Protocol | Open | Open Peer Review | Published:
A systematic review of patient safety in mental health: a protocol based on the inpatient setting
Systematic Reviewsvolume 5, Article number: 203 (2016)
Despite the growing international interest in patient safety as a discipline, there has been a lack of exploration of its application to mental health. It cannot be assumed that findings based upon physical health in acute care hospitals can be applied to mental health patients, disorders and settings. To the authors’ knowledge, there has only been one review of the literature that focuses on patient safety research in mental health settings, conducted in Canada in 2008. We have identified a need to update this review and develop the methodology in order to strengthen the findings and disseminate internationally for advancement in the field. This systematic review will explore the existing research base on patient safety in mental health within the inpatient setting.
To conduct this systematic review, a thorough search across multiple databases will be undertaken, based upon four search facets (“mental health”, “patient safety”, “research” and “inpatient setting”). The search strategy has been developed based upon the Canadian review accompanied with input from the National Reporting and Learning System (NRLS) taxonomy of patient safety incidents and the Diagnostic and Statistical Manual of Mental Disorders (fifth edition). The screening process will involve perspectives from at least two researchers at all stages with a third researcher invited to review when discrepancies require resolution. Initial inclusion and exclusion criteria have been developed and will be refined iteratively throughout the process. Quality assessment and data extraction of included articles will be conducted by at least two researchers. A data extraction form will be developed, piloted and iterated as necessary in accordance with the research question. Extracted information will be analysed thematically.
We believe that this systematic review will make a significant contribution to the advancement of patient safety in mental health inpatient settings. The findings will enable the development and implementation of interventions to improve the quality of care experienced by patients and support the identification of future research priorities.
Systematic review registration
Patient safety refers to the prevention of harm as a result of receiving healthcare services . This includes events such as mistakes during procedures and accidents that happen during hospital stays. There has been growing interest in patient safety as a discipline in recent years [2, 3]. The vast majority of this body of research to date has focused on physical healthcare; however, it cannot be assumed that findings based upon physical health patients can be applied to mental health patients, disorders and settings. This is due to the different challenges that are presented in this specialised area of care .
There has been exploration of specific adverse events that occur within acute mental health facilities, such as suicide and self-harm [5–8], with prevalence rates and precipitating factors examined regularly. There have also been aspects of patient safety touched upon in quality of care research within mental health facilities, for example, audit and quality of care intervention studies [9, 10]. A systematic review has also been conducted collating the literature regarding quality of care for institutionalised mental health patients . This review highlighted incidents such as restraint and seclusion as important aspects of quality of care but did not discuss patient safety as a whole. Although patient safety can be seen as a subset of quality of care, they are not synonymous, with research on the quality of healthcare sometimes lacking a focus on patient safety issues .
Research involving patient safety systems and management as a whole is lacking, as are attempts to apply patient safety as a complete concept directly to mental health research . This may be because mental health in general has been viewed as a neglected area in which patients may be less likely to have a voice when it comes to their care and safety . It has also been suggested that the social stigma surrounding mental health issues has the potential in itself to contribute to patient safety being neglected .
A Canadian Report published in 2009  is the only review of the literature to our knowledge that has explored the role of patient safety in mental health. This work makes a valid contribution to the emerging field of patient safety in mental health but has flaws that require addressing. Firstly, the literature review is now out of date, with evidence being collected in 2008. Secondly, the work focussed on a pre-specified set of patient safety incidents, so other areas of patient safety concern could have been neglected. Finally, the review was not published in an academic journal as far as we are aware, and there is a lack of methodological detail given in the report, limiting readers' understanding of its methodological rigour. The review does not specify any independent reviewing process, inter-reviewer agreement calculation, inclusion or exclusion criteria or assessment of the quality of the research included. This restricts broader access to the findings and makes it difficult to ensure that the processes of article selection and data extraction were conducted systematically. It is for these reasons that it is thought important to develop the methodology by undertaking a full systematic review as a first step towards a broader research programme on patient safety in mental health at the NIHR Imperial Patient Safety Translational Research Centre (PSTRC). The importance of high-quality systematic reviews in the patient safety research field has been emphasised .
This systematic review aims to bring together research within mental health to provide a clear picture of what we know about patient safety within this context. In order to deliver high-quality care to service users, it is essential that a stronger understanding of patient safety in mental health is developed and disseminated.
This systematic review aims to report an overview of the existing research base on patient safety in mental health within inpatient settings and critically reflect on the method and quality of existing studies. This review will inform patient safety practices in inpatient mental health settings, highlighting the best practice as well as gaps in knowledge to provide areas for further research that could lead to improvement in patient care.
The checklist included as an Additional file 1 has been used to guide the information included in this protocol.
This systematic review focuses on research conducted within the inpatient setting; this includes two core areas. The first area is mental healthcare inpatient settings (e.g. secure forensic units). The second area is an inpatient setting (i.e. within acute care) where a person with a mental health diagnosis is in receipt of healthcare for a physical problem.
The four key facets for this systematic review are:
“Mental Health” defined as a field comprising various professions, such as psychiatry and clinical psychology that deal with the promotion of mental and psychological well-being and the prevention, diagnosis or treatment of mental disorders as listed in the Diagnostic and Statistical Manual fifth edition 
“Patient Safety” defined as “The avoidance, prevention and amelioration of adverse outcomes or injuries stemming from the process of healthcare” 
“Research” defined as diligent and systematic inquiry or investigation into a subject in order to produce generalisable knowledge and to discover or revise facts, theories, applications, etc.
“Inpatient Setting” defined as hospital settings which provide continuous care for a period of over 24 h
The search terms will be restricted to title and abstract only. The time period will be restricted to work published in or after 1999 (in line with the seminal publication of the Institute of Medicine’s report “To Err is Human: Building a Safer Health System” ). This review will be purposely broad in order to effectively ground future research in this area.
Initial inclusion and exclusion criteria have been developed based upon the definitions included above and will be further iterated by the research team as part of the ongoing process.
Population: Article must report on patients being treated within mental health services (“Mental Health” being defined as a field comprising various professions, such as psychiatry and social work, that deals with the promotion of mental and psychological well-being and the prevention, diagnosis or treatment of mental disorders as listed in the Diagnostic and Statistical Manual fifth edition ) or having a diagnosis of mental disorder.
Intervention/outcomes: Articles must report on interventions or data related to “Patient Safety” (defined as “The avoidance, prevention and amelioration of adverse outcomes or injuries stemming from the process of healthcare” ).
Comparators: There are no restrictions on articles regarding the use or lack of comparison groups
Timing: Article must be published in, or after, the year 1999.
Setting: Article must report on the “Inpatient Setting” (defined as hospital settings which provide continuous care for a period of over 24 h).
Population: Articles based purely on physical healthcare patients with no connection to mental health and well-being (not mental health)
Intervention/outcomes: Articles based purely upon non-safety-related issues, e.g. general patient experience or clinical effectiveness of specific treatments (not patient safety)
Comparators: There are no restrictions on articles regarding the use or lack of comparison groups
Timing: Articles published before 1999
Setting: Articles based purely upon primary care, community care or social care (not inpatient setting)
Other general exclusion criteria:
Articles not in English
Conference abstracts/protocols/book chapters
Articles that present opinion/editorials/commentaries/clinical case reviews (not research)
After conducting the title and abstract screening and discussing across the research team, the criteria were developed to specify the focus for the full-text review. The initial additional criteria for the full-text review phase are outlined below:
Population: Articles that amalgamate data from both inpatient and outpatient settings such that data for an inpatient only sample is not available
Interventions/outcomes: Articles that solely examine the reliability or validity of risk assessment tools, with no relation to the management of the risk that the tool is measuring
Other general exclusion criteria:
Articles that are reviews of any kind (including literature and systematic reviews)
Articles that are not empirical research (i.e. articles that do not have a clearly defined hypothesis or research question that aims to generate new knowledge in this field of research)
We will consider all study designs in this systematic review. Articles must present “research” (defined as diligent and systematic inquiry or investigation into a subject in order to discover or revise facts, theories, applications, etc.)
The core stages of the literature search are listed below. We have currently completed the title and abstract phase. Further detail on each stage is provided later in this protocol:
Run search and restrict terms to title and abstract only (searches may need to be run individually in each database in order to include the appropriate MeSH terms and specifications etc.)
Combine searches from all databases and remove duplicates using both an electronic and manual approach
Title and abstract screening according to inclusion and exclusion criteria
Full-text screening according to inclusion and exclusion criteria. Hand searching will also be conducted based on reference lists
Quality and risk of bias assessment
Data extraction against key research questions
Synthesis, assessment of the strength of the body of evidence and write up
Dissemination (i.e. publication and presentation) and application (i.e. through the development of research studies)
However, it is important to emphasise that in reality, a systematic review is not usually a simple linear process but instead is iterative in nature . The flow diagram included below in Fig. 1 demonstrates how the stages are expected to interact with and influence one another. Further iterations of this flow chart will be developed throughout the project to represent changes and to capture key numbers. This protocol will also be updated and amended as and when necessary throughout the review process.
Our search strategy is presented below in Table 1. The taxonomy used in the NRLS for England and Wales has been used to identify additional search terms associated with patient safety that were not included in the original Canadian review due to their restrictions on included incident types. The taxonomy was not amended, to ensure all incident types that may be included in the literature were picked up in our search and to avoid any assumptions being made by the researchers about the relative importance of incident types within mental health. The search terms have been developed by gaining multiple expert perspectives on various iterations of them. They have been iterated to include the appropriate truncation and syntax in order to run the searches on each individual database of interest.
Health Management Information Consortium (HMIC)
Web of Science
Cumulative Index to Nursing and Allied Health Literature (CINAHL)
Grey literature and hand searching
Google and Google Scholar will also be searched using key phrases in line with the search strategy. The first 20 pages of results will be screened initially, as a large number of results are anticipated, and time resources need to be considered. The amount of new information being garnered from these first 20 pages will be assessed, and the page limit extended if it is felt that this would produce more original data. The reference lists of the eligible articles identified after full-text screening by the main search strategy will be reviewed by the research team to ensure that no key articles have been missed.
Perspectives from at least two reviewers will be gained on decision-making throughout the screening process. Pilot screening of a random sample of abstracts has been conducted with at least two reviewers screening independently. Disagreements have been discussed with other researchers within the team to gain consensus and to adapt and clarify the inclusion and exclusion criteria if needed.
After this stage, one reviewer has screened all abstracts, with a second reviewer independently screening a random sample of 10%. A kappa statistic will be calculated to assess inter-reviewer agreement. Full text screening is currently underway with input being provided from all members of the research team.
Studies will not be excluded on the basis of quality, but the quality of studies will be assessed and presented descriptively in order to inform the current state of knowledge in this area. Hawker et al.’s  quality assessment tool will be used to appraise studies, as the data garnered through this systematic review is anticipated to be varied and this tool is designed to be applicable to both quantitative and qualitative studies. Hawker’s checklist evaluates nine domains: (1) abstract/title, (2) introduction and aims, (3) method and data, (4) sampling, (5) data analysis, (6) ethics and bias, (7) results, (8) transferability and generalisability and (9) implications and usefulness. The quality of these nine domains will be assessed according to four descriptors: very poor, poor, fair and good. A global assessment of the quality of each article will then be undertaken by collating this information. This will allow for evaluation across the variety of methodologies we anticipate to garner from this review. The quality assessment tool will be applied to all included articles by two reviewers, and results will be compared and discussed with input from the broader research team.
Data will be extracted from included articles in line with the core research question driving this systematic review. A data extraction form will be developed, piloted and applied across all articles. If key information is not available in an article, the research team will contact the authors and request additional data. Again, perspectives from at least two reviewers will be employed to ensure that the relevant data is selected and extracted in the most systematic way possible. Table 2 is an example of the type of evidence table that will be used to record and extract data from included articles.
Software such as Endnote and Excel are being used to keep track of references and decision-making throughout the process. Endnote is being used to store and group references. Excel spreadsheets are being used to apply screening criteria systematically, record the reasoning behind decision-making and extract data from high-relevance articles in line with the research question.
Data synthesis is likely to be thematic in nature and influenced by the core research question (i.e. identifying key findings from the existing research base that can help set a future research agenda).
We will use a narrative synthesis approach as the data retrieved is likely to be heterogeneous, conducting meta-analysis/synthesis if and where appropriate.
Write-up, dissemination and use
The results will be written up in accordance with the PRISMA guidelines for peer-reviewed publication to support existing understanding and future research in this important area. They will also be used locally to support the development of a programme of work to improve patient safety in mental health in collaboration with local trusts.
Strengths and limitations of the review
The main strength of this systematic review is that it will be purposely broad in terms of patient safety issues and is expected to cover a wide range of literature. This will ensure that the review captures all relevant data and we are able to build a complete picture of the current state of the research area. The limitations will be that it will exclude articles that were published before 1999 and those that are not written in English and therefore may run the risk of bias, by presenting an ethnocentric view of the evidence. The focus on the inpatient setting alone may also be considered a criticism of this review, as we have therefore had to exclude any research conducted in other mental health settings that may have offered different research perspectives. However, we believe that different patient safety issues are likely to occur in different settings (i.e. inpatient setting compared to primary, community and social care) and therefore, it is important to explore them separately. We have chosen to focus on the inpatient setting as a priority due to its relation to our initial work programme as a translational patient safety research centre. Systematic reviews focussing upon primary, community and social care form part of our future work plan.
Relevance of the review
The findings of this systematic review will support the development of future academic research programmes based upon patient safety in mental health. They will also support the design of interventions to protect patient safety in this area and improve the quality of care that individuals receive. In this sense, they will be of relevance to multiple groups including patients, researchers, policy makers, healthcare managers and clinicians.
Vincent CA, Pincus T, Scurr JH. Patients’ experience of surgical accidents. Qual Health Care. 1993;2(2):77–82.
Francis, Robert. Report of the Mid Staffordshire NHS foundation trust public inquiry: executive summary, Vol 947. The Stationery Office; 2013
Vincent C, Amalberti R. Safety in healthcare is a moving target. BMJ Qual Saf. 2015;24:539–40.
Brickell TA, Nicholls TL, Procyshyn RM, McLean C, Dempster RJ, Lavoie JAA, Sahlstrom KJ, Tomita TM, Wang E. Patient safety in mental health. Edmonton: Canadian Patient Safety Institute and Ontario Hospital Association; 2009.
Goh SE, Salmons PH, Whittington RM. Hospital suicides: are there preventable factors? Profile of the psychiatric hospital suicide. Br J Psychiatry. 1989;154(2):247–9.
Gray NS, Hill C, McGleish A, Timmons D, MacCulloch MJ, Snowden RJ. Prediction of violence and self-harm in mentally disordered offenders: a prospective study of the efficacy of HCR-20, PCL-R, and psychiatric symptomatology. J Consult Clin Psychol. 2003;71(3):443.
Powell J, Geddes J, Hawton K, Deeks J, Goldacre M. Suicide in psychiatric hospital in-patients. Br J Psychiatry. 2000;176(3):266–72.
Roy A, Draper R. Suicide among psychiatric hospital in-patients. Psychol Med. 1995;25(01):199–202.
Hunter ME, Love CC. Total quality management and the reduction of inpatient violence and costs in a forensic psychiatric hospital. Psychiatr Serv. 1996;47(7):751–4.
Olusina AK, Ohaeri JU, Olatawura MO. Patient and staff satisfaction with the quality of in-patient psychiatric care in a Nigerian general hospital. Soc Psychiatry Psychiatr Epidemiol. 2002;37(6):283–8.
Taylor TL, Killaspy H, Wright C, Turton P, White S, Kallert TW, Kališová L. A systematic review of the international published literature relating to quality of institutional care for people with longer term mental health problems. Bmc Psychiatry. 2009;9(1):1.
Vincent C. Patient safety. Edinburgh: Churchill Livingstone; 2006. p. 42.
Mind (n.d.). Ward Watch: Mind’s campaign to improve hospital conditions for mental health patients.
Brown KF, Long SJ, Athanasiou T, Vincent CA, Kroll JS, Sevdalis N. Reviewing methodologically disparate data: a practical guide for the patient safety research field. J Eval Clin Pract. 2010;18(1):172–81.
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (5th ed., text revision). Washington, DC: American Psychiatric Association; 2013.
Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system. Committee on Quality of Health Care in America, Institute of Medicine; 1999
Hawker S, Payne S, Kerr C, Hardey M, Powell J. Appraising the evidence: reviewing disparate data systematically. Qual Health Res. 2002;12(9):1284–99.
The authors would like to acknowledge Dr Sheila Adam, Professor Bryony Dean Franklin, Ms Navila Chaudhry, Ms Tayana Soukup, Dr Josephine Ocloo and Ms Susan Burnett for reviewing and commenting upon various versions of this protocol.
This article represents independent research supported by the National Institute for Health Research (NIHR) Imperial Patient Safety Translational Research Centre. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.
Availability of data and materials
DD contributed to the conceptualisation and wrote the protocol. SA contributed to the conceptualisation and commented on the multiple versions of the protocol. BT contributed to the conceptualisation, commented on the multiple versions of the protocol and made amendments to the final version of the protocol. CR contributed to the conceptualisation and commented on the multiple versions of the protocol. LD commented on the latest version of the protocol. AD contributed to the conceptualisation and oversaw the broader work stream on mental health in patient safety at the NIHR Imperial Patient Safety Translational Research Centre. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist: recommended items to address in a systematic review protocol*. (DOC 81 kb)