A systematic review of patient safety in mental health: a protocol based on the inpatient setting
© The Author(s). 2016
Received: 21 June 2016
Accepted: 31 October 2016
Published: 29 November 2016
Despite the growing international interest in patient safety as a discipline, there has been a lack of exploration of its application to mental health. It cannot be assumed that findings based upon physical health in acute care hospitals can be applied to mental health patients, disorders and settings. To the authors’ knowledge, there has only been one review of the literature that focuses on patient safety research in mental health settings, conducted in Canada in 2008. We have identified a need to update this review and develop the methodology in order to strengthen the findings and disseminate internationally for advancement in the field. This systematic review will explore the existing research base on patient safety in mental health within the inpatient setting.
To conduct this systematic review, a thorough search across multiple databases will be undertaken, based upon four search facets (“mental health”, “patient safety”, “research” and “inpatient setting”). The search strategy has been developed based upon the Canadian review accompanied with input from the National Reporting and Learning System (NRLS) taxonomy of patient safety incidents and the Diagnostic and Statistical Manual of Mental Disorders (fifth edition). The screening process will involve perspectives from at least two researchers at all stages with a third researcher invited to review when discrepancies require resolution. Initial inclusion and exclusion criteria have been developed and will be refined iteratively throughout the process. Quality assessment and data extraction of included articles will be conducted by at least two researchers. A data extraction form will be developed, piloted and iterated as necessary in accordance with the research question. Extracted information will be analysed thematically.
We believe that this systematic review will make a significant contribution to the advancement of patient safety in mental health inpatient settings. The findings will enable the development and implementation of interventions to improve the quality of care experienced by patients and support the identification of future research priorities.
Systematic review registration
KeywordsPatient safety Mental health Research Inpatient setting
Patient safety refers to the prevention of harm as a result of receiving healthcare services . This includes events such as mistakes during procedures and accidents that happen during hospital stays. There has been growing interest in patient safety as a discipline in recent years [2, 3]. The vast majority of this body of research to date has focused on physical healthcare; however, it cannot be assumed that findings based upon physical health patients can be applied to mental health patients, disorders and settings. This is due to the different challenges that are presented in this specialised area of care .
There has been exploration of specific adverse events that occur within acute mental health facilities, such as suicide and self-harm [5–8], with prevalence rates and precipitating factors examined regularly. There have also been aspects of patient safety touched upon in quality of care research within mental health facilities, for example, audit and quality of care intervention studies [9, 10]. A systematic review has also been conducted collating the literature regarding quality of care for institutionalised mental health patients . This review highlighted incidents such as restraint and seclusion as important aspects of quality of care but did not discuss patient safety as a whole. Although patient safety can be seen as a subset of quality of care, they are not synonymous, with research on the quality of healthcare sometimes lacking a focus on patient safety issues .
Research involving patient safety systems and management as a whole is lacking, as are attempts to apply patient safety as a complete concept directly to mental health research . This may be because mental health in general has been viewed as a neglected area in which patients may be less likely to have a voice when it comes to their care and safety . It has also been suggested that the social stigma surrounding mental health issues has the potential in itself to contribute to patient safety being neglected .
A Canadian Report published in 2009  is the only review of the literature to our knowledge that has explored the role of patient safety in mental health. This work makes a valid contribution to the emerging field of patient safety in mental health but has flaws that require addressing. Firstly, the literature review is now out of date, with evidence being collected in 2008. Secondly, the work focussed on a pre-specified set of patient safety incidents, so other areas of patient safety concern could have been neglected. Finally, the review was not published in an academic journal as far as we are aware, and there is a lack of methodological detail given in the report, limiting readers' understanding of its methodological rigour. The review does not specify any independent reviewing process, inter-reviewer agreement calculation, inclusion or exclusion criteria or assessment of the quality of the research included. This restricts broader access to the findings and makes it difficult to ensure that the processes of article selection and data extraction were conducted systematically. It is for these reasons that it is thought important to develop the methodology by undertaking a full systematic review as a first step towards a broader research programme on patient safety in mental health at the NIHR Imperial Patient Safety Translational Research Centre (PSTRC). The importance of high-quality systematic reviews in the patient safety research field has been emphasised .
This systematic review aims to bring together research within mental health to provide a clear picture of what we know about patient safety within this context. In order to deliver high-quality care to service users, it is essential that a stronger understanding of patient safety in mental health is developed and disseminated.
This systematic review aims to report an overview of the existing research base on patient safety in mental health within inpatient settings and critically reflect on the method and quality of existing studies. This review will inform patient safety practices in inpatient mental health settings, highlighting the best practice as well as gaps in knowledge to provide areas for further research that could lead to improvement in patient care.
The checklist included as an Additional file 1 has been used to guide the information included in this protocol.
This systematic review focuses on research conducted within the inpatient setting; this includes two core areas. The first area is mental healthcare inpatient settings (e.g. secure forensic units). The second area is an inpatient setting (i.e. within acute care) where a person with a mental health diagnosis is in receipt of healthcare for a physical problem.
“Mental Health” defined as a field comprising various professions, such as psychiatry and clinical psychology that deal with the promotion of mental and psychological well-being and the prevention, diagnosis or treatment of mental disorders as listed in the Diagnostic and Statistical Manual fifth edition 
“Patient Safety” defined as “The avoidance, prevention and amelioration of adverse outcomes or injuries stemming from the process of healthcare” 
“Research” defined as diligent and systematic inquiry or investigation into a subject in order to produce generalisable knowledge and to discover or revise facts, theories, applications, etc.
“Inpatient Setting” defined as hospital settings which provide continuous care for a period of over 24 h
The search terms will be restricted to title and abstract only. The time period will be restricted to work published in or after 1999 (in line with the seminal publication of the Institute of Medicine’s report “To Err is Human: Building a Safer Health System” ). This review will be purposely broad in order to effectively ground future research in this area.
Initial inclusion and exclusion criteria have been developed based upon the definitions included above and will be further iterated by the research team as part of the ongoing process.
Population: Article must report on patients being treated within mental health services (“Mental Health” being defined as a field comprising various professions, such as psychiatry and social work, that deals with the promotion of mental and psychological well-being and the prevention, diagnosis or treatment of mental disorders as listed in the Diagnostic and Statistical Manual fifth edition ) or having a diagnosis of mental disorder.
Intervention/outcomes: Articles must report on interventions or data related to “Patient Safety” (defined as “The avoidance, prevention and amelioration of adverse outcomes or injuries stemming from the process of healthcare” ).
Comparators: There are no restrictions on articles regarding the use or lack of comparison groups
Timing: Article must be published in, or after, the year 1999.
Setting: Article must report on the “Inpatient Setting” (defined as hospital settings which provide continuous care for a period of over 24 h).
Population: Articles based purely on physical healthcare patients with no connection to mental health and well-being (not mental health)
Intervention/outcomes: Articles based purely upon non-safety-related issues, e.g. general patient experience or clinical effectiveness of specific treatments (not patient safety)
Comparators: There are no restrictions on articles regarding the use or lack of comparison groups
Timing: Articles published before 1999
Setting: Articles based purely upon primary care, community care or social care (not inpatient setting)
Articles not in English
Conference abstracts/protocols/book chapters
Articles that present opinion/editorials/commentaries/clinical case reviews (not research)
After conducting the title and abstract screening and discussing across the research team, the criteria were developed to specify the focus for the full-text review. The initial additional criteria for the full-text review phase are outlined below:
Population: Articles that amalgamate data from both inpatient and outpatient settings such that data for an inpatient only sample is not available
Interventions/outcomes: Articles that solely examine the reliability or validity of risk assessment tools, with no relation to the management of the risk that the tool is measuring
Articles that are reviews of any kind (including literature and systematic reviews)
Articles that are not empirical research (i.e. articles that do not have a clearly defined hypothesis or research question that aims to generate new knowledge in this field of research)
We will consider all study designs in this systematic review. Articles must present “research” (defined as diligent and systematic inquiry or investigation into a subject in order to discover or revise facts, theories, applications, etc.)
Run search and restrict terms to title and abstract only (searches may need to be run individually in each database in order to include the appropriate MeSH terms and specifications etc.)
Combine searches from all databases and remove duplicates using both an electronic and manual approach
Title and abstract screening according to inclusion and exclusion criteria
Full-text screening according to inclusion and exclusion criteria. Hand searching will also be conducted based on reference lists
Quality and risk of bias assessment
Data extraction against key research questions
Synthesis, assessment of the strength of the body of evidence and write up
Dissemination (i.e. publication and presentation) and application (i.e. through the development of research studies)
Search terms against each facet
Mental well being.ti,ab.
Psychological well being.ti,ab.
Impulse control disorder*1.ti,ab.
Substance related disorder*1.ti,ab.
New psychoactive substance*1.ti,ab.
Obsessive compulsive disorder*1.ti,ab.
Post traumatic stress disorder*1.ti,ab.
Post-traumatic stress disorder*1.ti,ab.
Cognitive Behavio?ral Therap*.ti,ab.
Person centred therap*.ti,ab.
Mindfulness based cognitive therap*.ti,ab.
Mindfulness-based cognitive therap*.ti,ab.
Mindfulness based relapse prevention.ti,ab.
Mindfulness-based relapse prevention.ti,ab.
Mindfulness based stress reduction.ti,ab.
Mindfulness-based stress reduction.ti,ab.
Dialectical Behavio?r Therap*.ti,ab.
Adverse drug event*1.ti,ab.
Failure to diagnose.ti,ab.
Failure of diagnos#s.ti,ab.
Delay in diagnos#s.ti,ab.
Patient in road traffic accident*1.ti,ab.
Collision with an object.ti,ab.
Contact with an object.ti,ab.
Contact with sharp*1.ti,ab.
Collision with sharp*1.ti,ab.
Exposure to hazardous substance*1.ti,ab.
Inappropriate patient handling.ti,ab.
Inappropriate patient positioning.ti,ab.
Failure in access.ti,ab.
Transfer to specialist care unit*1.ti,ab.
Delay in discharge.ti,ab.
Failure to discharge.ti,ab.
Discharge against medical advice.ti,ab.
Failure in referral process*.ti,ab.
Failure to return from authorised leave.ti,ab.
Unsafe clinical environment*1.ti,ab.
Inappropriate clinical environment*1.ti,ab.
Inappropriate admission of a minor to an adult setting.ti,ab.
Inappropriate transfer of a minor to an adult setting.ti,ab.
Poor clinical assessment*1.ti,ab.
Lack of clinical assessment*1.ti,ab.
Lack of risk assessment*1.ti,ab.
Failure to interpret test result*1.ti,ab.
Delay to interpret test result*1.ti,ab.
Failure to act on test result*1.ti,ab.
Delay to act on test result*1.ti,ab.
Failure to receive test result*1.ti,ab.
Delay to receive test result*1.ti,ab.
Incorrect test result*1.ti,ab.
Missing test result*1.ti,ab.
Failure to undertake test*.ti,ab.
Delay to undertake test*.ti,ab.
Failure in communication*1.ti,ab.
Failure to receive informed consent.ti,ab.
Mislabelled healthcare record*1.ti,ab.
Inadequate healthcare record*1.ti,ab.
Missing healthcare record*1.ti,ab.
Wrong healthcare record*1.ti,ab.
Illegible healthcare record*1.ti,ab.
Mislabelled referral letter*1.ti,ab.
Inadequate referral letter*1.ti,ab.
Missing referral letter*1.ti,ab.
Wrong referral letter*1.ti,ab.
Illegible referral letter*1.ti,ab.
No access to documentation.ti,ab.
Patient incorrectly identified.ti,ab.
Delay in obtaining clinical assistance.ti,ab.
Difficulty in obtaining clinical assistance.ti,ab.
Delay in recogni#ing complication*1 of treatment.ti,ab.
Failure in recogni#ing complication*1 of treatment.ti,ab.
Delay in monitoring.ti,ab.
Failure to monitor.ti,ab.
Failure to follow up.ti,ab.
Failure of sterili#ation of equipment.ti,ab.
Contamination of equipment.ti,ab.
Health care acquired infection*1.ti,ab.
Healthcare acquired infection*1.ti,ab.
Health care associated infection*1.ti,ab.
Healthcare associated infection*1.ti,ab.
Surgical site infection*1.ti,ab.
Availability of equipment.ti,ab.
Availability of bed*1.ti,ab.
Availability of IT.ti,ab.
Unavailability of staff.ti,ab.
Lack of skilled staff.ti,ab.
Lack of suitably trained staff.ti,ab.
Failure of device*1.ti,ab.
Failure of equipment.ti,ab.
Unavailability of device*1.ti,ab.
Extended episode*1 of care.ti,ab.
Failure to discontinue treatment*1.ti,ab.
Theatre list details incorrect.ti,ab.
Unplanned return to theatre.ti,ab.
Intensive Therapy Unit Admission*1.ti,ab.
Intensive Treatment Unit Admission*1.ti,ab.
Intensive Care Unit Admission*1.ti,ab.
Readmission of mother.ti,ab.
Term baby admitted to neonatal unit.ti,ab.
Undiagnosed f?etal abnormalit*.ti,ab.
Randomised controlled trial*1.ti,ab.
Controlled clinical trial*1.ti,ab.
Double blind method.ti,ab.
Single blind method.ti,ab.
Single blind stud*.ti,ab.
Double blind stud*.ti,ab.
Triple blind stud*.ti,ab.
Follow up stud*.ti,ab.
Quality improvement project*1.ti,ab.
Nominal group technique*1.ti,ab.
Nominal group stud*.ti,ab.
Health Management Information Consortium (HMIC)
Web of Science
Cumulative Index to Nursing and Allied Health Literature (CINAHL)
Grey literature and hand searching
Google and Google Scholar will also be searched using key phrases in line with the search strategy. The first 20 pages of results will be screened initially, as a large number of results are anticipated, and time resources need to be considered. The amount of new information being garnered from these first 20 pages will be assessed, and the page limit extended if it is felt that this would produce more original data. The reference lists of the eligible articles identified after full-text screening by the main search strategy will be reviewed by the research team to ensure that no key articles have been missed.
Perspectives from at least two reviewers will be gained on decision-making throughout the screening process. Pilot screening of a random sample of abstracts has been conducted with at least two reviewers screening independently. Disagreements have been discussed with other researchers within the team to gain consensus and to adapt and clarify the inclusion and exclusion criteria if needed.
After this stage, one reviewer has screened all abstracts, with a second reviewer independently screening a random sample of 10%. A kappa statistic will be calculated to assess inter-reviewer agreement. Full text screening is currently underway with input being provided from all members of the research team.
Studies will not be excluded on the basis of quality, but the quality of studies will be assessed and presented descriptively in order to inform the current state of knowledge in this area. Hawker et al.’s  quality assessment tool will be used to appraise studies, as the data garnered through this systematic review is anticipated to be varied and this tool is designed to be applicable to both quantitative and qualitative studies. Hawker’s checklist evaluates nine domains: (1) abstract/title, (2) introduction and aims, (3) method and data, (4) sampling, (5) data analysis, (6) ethics and bias, (7) results, (8) transferability and generalisability and (9) implications and usefulness. The quality of these nine domains will be assessed according to four descriptors: very poor, poor, fair and good. A global assessment of the quality of each article will then be undertaken by collating this information. This will allow for evaluation across the variety of methodologies we anticipate to garner from this review. The quality assessment tool will be applied to all included articles by two reviewers, and results will be compared and discussed with input from the broader research team.
Sample evidence table
Outcomes/data related to patient safety
Mezey, Hassell & Batlett (2005)
Medium-secure NHS psychiatric units (England and Wales)
31 female inpatients
58 staff (9 consultant forensic psychiatrists, 9 ward managers, 18 staff nurses, 9 nursing support workers, 3 social workers, 5 psychologists and 5 occupational therapist). 53% women, 47% men.
To examine the impact of gender segregation on the safety of women patients detained in medium-secure psychiatric facilities.
Women patients in both types of units reported high levels of actual and threatened physical and sexual violence. Women in single-sex units reported intimidation, threats and abuse by other women patients, although they were less vulnerable to sexual abuse and exploitation and serious physical assault.
Will be assessed and scored from ‘Good’ to ‘Very Poor’ based upon Hawker et al. (2002)
Meehan, Morrison & McDougall (1999)
Case review and interview
Acute psychiatric unit on the grounds of a public hospital
All participants who were recorded as AWOL in the unit’s register within a 6-month study period.
Interviews: 14 patients (9 males, 5 females; 19–58 years old) who were interviewed within 48 h of returning from being AWOL.
To identify patient and environmental characteristics associated with absconding behaviour and to gain an understanding of the behaviour form the patient’s perspective.
Those who absconded were male (58%), under 40 years of age (74%), admitted involuntarily (78%), and had a diagnosis of schizophrenia (42%). One third of all AWOL incidents resulted from repeated absconding by the same individuals. The first 7 days post admission was a high-risk period for absconding behaviour. Identified situational and environmental factors likely to increase the risk of absconding included: staff skills, communication and management strategies.
Software such as Endnote and Excel are being used to keep track of references and decision-making throughout the process. Endnote is being used to store and group references. Excel spreadsheets are being used to apply screening criteria systematically, record the reasoning behind decision-making and extract data from high-relevance articles in line with the research question.
Data synthesis is likely to be thematic in nature and influenced by the core research question (i.e. identifying key findings from the existing research base that can help set a future research agenda).
We will use a narrative synthesis approach as the data retrieved is likely to be heterogeneous, conducting meta-analysis/synthesis if and where appropriate.
Write-up, dissemination and use
The results will be written up in accordance with the PRISMA guidelines for peer-reviewed publication to support existing understanding and future research in this important area. They will also be used locally to support the development of a programme of work to improve patient safety in mental health in collaboration with local trusts.
Strengths and limitations of the review
The main strength of this systematic review is that it will be purposely broad in terms of patient safety issues and is expected to cover a wide range of literature. This will ensure that the review captures all relevant data and we are able to build a complete picture of the current state of the research area. The limitations will be that it will exclude articles that were published before 1999 and those that are not written in English and therefore may run the risk of bias, by presenting an ethnocentric view of the evidence. The focus on the inpatient setting alone may also be considered a criticism of this review, as we have therefore had to exclude any research conducted in other mental health settings that may have offered different research perspectives. However, we believe that different patient safety issues are likely to occur in different settings (i.e. inpatient setting compared to primary, community and social care) and therefore, it is important to explore them separately. We have chosen to focus on the inpatient setting as a priority due to its relation to our initial work programme as a translational patient safety research centre. Systematic reviews focussing upon primary, community and social care form part of our future work plan.
Relevance of the review
The findings of this systematic review will support the development of future academic research programmes based upon patient safety in mental health. They will also support the design of interventions to protect patient safety in this area and improve the quality of care that individuals receive. In this sense, they will be of relevance to multiple groups including patients, researchers, policy makers, healthcare managers and clinicians.
The authors would like to acknowledge Dr Sheila Adam, Professor Bryony Dean Franklin, Ms Navila Chaudhry, Ms Tayana Soukup, Dr Josephine Ocloo and Ms Susan Burnett for reviewing and commenting upon various versions of this protocol.
This article represents independent research supported by the National Institute for Health Research (NIHR) Imperial Patient Safety Translational Research Centre. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.
Availability of data and materials
DD contributed to the conceptualisation and wrote the protocol. SA contributed to the conceptualisation and commented on the multiple versions of the protocol. BT contributed to the conceptualisation, commented on the multiple versions of the protocol and made amendments to the final version of the protocol. CR contributed to the conceptualisation and commented on the multiple versions of the protocol. LD commented on the latest version of the protocol. AD contributed to the conceptualisation and oversaw the broader work stream on mental health in patient safety at the NIHR Imperial Patient Safety Translational Research Centre. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Vincent CA, Pincus T, Scurr JH. Patients’ experience of surgical accidents. Qual Health Care. 1993;2(2):77–82.View ArticlePubMedPubMed CentralGoogle Scholar
- Francis, Robert. Report of the Mid Staffordshire NHS foundation trust public inquiry: executive summary, Vol 947. The Stationery Office; 2013
- Vincent C, Amalberti R. Safety in healthcare is a moving target. BMJ Qual Saf. 2015;24:539–40.View ArticlePubMedPubMed CentralGoogle Scholar
- Brickell TA, Nicholls TL, Procyshyn RM, McLean C, Dempster RJ, Lavoie JAA, Sahlstrom KJ, Tomita TM, Wang E. Patient safety in mental health. Edmonton: Canadian Patient Safety Institute and Ontario Hospital Association; 2009.Google Scholar
- Goh SE, Salmons PH, Whittington RM. Hospital suicides: are there preventable factors? Profile of the psychiatric hospital suicide. Br J Psychiatry. 1989;154(2):247–9.View ArticlePubMedGoogle Scholar
- Gray NS, Hill C, McGleish A, Timmons D, MacCulloch MJ, Snowden RJ. Prediction of violence and self-harm in mentally disordered offenders: a prospective study of the efficacy of HCR-20, PCL-R, and psychiatric symptomatology. J Consult Clin Psychol. 2003;71(3):443.View ArticlePubMedGoogle Scholar
- Powell J, Geddes J, Hawton K, Deeks J, Goldacre M. Suicide in psychiatric hospital in-patients. Br J Psychiatry. 2000;176(3):266–72.View ArticlePubMedGoogle Scholar
- Roy A, Draper R. Suicide among psychiatric hospital in-patients. Psychol Med. 1995;25(01):199–202.View ArticlePubMedGoogle Scholar
- Hunter ME, Love CC. Total quality management and the reduction of inpatient violence and costs in a forensic psychiatric hospital. Psychiatr Serv. 1996;47(7):751–4.View ArticlePubMedGoogle Scholar
- Olusina AK, Ohaeri JU, Olatawura MO. Patient and staff satisfaction with the quality of in-patient psychiatric care in a Nigerian general hospital. Soc Psychiatry Psychiatr Epidemiol. 2002;37(6):283–8.View ArticlePubMedGoogle Scholar
- Taylor TL, Killaspy H, Wright C, Turton P, White S, Kallert TW, Kališová L. A systematic review of the international published literature relating to quality of institutional care for people with longer term mental health problems. Bmc Psychiatry. 2009;9(1):1.View ArticleGoogle Scholar
- Vincent C. Patient safety. Edinburgh: Churchill Livingstone; 2006. p. 42.Google Scholar
- Mind (n.d.). Ward Watch: Mind’s campaign to improve hospital conditions for mental health patients.
- Brown KF, Long SJ, Athanasiou T, Vincent CA, Kroll JS, Sevdalis N. Reviewing methodologically disparate data: a practical guide for the patient safety research field. J Eval Clin Pract. 2010;18(1):172–81.View ArticlePubMedGoogle Scholar
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (5th ed., text revision). Washington, DC: American Psychiatric Association; 2013.View ArticleGoogle Scholar
- Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system. Committee on Quality of Health Care in America, Institute of Medicine; 1999
- Hawker S, Payne S, Kerr C, Hardey M, Powell J. Appraising the evidence: reviewing disparate data systematically. Qual Health Res. 2002;12(9):1284–99.View ArticlePubMedGoogle Scholar