Standardising care in the ICU: a protocol for a scoping review of tools used to improve care delivery
Systematic Reviews volume 9, Article number: 164 (2020)
Increasing numbers of critically ill patients experience a prolonged intensive care unit stay contributing to greater physical and psychological morbidity, strain on families and cost to health systems. Quality improvement tools such as checklists concisely articulate best practices with the aim of improving quality and safety; however, these tools have not been designed for the specific needs of patients with prolonged ICU stay.
The primary objective of this review will be to determine the characteristics including format and content of multicomponent tools designed to standardise or improve ICU care. Secondary objectives are to describe the outcomes reported in these tools, the type of patients and settings studied, and to understand how these tools were developed and implemented in clinical practice.
We will search the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE, MEDLINE, PsycINFO, Web of Science, OpenGrey, NHS evidence and Trial Registries from January 2000 onwards. We will include primary research studies (e.g. experimental, quasi-experimental, observational and qualitative studies) recruiting more than 10 adult participants admitted to ICUs, high dependency units and weaning centres regardless of length of stay, describing quality improvement tools such as structured care plans or checklists designed to standardize more than one aspect of care delivery. We will extract data on study and patient characteristics, tool design and implementation strategies and measured outcomes. Two reviewers will independently screen citations for eligible studies and perform data extraction. Data will be synthesised with descriptive statistics; we will use a narrative synthesis to describe review findings.
The findings will be used to guide development of tools for use with prolonged ICU stay patients. Our group will use experience-based co-design methods to identify the most important actionable processes of care to include in quality improvement tools these patients. Such tools are needed to standardise practice and thereby improve quality of care. Illustrating the development and implementation methods used for such tools will help to guide translation of similar tools into ICU clinical practice and future research.
Systematic review registration
Increasing numbers of patients remain in intensive care units (ICUs) for longer than a week due to increased survival rates, comorbidity and age in the general population resulting in lower resilience to acute illness and longer recovery [1,2,3,4]. Various terminology is used to describe these patients including ‘persistent critical illness’ and ‘chronic critical illness’ (CCI). Persistent critical illness is used to describe the point at which a patient’s presenting condition no longer predicts their risk of mortality . Patients, however, continue to experience ongoing illness-related complications and organ failure . This differentiates these patients from those experiencing prolonged respiratory weaning or conditions with an inherently long recovery time such as Guillain-Barré syndrome. Chronic critical illness is also used to describe patients with a prolonged length of stay (LOS)  and refers to a medically complex group of patients with multiple co-morbidities, often of older age. This frailty can result in less physical resilience to withstand the insult of critical illness . For clarity, the term ‘prolonged ICU stay’ which encompasses both persistent and chronic critical illness, will be used in this paper to describe any patient with a stay of over 7 days. This timepoint is the lower threshold defined by Iwashyna et al. , who suggest that the transition to persistent critical illness occurs within a range of 7–22 days. These patients experience a range of complications, including muscle wasting  and long-term physical and functional deficits [8, 9], psychological distress , and cognitive deficits, leading to longer stays in hospital after ICU discharge  and prolonged recovery. They are more likely to die , and survivors are less likely to return home, often requiring ongoing nursing or residential care [12, 13]. Family members experience significant levels of psychological distress [14, 15], which may require involvement of social workers or psychologists.
The transition from acute critical illness to a prolonged ICU stay involves a shift in the goals of care. This frequently involves professions and specialities not typically involved in the acute phase of care, such as speech and language therapists, occupational therapists, social workers, and palliative care. The needs of this patient group are distinct and include rehabilitation. Family members require regularly updates and involvement in care . Clinicians report feeling dissatisfied with their management of these patients due to the need to prioritise care for more unstable patients , a dislike of caring for lower acuity patients and a lack of training .
Intensive care units are complex environments, involving the coordination of multiple healthcare professions, specialties and numerous tasks for patients with life-threatening conditions . Communication errors are common [18, 19] and contribute to patient harm and frustrations for clinicians [18, 20, 21]. In response to these errors, quality improvement tools including checklists, tools to structure ward rounds, bundles and protocols have been developed for the purposes of standardising care. These tools have the potential to improve safety [22, 23], patient, family and staff satisfaction , and understanding of goals of treatment [25,26,27,28], and can decrease ICU length of stay [17, 28]. However, these tools most commonly focus on medically orientated priorities of care delivery during the acute period of ICU admission [29,30,31]. Such tools may be less relevant to more stable patients requiring aspects of care delivery such as mobilisation, communication aids and patient-led goal setting [12, 32]. Additionally, many of these tools are designed for delivery of a single element of care, such as the prevention of infection associated with central line insertion, rather than the coordination of a range of tasks by the interprofessional team.
The ability of such tools to impact care is dependent on a wide range of factors , including successful implementation addressing local barriers to adoption, widespread ‘buy-in’ from clinicians and ongoing implementation strategies to sustain use . A 2013 systematic review of the impact of knowledge translation studies in ICU concluded that there was insufficient evidence to identify the most effective knowledge translation strategies for improving practice in the ICU, particularly for quality improvement measures which cannot be protocolised—however, it did not include qualitative literature .
Why is it important to do this review?
Given the demonstrable benefits of ICU quality improvement tools for patients in the acute phase of ICU admission, knowledge of the elements and factors that facilitate successful implementation could inform design of similar tools to address the distinct care needs of patients experiencing a prolonged ICU stay . This is particularly important given the rising prevalence of these patients and their cost to the healthcare system. To the best of our knowledge, no review has synthesised this information.
Our primary objective is to determine the characteristics (i.e., format, content) of multicomponent tools designed to standardise and/or improve care delivery in adult ICU patient management. Our secondary objectives are to describe (1) what outcomes are reported, how they are measured and their effect; (2) the type of patients studied; (3) how tools were developed including patients and/or family member involvement; and (4) how these tools are implemented in practice.
We have chosen a scoping review approach as described by Tricco et al.  and adapted from Arksey and O’Malley  as the most appropriate methodology to achieve our objective of mapping the different components of these tools and the research on them to date. We also anticipate a range of different methodologies and study designs, for which scoping reviews are the advised methodology .
The present protocol has been registered within the Open Science Framework platform (https://osf.io/z8mre). It is reported in accordance with the reporting guidance provided in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement and the PRISMA extension for Scoping Reviews (PRISMA-ScR)  see PRISMA-P checklist in Additional file 1).
Information sources and searches
A search strategy (Additional file 2) was created using a combination of MeSH terms and keyword combinations. We will adapt the search strategy for each database. We will search electronic databases including MEDLINE (Ovid), the Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE, PsycINFO and Web of Science from January 2000 onwards, to reflect current ICU care. We will search for ongoing or completed trials using the World Health Organisation International Clinical Trials Registry Platform (http://apps.who.int/trialsearch/) and systematic reviews via the Cochrane Library. We will search for grey literature using Opengrey (http://www.opengrey.eu/), NHS evidence (https://www.evidence.nhs.uk/), Google Scholar and Prospero. We will scan reference lists of included studies for other studies of relevance. We will exclude editorials, commentaries and animal studies. LA will contact authors where necessary for full-text papers or to enquire about unpublished work identified through protocols or trial registries. A draft search for MEDLINE (Ovid) is available in Additional file 2.
Articles will be selected according to the following criteria for study population, intervention and comparator and study design.
We will include studies recruiting adult patients aged 18 years and older admitted to an intensive or critical care unit, high dependency or a weaning centre, respiratory care unit or long-term acute care hospital (LTACH), regardless of length of stay. We will also include studies that include family members/caregivers and the healthcare practitioners responsible for the care of these patients as participants.
We will include studies that report on quality improvement interventions such as multicomponent structured care plans, goal sheets, or checklists designed to standardize or remind clinicians about more than one aspect of care delivery. We will exclude checklists for procedures such as central line insertion or tools such as care bundles with single objectives of care, e.g. to prevent ventilator-associated pneumonia. Protocols, including those for delirium prevention, sedation management, weaning, and mobilisation will also be excluded as we do not seek to produce a decision algorithm and therefore this format is outside the scope of this review. Examples of such tools are daily goals sheets [38, 17] and rounding checklists .We will exclude: 1. checklists for procedures such as central line insertion; 2. care bundles with single objectives of care e.g. to prevent ventilator-associated pneumonia; 3. Single objective protocols, including those for delirium prevention, sedation management, weaning, and mobilisation will also be excluded as we do not seek to produce a decision algorithm and therefore this format is outside the scope of this review.
We will include studies with an active comparator (i.e. another quality improvement tool), a passive comparator (i.e. usual care) and no comparator.
We will not make decisions related to inclusion of studies based on outcomes reported.
We will include all qualitative and quantitative study designs including experimental, quasi-experimental, observational studies and qualitative studies except case series, as this design is not appropriate for the evaluation of a Quality Improvement (QI) tool. For pragmatic reasons, we will only include studies published in English. We will include unpublished work in the form of conference proceedings and theses.
One author (LA) will independently screen titles and abstracts to remove obvious exclusions using Endnote X8. The full text of citations selected for potential inclusion will be retrieved and assessed independently by two authors (LA and CA) for eligibility, with a third reviewer (LR) available for arbitration if needed. All decisions will be recorded in an Excel file.
Data charting process
Two authors (LA and CA) will independently extract data using a Google form (Additional File 3) iteratively designed for this review by three authors (LA, CA and LR). The form captures the following variables:
Participants—participant characteristics (patient/family member/healthcare worker), country, setting (e.g. ICU or weaning unit), admitting speciality).
Study design—study type and methodology used
Tool—the type, design, frequency of completion, content and aims of the QI tool described
Tool development—we will extract data on how the tool was developed, including patient and family involvement and feasibility testing,
Tool implementation—methods used and evaluated using the Theoretical Domains Framework  to describe barriers and facilitators to adoption.
Outcomes—the effect of the interventions will be extracted including descriptive data and outcome measures used.
Differences in extracted data between the two reviewers will be resolved by discussion, and a third reviewer (LR) consulted if an agreement cannot be reached. LA will contact corresponding authors for missing information as needed (e.g. tool development or implementation strategies).
Critical appraisal of evidence sources
We will use the results of the MMAT  to help inform conclusions and recommendations from the scoping review, as a robust tool for describing quality of mixed-methods studies. The authors of the tool strongly discourage using stand-alone numerical scores for studies, and so we intend to use the tool as they advise to describe high-, medium- and low-quality studies .
Evidence synthesis, analysis and interpretation
We will summarise characteristics of included studies, including the setting (type of unit and country) and type of tool used using descriptive statistics.
To address our primary objective, we will present tables grouped according to tool type (e.g. checklist, care plan, goal sheet) describing the purpose and content of each tool. We will include reported outcomes, their measures (if applicable) and the effects of the intervention on these outcomes.
To address our secondary objectives, a table will be produced describing the patients and settings studied in each included tool, and tool development including source of content (e.g. published evidence, expert opinion) and whether patients and family members were involved in its development. Data on methods of tool implementation will be summarised with reported barriers and facilitators interpreted using the Theoretical Domains Framework.
International work  to identify and prioritise the processes of care that most improve the experience of patients with prolonged ICU stay and their families is ongoing, using principles of experience-based co-design. The findings of this review will inform the design and implementation of quality improvement tools to improve/standardise the delivery of these identified processes of care, to assist knowledge translation to clinical practice.
A previous systematic review  failed to identify any quality improvement tools specific to long stay patients in intensive care. An improved comprehension of how such tools are developed and implemented will help to guide translation for similar tools in ICU.
Limitations of our findings are anticipated due to heterogeneity in the tools studied and differences in the context in which they are applied, and the selection bias inherent with only including papers published in English, and after 2000. Limitations of scoping review methodology will mean that a synthesis of findings across articles is not possible.
This review will also provide a summary for clinicians seeking to better understand and utilise the range of quality improvement tools used to improve more than one aspect of care in the ICU.
Availability of data and materials
Intensive care unit
Chronic critical illness
Length of stay
Preferred Reporting Items for Systematic Reviews and Meta-Analyses, Scoping Review
Medical Subject Headings
Long-term acute care hospital
Iwashyna TJ, et al. Towards defining persistent critical illness and other varieties of chronic critical illness. Crit Care Resusc. 2015;17(3):215–8.
Kahn JM, et al. The epidemiology of chronic critical illness in the United States. Crit Care Med. 2015;43(2):282–7.
Nelson JE, et al. Chronic critical illness. Am J Respir Crit Care Med. 2010;182(4):446–54.
Sjoding MW, Cooke CR. Chronic critical illness: a growing legacy of successful advances in critical care. Crit Care Med. 2015;43(2):476–7.
Viglianti EM, et al. Late organ failures in patients with prolonged intensive care unit stays. Journal of Critical Care. 2018;46:55–7.
Pugh R, Ellison A, Pye K, et al. Feasibility and reliability of frailty assessment in the critically ill: a systematic review. Critical Care. 2018.
Iwashyna T, et al. Timing of onset and burden of persistent critical illness in Australia and New Zealand: a retrospective, population-based, observational study. Lancet Respir Med. 2016;4(7):566–73.
Chelluri L, et al. Long-term mortality and quality of life after prolonged mechanical ventilation. Critical care medicine. 2004;32(1):61–9.
Combes A, et al. Morbidity, mortality, and quality-of-life outcomes of patients requiring≥ 14 days of mechanical ventilation. Critical care medicine. 2003;31(5):1373–81.
Rose L, et al. Psychological wellbeing, health related quality of life and memories of intensive care and a specialised weaning centre reported by survivors of prolonged mechanical ventilation. Intensive Crit Care Nurs. 2014;30(3):145–51.
Leroy G, et al. One-year mortality in patients requiring prolonged mechanical ventilation: multicenter evaluation of the ProVent score. Crit Care. 2014;18(4):R155. https://doi.org/10.1186/cc13994.
Iwashyna TJ, et al. Persistent critical illness characterised by Australian and New Zealand ICU clinicians. Crit Care Resusc. 2015;17(3):153–8.
Douglas SL, et al. Survival and quality of life: short-term versus long-term ventilator patients. Critical care medicine. 2002;30(12):2655–62.
Wintermann GB, et al. Predictors of posttraumatic stress and quality of life in family members of chronically critically ill patients after intensive care. Ann Intensive Care. 2016;6(1):69. https://doi.org/10.1186/s13613-016-0174-0.
Hickman RL Jr. and S.L. Douglas, Impact of chronic critical illness on the psychological outcomes of family members. AACN Adv Crit Care. 2010;21(1):80–91.
Roulin, M.-J., M.-F. Boul'ch, and P. Merlani, Staff satisfaction between 2 models of care for the chronically critically ill. Journal of Critical Care, 2012. 27(4): p. 426.e1-426.e8.
Pronovost P, et al. Improving communication in the ICU using daily goals. J Crit Care. 2003;18(2):71–5.
Reader TW, Flin R, Cuthbertson BH. Communication skills and error in the intensive care unit. Current opinion in critical care. 2007;13(6):732–6.
Alvarez G, Coiera E. Interruptive communication patterns in the intensive care unit ward round. International journal of medical informatics. 2005;74(10):791–6.
Thomas A, MacDonald J. A review of patient safety incidents reported as ‘severe’or ‘death’from critical care units in England and Wales between 2004 and 2014. Anaesthesia. 2016;71(9):1013–23.
Pronovost PJ, et al. Improving patient safety in intensive care units in Michigan. Journal of Critical Care. 2008;23(2):207–21.
Rosen MA, Pronovost PJ. Advancing the use of checklists for evaluating performance in health care. Acad Med. 2014;89(7):963–5.
Sagana R, Hyzy RC. Achieving zero central line-associated bloodstream infection rates in your intensive care unit. Critical Care Clinics. 2013;29(1):1–9.
Jacobowski NL, et al. Communication in critical care: family rounds in the intensive care unit. Am J Crit Care. 2010;19(5):421–30.
Gonzalo JD, et al. Bedside interprofessional rounds: perceptions of benefits and barriers by internal medicine nursing staff, attending physicians, and housestaff physicians. J Hosp Med. 2014;9(10):646–51.
Agarwal S, et al. Improving communication in a pediatric intensive care unit using daily patient goal sheets. J Crit Care. 2008;23(2):227–35.
Phipps LM, Thomas NJ. The use of a daily goals sheet to improve communication in the paediatric intensive care unit. Intensive Crit Care Nurs. 2007;23(5):264–71.
Narasimhan M, et al. Improving nurse-physician communication and satisfaction in the intensive care unit with a daily goals worksheet. Am J Crit Care. 2006;15(2):217–22.
Newkirk M, et al. Checklists change communication about key elements of patient care. J Trauma Acute Care Surg. 2012;73(2 Suppl 1):S75–82.
Siegele P. Enhancing outcomes in a surgical intensive care unit by implementing daily goals tools. Critical care nurse. 2009;29(6):58–69.
Weiss CH, et al. Prompting physicians to address a daily checklist and process of care and clinical outcomes: a single-site study. Am J Respir Crit Care Med. 2011;184(6):680–6.
Rose L, et al. Patient and family centered actionable processes of care and performance measures for persistent and chronic critical illness: a systematic review. Critical Care Explorations. 2019;1(4):e0005.
Bosk CL, et al. Reality check for checklists. The Lancet. 2009;374(9688):444–5.
Sinuff T, et al. Knowledge translation interventions for critically ill patients: a systematic review. Crit Care Med. 2013;41(11):2627–40.
Tricco AC, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and ExplanationThe PRISMA-ScR Statement. Annals of Internal Medicine. 2018;169(7):467–73.
Arksey H, O'Malley L. Scoping studies: towards a methodological framework. International journal of social research methodology. 2005;8(1):19–32.
Moher D, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.
Centofanti, J.E., et al., Use of a daily goals checklist for morning ICU rounds: a mixed-methods study. Critical Care Medicine. 42(8): p. 1797-803.
Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implementation Science. 2012;7(1):37.
Hong QN, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for Information. 2018;34(4):285–91.
Hong, Q.N. Questions on the MMAT version 2018. 2018; Available from: http://mixedmethodsappraisaltoolpublic.pbworks.com/w/file/fetch/140056890/Reporting%20the%20results%20of%20the%20MMAT.pdf. Accessed 5th June 2020.
Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implementation Science. 2010;5(1):69.
Laura Allum is funded by a National Institute for Health Research (NIHR) Clinical Doctoral Fellowship for this research project.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Allum, L., Apps, C., Hart, N. et al. Standardising care in the ICU: a protocol for a scoping review of tools used to improve care delivery. Syst Rev 9, 164 (2020). https://doi.org/10.1186/s13643-020-01414-6
- Critical care, Patient care planning, Checklist, Delivery of Healthcare, Prolonged critical illness