Skip to main content

Standardising care in the ICU: a protocol for a scoping review of tools used to improve care delivery

Abstract

Background

Increasing numbers of critically ill patients experience a prolonged intensive care unit stay contributing to greater physical and psychological morbidity, strain on families and cost to health systems. Quality improvement tools such as checklists concisely articulate best practices with the aim of improving quality and safety; however, these tools have not been designed for the specific needs of patients with prolonged ICU stay.

The primary objective of this review will be to determine the characteristics including format and content of multicomponent tools designed to standardise or improve ICU care. Secondary objectives are to describe the outcomes reported in these tools, the type of patients and settings studied, and to understand how these tools were developed and implemented in clinical practice.

Methods

We will search the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE, MEDLINE, PsycINFO, Web of Science, OpenGrey, NHS evidence and Trial Registries from January 2000 onwards. We will include primary research studies (e.g. experimental, quasi-experimental, observational and qualitative studies) recruiting more than 10 adult participants admitted to ICUs, high dependency units and weaning centres regardless of length of stay, describing quality improvement tools such as structured care plans or checklists designed to standardize more than one aspect of care delivery. We will extract data on study and patient characteristics, tool design and implementation strategies and measured outcomes. Two reviewers will independently screen citations for eligible studies and perform data extraction. Data will be synthesised with descriptive statistics; we will use a narrative synthesis to describe review findings.

Discussion

The findings will be used to guide development of tools for use with prolonged ICU stay patients. Our group will use experience-based co-design methods to identify the most important actionable processes of care to include in quality improvement tools these patients. Such tools are needed to standardise practice and thereby improve quality of care. Illustrating the development and implementation methods used for such tools will help to guide translation of similar tools into ICU clinical practice and future research.

Systematic review registration

This protocol is registered on the Open Science Framework, https://osf.io/, DOI https://doi.org/10.17605/OSF.IO/Z8MRE

Peer Review reports

Background

Increasing numbers of patients remain in intensive care units (ICUs) for longer than a week due to increased survival rates, comorbidity and age in the general population resulting in lower resilience to acute illness and longer recovery [1,2,3,4]. Various terminology is used to describe these patients including ‘persistent critical illness’ and ‘chronic critical illness’ (CCI). Persistent critical illness is used to describe the point at which a patient’s presenting condition no longer predicts their risk of mortality [1]. Patients, however, continue to experience ongoing illness-related complications and organ failure [5]. This differentiates these patients from those experiencing prolonged respiratory weaning or conditions with an inherently long recovery time such as Guillain-Barré syndrome. Chronic critical illness is also used to describe patients with a prolonged length of stay (LOS) [2] and refers to a medically complex group of patients with multiple co-morbidities, often of older age. This frailty can result in less physical resilience to withstand the insult of critical illness [6]. For clarity, the term ‘prolonged ICU stay’ which encompasses both persistent and chronic critical illness, will be used in this paper to describe any patient with a stay of over 7 days. This timepoint is the lower threshold defined by Iwashyna et al. [7], who suggest that the transition to persistent critical illness occurs within a range of 7–22 days. These patients experience a range of complications, including muscle wasting [3] and long-term physical and functional deficits [8, 9], psychological distress [10], and cognitive deficits, leading to longer stays in hospital after ICU discharge [3] and prolonged recovery. They are more likely to die [11], and survivors are less likely to return home, often requiring ongoing nursing or residential care [12, 13]. Family members experience significant levels of psychological distress [14, 15], which may require involvement of social workers or psychologists.

The transition from acute critical illness to a prolonged ICU stay involves a shift in the goals of care. This frequently involves professions and specialities not typically involved in the acute phase of care, such as speech and language therapists, occupational therapists, social workers, and palliative care. The needs of this patient group are distinct and include rehabilitation. Family members require regularly updates and involvement in care [10]. Clinicians report feeling dissatisfied with their management of these patients due to the need to prioritise care for more unstable patients [12], a dislike of caring for lower acuity patients and a lack of training [16].

Intensive care units are complex environments, involving the coordination of multiple healthcare professions, specialties and numerous tasks for patients with life-threatening conditions [17]. Communication errors are common [18, 19] and contribute to patient harm and frustrations for clinicians [18, 20, 21]. In response to these errors, quality improvement tools including checklists, tools to structure ward rounds, bundles and protocols have been developed for the purposes of standardising care. These tools have the potential to improve safety [22, 23], patient, family and staff satisfaction [24], and understanding of goals of treatment [25,26,27,28], and can decrease ICU length of stay [17, 28]. However, these tools most commonly focus on medically orientated priorities of care delivery during the acute period of ICU admission [29,30,31]. Such tools may be less relevant to more stable patients requiring aspects of care delivery such as mobilisation, communication aids and patient-led goal setting [12, 32]. Additionally, many of these tools are designed for delivery of a single element of care, such as the prevention of infection associated with central line insertion, rather than the coordination of a range of tasks by the interprofessional team.

The ability of such tools to impact care is dependent on a wide range of factors [33], including successful implementation addressing local barriers to adoption, widespread ‘buy-in’ from clinicians and ongoing implementation strategies to sustain use [33]. A 2013 systematic review of the impact of knowledge translation studies in ICU concluded that there was insufficient evidence to identify the most effective knowledge translation strategies for improving practice in the ICU, particularly for quality improvement measures which cannot be protocolised—however, it did not include qualitative literature [34].

Why is it important to do this review?

Given the demonstrable benefits of ICU quality improvement tools for patients in the acute phase of ICU admission, knowledge of the elements and factors that facilitate successful implementation could inform design of similar tools to address the distinct care needs of patients experiencing a prolonged ICU stay [32]. This is particularly important given the rising prevalence of these patients and their cost to the healthcare system. To the best of our knowledge, no review has synthesised this information.

Our primary objective is to determine the characteristics (i.e., format, content) of multicomponent tools designed to standardise and/or improve care delivery in adult ICU patient management. Our secondary objectives are to describe (1) what outcomes are reported, how they are measured and their effect; (2) the type of patients studied; (3) how tools were developed including patients and/or family member involvement; and (4) how these tools are implemented in practice.

We have chosen a scoping review approach as described by Tricco et al. [35] and adapted from Arksey and O’Malley [36] as the most appropriate methodology to achieve our objective of mapping the different components of these tools and the research on them to date. We also anticipate a range of different methodologies and study designs, for which scoping reviews are the advised methodology [36].

Methods

The present protocol has been registered within the Open Science Framework platform (https://osf.io/z8mre). It is reported in accordance with the reporting guidance provided in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement [37]and the PRISMA extension for Scoping Reviews (PRISMA-ScR) [35] see PRISMA-P checklist in Additional file 1).

Information sources and searches

A search strategy (Additional file 2) was created using a combination of MeSH terms and keyword combinations. We will adapt the search strategy for each database. We will search electronic databases including MEDLINE (Ovid), the Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE, PsycINFO and Web of Science from January 2000 onwards, to reflect current ICU care. We will search for ongoing or completed trials using the World Health Organisation International Clinical Trials Registry Platform (http://apps.who.int/trialsearch/) and systematic reviews via the Cochrane Library. We will search for grey literature using Opengrey (http://www.opengrey.eu/), NHS evidence (https://www.evidence.nhs.uk/), Google Scholar and Prospero. We will scan reference lists of included studies for other studies of relevance. We will exclude editorials, commentaries and animal studies. LA will contact authors where necessary for full-text papers or to enquire about unpublished work identified through protocols or trial registries. A draft search for MEDLINE (Ovid) is available in Additional file 2.

Eligibility criteria

Articles will be selected according to the following criteria for study population, intervention and comparator and study design.

Population

We will include studies recruiting adult patients aged 18 years and older admitted to an intensive or critical care unit, high dependency or a weaning centre, respiratory care unit or long-term acute care hospital (LTACH), regardless of length of stay. We will also include studies that include family members/caregivers and the healthcare practitioners responsible for the care of these patients as participants.

Intervention

We will include studies that report on quality improvement interventions such as multicomponent structured care plans, goal sheets, or checklists designed to standardize or remind clinicians about more than one aspect of care delivery. We will exclude checklists for procedures such as central line insertion or tools such as care bundles with single objectives of care, e.g. to prevent ventilator-associated pneumonia. Protocols, including those for delirium prevention, sedation management, weaning, and mobilisation will also be excluded as we do not seek to produce a decision algorithm and therefore this format is outside the scope of this review. Examples of such tools are daily goals sheets [38, 17] and rounding checklists [31].We will exclude: 1. checklists for procedures such as central line insertion; 2. care bundles with single objectives of care e.g. to prevent ventilator-associated pneumonia; 3. Single objective protocols, including those for delirium prevention, sedation management, weaning, and mobilisation will also be excluded as we do not seek to produce a decision algorithm and therefore this format is outside the scope of this review.

Comparators

We will include studies with an active comparator (i.e. another quality improvement tool), a passive comparator (i.e. usual care) and no comparator.

Outcomes

We will not make decisions related to inclusion of studies based on outcomes reported.

Study design

We will include all qualitative and quantitative study designs including experimental, quasi-experimental, observational studies and qualitative studies except case series, as this design is not appropriate for the evaluation of a Quality Improvement (QI) tool. For pragmatic reasons, we will only include studies published in English. We will include unpublished work in the form of conference proceedings and theses.

Study selection

One author (LA) will independently screen titles and abstracts to remove obvious exclusions using Endnote X8. The full text of citations selected for potential inclusion will be retrieved and assessed independently by two authors (LA and CA) for eligibility, with a third reviewer (LR) available for arbitration if needed. All decisions will be recorded in an Excel file.

Data charting process

Two authors (LA and CA) will independently extract data using a Google form (Additional File 3) iteratively designed for this review by three authors (LA, CA and LR). The form captures the following variables:

  • Participants—participant characteristics (patient/family member/healthcare worker), country, setting (e.g. ICU or weaning unit), admitting speciality).

  • Study design—study type and methodology used

  • Tool—the type, design, frequency of completion, content and aims of the QI tool described

  • Tool development—we will extract data on how the tool was developed, including patient and family involvement and feasibility testing,

  • Tool implementation—methods used and evaluated using the Theoretical Domains Framework [39] to describe barriers and facilitators to adoption.

  • Outcomes—the effect of the interventions will be extracted including descriptive data and outcome measures used.

Differences in extracted data between the two reviewers will be resolved by discussion, and a third reviewer (LR) consulted if an agreement cannot be reached. LA will contact corresponding authors for missing information as needed (e.g. tool development or implementation strategies).

Critical appraisal of evidence sources

We will use the results of the MMAT [40] to help inform conclusions and recommendations from the scoping review, as a robust tool for describing quality of mixed-methods studies. The authors of the tool strongly discourage using stand-alone numerical scores for studies, and so we intend to use the tool as they advise to describe high-, medium- and low-quality studies [41].

Evidence synthesis, analysis and interpretation

We will complete a PRISMA study flow diagram [37] to describe our search results. We will provide a narrative synthesis to describe our findings as recommended by Levac et al. [42].

We will summarise characteristics of included studies, including the setting (type of unit and country) and type of tool used using descriptive statistics.

To address our primary objective, we will present tables grouped according to tool type (e.g. checklist, care plan, goal sheet) describing the purpose and content of each tool. We will include reported outcomes, their measures (if applicable) and the effects of the intervention on these outcomes.

To address our secondary objectives, a table will be produced describing the patients and settings studied in each included tool, and tool development including source of content (e.g. published evidence, expert opinion) and whether patients and family members were involved in its development. Data on methods of tool implementation will be summarised with reported barriers and facilitators interpreted using the Theoretical Domains Framework.

Discussion

International work [32] to identify and prioritise the processes of care that most improve the experience of patients with prolonged ICU stay and their families is ongoing, using principles of experience-based co-design. The findings of this review will inform the design and implementation of quality improvement tools to improve/standardise the delivery of these identified processes of care, to assist knowledge translation to clinical practice.

A previous systematic review [32] failed to identify any quality improvement tools specific to long stay patients in intensive care. An improved comprehension of how such tools are developed and implemented will help to guide translation for similar tools in ICU.

Limitations of our findings are anticipated due to heterogeneity in the tools studied and differences in the context in which they are applied, and the selection bias inherent with only including papers published in English, and after 2000. Limitations of scoping review methodology will mean that a synthesis of findings across articles is not possible.

This review will also provide a summary for clinicians seeking to better understand and utilise the range of quality improvement tools used to improve more than one aspect of care in the ICU.

Availability of data and materials

Not applicable.

Abbreviations

ICU:

Intensive care unit

CCI:

Chronic critical illness

LOS:

Length of stay

PRISMA-scr:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses, Scoping Review

MeSH:

Medical Subject Headings

LTACH:

Long-term acute care hospital

QI:

Quality improvement

References

  1. Iwashyna TJ, et al. Towards defining persistent critical illness and other varieties of chronic critical illness. Crit Care Resusc. 2015;17(3):215–8.

    PubMed  Google Scholar 

  2. Kahn JM, et al. The epidemiology of chronic critical illness in the United States. Crit Care Med. 2015;43(2):282–7.

    Article  PubMed  Google Scholar 

  3. Nelson JE, et al. Chronic critical illness. Am J Respir Crit Care Med. 2010;182(4):446–54.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Sjoding MW, Cooke CR. Chronic critical illness: a growing legacy of successful advances in critical care. Crit Care Med. 2015;43(2):476–7.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Viglianti EM, et al. Late organ failures in patients with prolonged intensive care unit stays. Journal of Critical Care. 2018;46:55–7.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Pugh R, Ellison A, Pye K, et al. Feasibility and reliability of frailty assessment in the critically ill: a systematic review. Critical Care. 2018.

  7. Iwashyna T, et al. Timing of onset and burden of persistent critical illness in Australia and New Zealand: a retrospective, population-based, observational study. Lancet Respir Med. 2016;4(7):566–73.

    Article  PubMed  Google Scholar 

  8. Chelluri L, et al. Long-term mortality and quality of life after prolonged mechanical ventilation. Critical care medicine. 2004;32(1):61–9.

    Article  PubMed  Google Scholar 

  9. Combes A, et al. Morbidity, mortality, and quality-of-life outcomes of patients requiring≥ 14 days of mechanical ventilation. Critical care medicine. 2003;31(5):1373–81.

    Article  PubMed  Google Scholar 

  10. Rose L, et al. Psychological wellbeing, health related quality of life and memories of intensive care and a specialised weaning centre reported by survivors of prolonged mechanical ventilation. Intensive Crit Care Nurs. 2014;30(3):145–51.

    Article  PubMed  Google Scholar 

  11. Leroy G, et al. One-year mortality in patients requiring prolonged mechanical ventilation: multicenter evaluation of the ProVent score. Crit Care. 2014;18(4):R155. https://doi.org/10.1186/cc13994.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Iwashyna TJ, et al. Persistent critical illness characterised by Australian and New Zealand ICU clinicians. Crit Care Resusc. 2015;17(3):153–8.

    PubMed  Google Scholar 

  13. Douglas SL, et al. Survival and quality of life: short-term versus long-term ventilator patients. Critical care medicine. 2002;30(12):2655–62.

    Article  PubMed  Google Scholar 

  14. Wintermann GB, et al. Predictors of posttraumatic stress and quality of life in family members of chronically critically ill patients after intensive care. Ann Intensive Care. 2016;6(1):69. https://doi.org/10.1186/s13613-016-0174-0.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Hickman RL Jr. and S.L. Douglas, Impact of chronic critical illness on the psychological outcomes of family members. AACN Adv Crit Care. 2010;21(1):80–91.

    PubMed  PubMed Central  Google Scholar 

  16. Roulin, M.-J., M.-F. Boul'ch, and P. Merlani, Staff satisfaction between 2 models of care for the chronically critically ill. Journal of Critical Care, 2012. 27(4): p. 426.e1-426.e8.

  17. Pronovost P, et al. Improving communication in the ICU using daily goals. J Crit Care. 2003;18(2):71–5.

    Article  PubMed  Google Scholar 

  18. Reader TW, Flin R, Cuthbertson BH. Communication skills and error in the intensive care unit. Current opinion in critical care. 2007;13(6):732–6.

    Article  PubMed  Google Scholar 

  19. Alvarez G, Coiera E. Interruptive communication patterns in the intensive care unit ward round. International journal of medical informatics. 2005;74(10):791–6.

    Article  PubMed  Google Scholar 

  20. Thomas A, MacDonald J. A review of patient safety incidents reported as ‘severe’or ‘death’from critical care units in England and Wales between 2004 and 2014. Anaesthesia. 2016;71(9):1013–23.

    Article  CAS  PubMed  Google Scholar 

  21. Pronovost PJ, et al. Improving patient safety in intensive care units in Michigan. Journal of Critical Care. 2008;23(2):207–21.

    Article  PubMed  Google Scholar 

  22. Rosen MA, Pronovost PJ. Advancing the use of checklists for evaluating performance in health care. Acad Med. 2014;89(7):963–5.

    Article  PubMed  Google Scholar 

  23. Sagana R, Hyzy RC. Achieving zero central line-associated bloodstream infection rates in your intensive care unit. Critical Care Clinics. 2013;29(1):1–9.

    Article  PubMed  Google Scholar 

  24. Jacobowski NL, et al. Communication in critical care: family rounds in the intensive care unit. Am J Crit Care. 2010;19(5):421–30.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Gonzalo JD, et al. Bedside interprofessional rounds: perceptions of benefits and barriers by internal medicine nursing staff, attending physicians, and housestaff physicians. J Hosp Med. 2014;9(10):646–51.

    Article  PubMed  Google Scholar 

  26. Agarwal S, et al. Improving communication in a pediatric intensive care unit using daily patient goal sheets. J Crit Care. 2008;23(2):227–35.

    Article  PubMed  Google Scholar 

  27. Phipps LM, Thomas NJ. The use of a daily goals sheet to improve communication in the paediatric intensive care unit. Intensive Crit Care Nurs. 2007;23(5):264–71.

    Article  PubMed  Google Scholar 

  28. Narasimhan M, et al. Improving nurse-physician communication and satisfaction in the intensive care unit with a daily goals worksheet. Am J Crit Care. 2006;15(2):217–22.

    Article  PubMed  Google Scholar 

  29. Newkirk M, et al. Checklists change communication about key elements of patient care. J Trauma Acute Care Surg. 2012;73(2 Suppl 1):S75–82.

    Article  PubMed  Google Scholar 

  30. Siegele P. Enhancing outcomes in a surgical intensive care unit by implementing daily goals tools. Critical care nurse. 2009;29(6):58–69.

    Article  PubMed  Google Scholar 

  31. Weiss CH, et al. Prompting physicians to address a daily checklist and process of care and clinical outcomes: a single-site study. Am J Respir Crit Care Med. 2011;184(6):680–6.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Rose L, et al. Patient and family centered actionable processes of care and performance measures for persistent and chronic critical illness: a systematic review. Critical Care Explorations. 2019;1(4):e0005.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Bosk CL, et al. Reality check for checklists. The Lancet. 2009;374(9688):444–5.

    Article  Google Scholar 

  34. Sinuff T, et al. Knowledge translation interventions for critically ill patients: a systematic review. Crit Care Med. 2013;41(11):2627–40.

    Article  PubMed  Google Scholar 

  35. Tricco AC, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and ExplanationThe PRISMA-ScR Statement. Annals of Internal Medicine. 2018;169(7):467–73.

    Article  PubMed  Google Scholar 

  36. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. International journal of social research methodology. 2005;8(1):19–32.

    Article  Google Scholar 

  37. Moher D, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Centofanti, J.E., et al., Use of a daily goals checklist for morning ICU rounds: a mixed-methods study. Critical Care Medicine. 42(8): p. 1797-803.

  39. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implementation Science. 2012;7(1):37.

    Article  PubMed  Google Scholar 

  40. Hong QN, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for Information. 2018;34(4):285–91.

    Article  Google Scholar 

  41. Hong, Q.N. Questions on the MMAT version 2018. 2018; Available from: http://mixedmethodsappraisaltoolpublic.pbworks.com/w/file/fetch/140056890/Reporting%20the%20results%20of%20the%20MMAT.pdf. Accessed 5th June 2020.

  42. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implementation Science. 2010;5(1):69.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Laura Allum is funded by a National Institute for Health Research (NIHR) Clinical Doctoral Fellowship for this research project.

Author information

Authors and Affiliations

Authors

Contributions

LA and LR conceived of this review. LA drafted the protocol under the supervision of LR. All authors read and approved the final manuscript. No funding body, sponsor nor institution had any involvement in the development of this protocol. This paper presents independent research funded by the National Institute for Health Research (NIHR). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Corresponding author

Correspondence to Laura Allum.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

PRISMA extension for scoping reviews checklist (PRISMA-scr).

Additional file 2.

MEDLINE search strategy.

Additional file 3.

Date extraction document.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Allum, L., Apps, C., Hart, N. et al. Standardising care in the ICU: a protocol for a scoping review of tools used to improve care delivery. Syst Rev 9, 164 (2020). https://doi.org/10.1186/s13643-020-01414-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-020-01414-6

Keywords