Skip to main content
Download PDF

Air ambulance outcome measures using Institutes of Medicine and Donabedian quality frameworks: protocol for a systematic scoping review

Systematic Reviews volume 9, Article number: 72 (2020) Cite this article

Abstract

Background

Dedicated air ambulance services provide a vital link for critically ill and injured patients to higher levels of care. The recent developments of pre-hospital and retrieval medicine create an opportunity for air ambulance providers and policy-makers to utilize a dashboard of quality performance measures to assess service performance. The objective of this scoping systematic review will be to identify and evaluate the range of air ambulance outcome measures reported in the literature and help to construct a quality dashboard based on a healthcare quality framework.

Methods

We will search PubMed, MEDLINE, CINAHL, Scopus, and Cochrane Database of Systematic Reviews (from January 2001 onwards). Complementary searches will be conducted in selected relevant journals. We will include systematic reviews and observational studies (cohort, cross-sectional, interrupted time series) in critically ill or injured patients published in English and focusing on air ambulance delivery and quality measures. Two reviewers will independently screen all citations, full-text articles, and abstract data. The study methodological quality (or bias) will be appraised using appropriate tools. Analysis of the characteristics associated with outcome measure will be mapped and described according to the proposed healthcare quality framework.

Discussion

This review will contribute to the development of an air ambulance quality dashboard designed to combine multiple quality frameworks. Our findings will provide a basis for helping decision-making in health planning and policy.

Systematic review registration

PROSPERO CRD42019144652

Peer Review reports

Background

Air ambulances, both fixed and rotary wing, have become essential components in modern emergency healthcare systems. Drawing lessons from military conflict, the aim is to use fast transportation means to provide people with acute illnesses and injuries with access to centralized specialist care. The development of modern emegency medicine has provided a further opportunity to enhance the coordination and clinical standards available for the intended purpose of rapid response medical care provided to seriously sick and injured people [1].

However, the implementation of air ambulances are often tested in austere and unfamiliar situations [2,3,4,5,6,7], using limited and costly resources [8,9,10,11], and inequity of time [12, 13], distance [13,14,15], and accessibility [16,17,18,19]. Similar themes have emerged in multiple regions and countries (2:6, 8, 10:13). These developments of improved neurologic, cardiac, and trauma care pathways aim to reduce inequalities and ineffective efforts [8, 11,12,13, 18]. The increased utilization of air ambulance retrieval and transfers shows no sign of slowing [20, 21] which impacts on an already burdened emergency care system [22,23,24,25]. However, the drive to advance medical and aviation capability may tip the balance of future sustainability without a strategic health service plan which identifies and evaluates performance indicators [26]. Quality frameworks can provide structure to explore these indicators and form a basis for discussion. For these reasons, a scoping review was conducted to systematically map the range and nature of existing literature in this area, identify any existing gaps in knowledge [27], and synthesize the evidence in a framework.

The Institutes of Medicine (IOM) quality domains and Donabedian quality attributes are two generally accepted frameworks for health service performance measurements. IOM recognized six areas of improvement which are needed in response to inconsistent care across a rapidly changing health system [28]. The six areas were designed to encompass core needs of quality care:

  • Effective: providing evidence-based care to all who could benefit and refraining from providing services to those not likely to benefit;

  • Efficient: avoiding waste, including equipment, supplies, ideas, or energy;

  • Safe: avoiding injury,

  • Patient-centered: respectful and responsive to patient preferences, needs, and values;

  • Timely: reducing waiting and delays for those that give and receive care; and

  • Equitable: care which does not vary according to gender, ethnicity, geographic location, or socioeconomic status [28].

The IOM included recommendations for a system redesign to include the development of measures for assessing quality of care [28].

On the other hand, Dr. Avedis Donabedian believed that quality assessment should include three critical elements in healthcare delivery: structure, process, and outcome [29].

  • Structure measure: material resources; facilities, equipment, human resources (number of personnel and their qualifications), and organizational structures (funding and reimbursement)

  • Process measure: how healthcare is given and received as guided by policy, standards, and procedures

  • Outcome measure: the effect of care and its impact on the health status of patients and populations

The structure of quality healthcare delivery needs to be built upon the material resources such as facilities, equipment, human resources (e.g., number of personnel and their qualifications), and organizational structures (e.g., funding and reimbursement). In turn, good structure increases the likelihood of good process, which includes how healthcare is provided and received through policy, standards, and procedures. The consequence of good structure and good process increases the likelihood of good outcome, effect of care, and health status of patients and populations [30].

Knowledge of the linkage between the three elements needs to be known before quality assessment can be conducted [30]. Donabedian includes caution around the certainty of assessing quality as it is often bound by the current strengths and limitations of clinical science, and outcomes are influenced by multiple factors, including the antecedent process of care [30].

As our combination of IOM and Donabedian quality framework has developed, other perspectives have emerged which further interpret these foundational criteria. These include further description of performance metric functions. Firstly, the US Government Performance Results Act 1993 (Section 2801) [31] outlines strategic performance metrics in four main categories: outcome, output, impact, and input.

  • Outcome measure: “An assessment of the results of a program compared to its intended purpose”

  • Output measure: “A tabulation, calculation, or recording of an activity or effort that can be expressed in a quantitative or qualitative manner”

  • Impact measure: “A measure of the direct or indirect effect or consequence resulting from achieving program goals”

  • Input measure: “A measure of the resources used to achieve an outcome (e.g., employees and funding)”

Secondly, the Agency for Healthcare Research and Quality (AHRQ) states clear differences between a process measure and a patient outcome measure [32, 33].

  • Process measure: a healthcare-related activity performed for, on behalf of, or by a patient (e.g., readmission rates or discharge status) [33].

  • Patient outcome measure: “a health state of a patient resulting from healthcare” (e.g., physiologic measures, radiology and lab results, and morbidity) [32]

For example, hospital staff shortage may delay a patient discharge, or inadequate patient teaching may lead to a readmission which may not pertain to patient physiology, but potentially, the process of the hospital or health system [34].

Finally, there is a pragmatic consideration in the identification and development of performance criteria. They must be measureable, meaningful, and manageable [35].

  • Indicators should be able to be measured either through qualitative or quantitative means.

  • Indicators should be meaningful in that they reflect quality of care and are considered important by both the clients and providers of health services and that they reflect the quality of services provided.

  • Finally, indicators need to be manageable. Service providers need to be able to influence them and improve them. They also need to be efficient: data collection as a byproduct of the services provided and is not costly to collect.

These conceptual understandings help to create a combined framework which identify and evaluate the range and nature of air ambulance outcome measures of quality care.

Objectives

The aim of this review will be to identify and evaluate the range and nature of air ambulance outcome measures reported in the literature and to construct a quality dashboard based on a sound conceptual framework.

The review will aim to address specific research questions:

  1. 1.

    What range of outcome measures are used in air ambulance literature?

  2. 2.

    What measurement instruments or tools were used to identify air ambulance quality of care?

  3. 3.

    Which air ambulance performance outcomes are utilized in our refined quality framework?

  4. 4.

    Can our quality framework create a performance dashboard for strategic improvement?

The PICO question is (P) patients critically ill or injured, (I) which require flight in a dedicated air ambulance, (C) we will not use comparison, and (O) air ambulance service outcome measures, constructed in a combined Institutes of Medicine and Donabedian quality dashboard.

Methods

The review protocol has been registered within the International Prospective Register of Systematic Reviews (PROSPERO) ID no. CRD42019144652 and is being reported in accordance with the reporting guidance Preferred Reporting Items for Systematic Review and Meta-Analyses Protocol (PRIMSA-P) statement [36] (see checklist in Additional file 1).

Studies will be selected according to the following criteria: study design, setting, population, intervention, and outcomes

Eligibility criteria

Study design

The review will include observational cohort, cross-sectional, longitudinal, interrupted time series, and systematic review studies. Randomized controlled, clinical controlled, and controlled before-after trials have numerous ethical constraints for air ambulance life and limb-saving interventions and cannot be balanced with a control group [37]. Therefore, these study designs will not be included in the search strategy.

Setting

The setting includes geographic (e.g., rural, urban, regional), multi-cultural, all levels of socioeconomic, and national/country of origin contexts.

The selected population (P) will include studies involving children, adolescents, and adults who are critically ill or injured (regardless of age or sex). The service intervention (I) we are considering are the following: patients which require flight on dedicated air ambulance missions/tasks (primary/scene/delayed primary/interfacility/interhospital/back-transfer), all aircraft type (helicopter/rotor-wing or fixed-wing), and crew mix (paramedic, nurse, doctor). The outcome (O) is first, to identify the range of air ambulance service outcome measures and their metric instruments represented in the literature, and second, to create a quality dashboard using a combined IOM and Donabedian framework, relevant to patients, providers, and policy-makers for future service improvement and planning.

Studies will be limited to articles published in English (from January 2001 onwards). These dates were chosen to coincide with the International Civil Aviation Organization (ICAO) recognition of new approaches to civil aviation safety risk and quality concerns in 2001 [38]. Exclusion criteria will include military studies, individual case studies, small case control studies outside of the general representative population (e.g., skier or snowboarder survival, SCUBA-related illness), equipment or device trials (e.g., active cooling apparatus for neonates, supraglottic airway devices), and drug or laboratory trials (e.g., diagnostic accuracy of serum lactate or mannitol dosing), as these are not relevant to the review.

Data sources and search strategy

The PubMed search strategy will use relevant Medical Subject Headings (MeSH) terms (Additional file 2). For example, (1) Air ambulance “Fixed-wing aircraft or helicopters equipped for air transport of patients.” Subheadings may include classification, economics, ethics, history, legislation and jurisprudence, organization and administration, standards, statistics and numerical data, supply and distribution, and trends. No filters will restrict the MeSH major topics-only PubMed search builder options. (2) Outcome and Process Assessment (Health Care): “Evaluation procedures that focus on both the outcome and status (outcomes assessment) of the patient at the end of an episode of care—presence of symptoms, level of activity, and mortality; and the process (assessment, process)—what is done for the patient diagnostically and therapeutically.” Subheadings may include classification, economics, epidemiology, ethics, history, legislation and jurisprudence, methods, mortality, organization and administration, psychology, standards, statistics and numerical data, and trends. No filters will restrict the MeSH major topics-only PubMed search builder options. Search will include topics found below the MeSH hierarchy tree, if available.

The initial search strategy will include four databases commonly used in medical searches: PubMed, MEDLINE Ovid, CINAHL, Scopus, and Cochrane Database of Systematic Reviews from January 2001 onwards. A complementary search will include three relevant journals: Air Medical Journal, Emergency Medicine Australasia, and Annals of Emergency Medicine, as each has a dedicated section in pre-hospital retrieval and emergency medicine transport from January 2001 onwards. If necessary, we will contact authors to identify additional sources. A draft search for PubMed is included in Additional file 2.

Study selection and data extraction

The selection process will use a pre-designed screening tool listing inclusion and exclusion criteria, and two authors (KHE, MTE) will independently examine study titles and abstracts following the PRISMA process. Screening will be managed in an Excel spreadsheet in descending chronological order of publication year and include complete citation. The authors will screen all citation titles and abstracts according to the selection criteria following the PRISMA process. The authors will record results with a colored Excel cell code and label extraction process. The cell color green means “yes,” red color cell “no,” or yellow color cell “maybe.” The authors will obtain full-text articles for potential relevance and then examine for eligibility. The authors will then assess and discuss the result for agreement. A third author will be included in the event of unresolved discrepancies. The authors will attempt to contact study authors in this event, to resolve uncertainties. Two authors will independently extract study data using a piloted form (Additional file 3) and checked for accuracy by a third author. Data extracted will include sample size, country(ies) study was performed, study setting, patient age range, pathology type or characteristic, air craft type, mission type, mission time interval, data source and type, crew type, intervention metrics, exclusion and inclusion criteria, limitations, comparison measures, primary and secondary (if available) outcome measures, funding source, and study results. Data extractors will not be blinded to study citations. There are no pre-planned assumptions or simplifications. Data extraction process steps will be maintained and managed using Microsoft Excel 2016. All publications will be managed using EndNote X8.

Review of selected articles

Complete review of selected articles will be read and organized using a table format (Additional file 3).

Outcomes and variations

The air ambulance outcome measures will further be defined according to the US Government Performance Results Act 1993 (Section 2801) [31]: “An assessment of the results of a program compared to its intended purpose.” Outcome measures could incorporate any assessment of this target (e.g., mortality and morbidity rates, adverse events, time-to-patient intervals, referral patterns or crew qualifications, dispatch criteria, or base proximity to tertiary facilities). The authors will attempt to interpret regional or national variations in terminology, if necessary (e.g., interhospital or delayed primary mission), and report the variations in glossary format, in the “Results” section of the review.

Appraisal of evidence—risk of bias

Risk of bias quality will be assessed using ROBIS (risk of bias in systematic reviews) [39] and the Newcastle-Ottawa Scale (NOS) [40]. The ROBIS tool was chosen for the rigor in assessing the metabias in the systematic review process and the signaling questions as they relate to healthcare effectiveness (interventions) [40]. The NOS instrument was chosen for rigor in assessing the quality of nonrandomized studies. Three authors will independently assess the articles, one piloting and two with previous risk of bias appraisal experience. Disagreement between reviewers will be discussed until consensus is reached. Findings of the review will be included in the “Results” section and impact of bias, if any, in the “Discussion” and “Conclusion” sections. The ROBIS phase 2 applies signaling questions in four domains of key review processes at the study level: study eligibility criteria, identification and selection of studies, data collection and study appraisal, and synthesis and findings. ROBIS signaling questions are designed to “help assess specific concerns about potential biases” [39]. Each study level item will be assessed sequentially, not as “stand-alone units” [39]. ROBIS phase 3 process is at the outcome level, as a whole. This phase includes signaling questions and information to support the overall judgment of risk of bias. ROBIS assessment tools, for example ratings, signaling question explanations, and concerns for rating, will be used for guidance [39]. Answers to signaling questions are “yes,” “probably yes” (low concerns), “probably no,” “no” (higher concern), and “no information” (unclear). The table legend will include visual color and symbols for translation (Additional file 4). The NOS instrument assesses quality of selection (case definition, representativeness, case selection, control selection, control definition), comparability (case design or analysis), and outcome (assessment of outcome, length and adequacy of follow-up). Studies could be awarded a maximum score of 9 points. Studies with scores of 5 points or more are considered to be of moderate to good study quality [40]. NOS assessments will be presented in table format. Attempts will be made to contact authors for more information, if necessary. Appraisals will be made by three review authors based on ROBIS and NOS assessment guidelines. Disagreements will be resolved by discussion. If necessary, a fourth author will be consulted until consensus is reached.

Planned approach to synthesis and analysis

Authors will summarize search results in a PRISMA study flow diagram [41] and by narrative synthesis in text and table format. Description of the five-phase narrative synthesis process will improve protocol transparency and reproducibility [42]. The authors will first summarize selected study variables in table format. Second, the authors will explore the findings and relationships in the combined IOM and Donabedian framework (e.g., how “time-to-patient” relate within the quality domains) (Table 1), using cognitive reconstruction [44] by collecting the outcome measures, then working backward to connect effect links in the framework. Third, the authors will discuss effect differences within the frameworks in a narrative format. Fourth, the authors will undertake thematic content analysis of selected article findings and relationships within the framework, using cognitive reconstruction [44], in a table format. Finally, the authors will present a visual dashboard diagram for patients, providers, and policy-makers to consider for future service improvement and planning.

Table 1 Proposed dashboard distribution strategy of air ambulance outcome measure examples in a combined IOM and Donabedian domains
Full size table

Subgroup and sensitivity analysis

A subgroup or sensitivity analysis will not be undertaken in this review. The aim of the review is to identify and evaluate the range of air ambulance outcome measures reported in the literature, not to test the change effect of parameters.

Publication bias

Publication bias will not be explored in this review, as the aim of the review is to identify the air ambulance outcome measures and tools, not the positive or negative results of outcomes.

Discussion

Performance quality is able to be measured on many levels within the air ambulance health service: the frontline health providers, individual patient outcomes, the support systems (e.g., dispatch and triage), organizational structures (e.g., asset capability and availability), governance, and legislation. We acknowledge that quality is a challenging construct to define and measure in highly heterogenous, complex and interconnected emergency medical systems [45,46,47,48]. However, the first step is to explore air ambulance outcome measures as not an end, but rather the means to improving quality healthcare delivery [49]. The intent of this review is not to impose quality metric implementation, but rather introduce a generally accepted set of indicators which help to guage system-wide benchmarking and trend analysis [50]. Identification of the range of quality measurements reduces duplication, inconsistencies, and performance “gaps.” Evaluation of quality measure eliminates metric “cherry picking,” which highlights stakeholder’s self-interests [51]. Failure to identify meaningful outcome measures hinders the ability to recognize disparity and variations of care [50].

Limitations

We acknowledge potential limitations of the review. These may include study inconsistencies in data collection and recording methods of critical information in the pre-hospital setting, such as field vital signs or response time [52]. Studies that use trauma registry data sources may have significant variability of definitions, standard measures, and case inclusion [52], which may influence study outcome. The authors acknowledge their limitations in language fluency, which are limited to English. Finally, there is a possibility to inadvertently miss relevant studies outside of our search strategy. Protocol amendments will be documented and available for open review on the PROSPERO website: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42019144652.

Conclusion

In summary, dedicated air ambulance services provide a vital link for critically ill and injured patients to higher levels of care. The recent developments in modern emergency medicine create an opportunity for air ambulance providers and policy-makers to utilize a dashboard of quality performance measures. Our systematic review contains the first step toward the development of an air ambulance quality dashboard, designed to combine frameworks of the Institutes of Medicine and Dr. Avedis Donabedian and further refined using the Agency for Healthcare Research and Quality and the US Government Performance Results Act 1993, which aims to provide a basis for strategic health service planning.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AHRQ:

The Agency for Healthcare Research and Quality

Donabedian:

Dr. Avedis Donabedian

IOM:

Institutes of Medicine

PROSPERO:

International Prospective Register of Systematic Reviews

ROBIS:

Risk of bias in systematic reviews

References

  1. Australasian College for Emergency Medicine. Pre-hospital and retrieval medicine 2019 [02-09-2019]. Available from: https://acem.org.au/PHRM.

  2. Norum J, Elsbak TM. Air ambulance services in the Arctic 1999-2009: a Norwegian study. Int J Emerg Med. 2011;4(1):1.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Warren J, Fromm RE Jr, Orr RA, Rotello LC, Horst HM, American College of Critical Care M. Guidelines for the inter- and intrahospital transport of critically ill patients. Crit Care Med. 2004;32(1):256–62.

    Article  PubMed  Google Scholar 

  4. Singh JM, MacDonald RD, Bronskill SE, Schull MJ. Incidence and predictors of critical events during urgent air-medical transport. CMAJ. 2009;181(9):579–84.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Sethi D, Subramanian S. When place and time matter: how to conduct safe inter-hospital transfer of patients. Saudi J Anaesth. 2014;8(1):104–13.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Peters J, Bruijstens L, van der Ploeg J, Tan E, Hoogerwerf N, Edwards M. Indications and results of emergency surgical airways performed by a physician-staffed helicopter emergency service. Injury. 2015;46(5):787–90.

    Article  PubMed  Google Scholar 

  7. Lees M, Elcock M. Safety of interhospital transport of cardiac patients and the need for medical escorts. Emerg Med Australas. 2008;20(1):23–31.

    PubMed  Google Scholar 

  8. Brändström H, Winsö O, Lindholm L, Haney M. Regional intensive care transports: a prospective analysis of distance, time and cost for road, helicopter and fixed-wing ambulances. Scand J Trauma Resusc Emerg Med. 2014;22(1):36.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Taylor CB, Stevenson M, Jan S, Liu B, Tall G, Middleton PM, et al. An investigation into the cost, coverage and activities of Helicopter Emergency Medical Services in the state of New South Wales, Australia. Injury. 2011;42(10):1088–94.

    Article  PubMed  Google Scholar 

  10. Ringburg AN, Polinder S, Meulman TJ, Steyerberg EW, van Lieshout EM, Patka P, et al. Cost-effectiveness and quality-of-life analysis of physician-staffed helicopter emergency medical services. Br J Surg. 2009;96(11):1365–70.

    Article  CAS  PubMed  Google Scholar 

  11. Newgard CD, Staudenmayer K, Hsia RY, Mann NC, Bulger EM, Holmes JF, et al. The cost of overtriage: more than one-third of low-risk injured patients were taken to major trauma centers. Health Affairs (Millwood). 2013;32(9):1591–9.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Bekelis K, Missios S, Mackenzie TA. Prehospital helicopter transport and survival of patients with traumatic brain injury. Ann Surg. 2015;261(3):579–85.

    Article  PubMed  Google Scholar 

  13. Langabeer JR, Prasad S, Seo M, Smith DT, Segrest W, Owan T, et al. The effect of interhospital transfers, emergency medical services, and distance on ischemic time in a rural ST-elevation myocardial infarction system of care. Am J Emerg Med. 2015;33(7):913–6.

    Article  PubMed  Google Scholar 

  14. Croser JL. Trauma care systems in Australia. Injury. 2003;34(9):649–51.

    Article  PubMed  Google Scholar 

  15. Danne PD. Trauma management in Australia and the tyranny of distance. World J Surg. 2003;27(4):385–9.

    Article  PubMed  Google Scholar 

  16. Garne DL, Perkins DA, Boreland FT, Lyle DM. Frequent users of the Royal Flying Doctor Service primary clinic and aeromedical services in remote New South Wales: a quality study. Med J Aust. 2009;191(11-12):602–4.

    Article  PubMed  Google Scholar 

  17. Hussain J, Robinson A, Stebbing M, McGrail M. More is more in remote Central Australia: more provision of primary healthcare services is associated with more acute medical evacuations and more remote telephone consultations. Rural Remote Health. 2014;14(4):2796.

    PubMed  Google Scholar 

  18. Fatovich DM, Phillips M, Jacobs IG, Langford SA. Major trauma patients transferred from rural and remote Western Australia by the Royal Flying Doctor Service. J Trauma. 2011;71(6):1816–20.

    PubMed  Google Scholar 

  19. Margolis SA, Ypinazar VA. Aeromedical retrieval for critical clinical conditions: 12 years of experience with the Royal Flying Doctor Service, Queensland, Australia. J Emerg Med. 2009;36(4):363–8.

    Article  PubMed  Google Scholar 

  20. Droogh JM, Smit M, Absalom AR, Ligtenberg JJ, Zijlstra JG. Transferring the critically ill patient: are we there yet? Crit Care. 2015;19:62.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Lucas DJ, Ejaz A, Haut ER, Spolverato G, Haider AH, Pawlik TM. Interhospital transfer and adverse outcomes after general surgery: implications for pay for performance. J Am Coll Surg. 2014;218(3):393–400.

    Article  PubMed  Google Scholar 

  22. Iwashyna TJ, Kahn JM. Regionalization of Critical Care. In: Scales CD, Rubenfeld DG, editors. The organization of critical care: an evidence-based approach to improving quality. New York: Springer New York; 2014. p. 217–33.

    Google Scholar 

  23. FitzGerald G, Toloo S, Rego J, Ting J, Aitken P, Tippett V. Demand for public hospital emergency department services in Australia: 2000–2001 to 2009–2010. Emer Med Australas. 2012;24(1):72–8.

    Article  Google Scholar 

  24. Bernstein SL, Aronsky D, Duseja R, Epstein S, Handel D, Hwang U, et al. The effect of emergency department crowding on clinically oriented outcomes. Acad Emerg Med. 2009;16(1):1–10.

    Article  PubMed  Google Scholar 

  25. Sorensen MJ, von Recklinghausen FM, Fulton G, Burchard KW. Secondary overtriage: the burden of unnecessary interfacility transfers in a rural trauma system. JAMA Surg. 2013;148(8):763–8.

    Article  PubMed  Google Scholar 

  26. Whicher D, Rosengren K, Siddiqi S, Simpson L. The future of health services research: advancing health systems research and practice in the United States. In: Whicher D, Rosengren K, Siddiqi S, Simpson L, editors. Washington, DC: National Academy of Medicine; 2018.

    Google Scholar 

  27. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

    Article  Google Scholar 

  28. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: The National Academies Press; 2001. p. 360.

    Google Scholar 

  29. Ayanian JZ, Markel H. Donabedian’s lasting framework for healthcare quality. N E J Med. 2016;375(3):205–7.

    Article  Google Scholar 

  30. Donabedian A. The quality of care: how can it be assessed? Arch Pathol Lab Med. 1997;121(11):1145–50.

    CAS  PubMed  Google Scholar 

  31. Government Performance Results Act of 1993. Strategic planning and performance measurement. http://govinfo.library.unt.edu/npr/library/misc/s20.html: United States Congress; 1993.

  32. The Agency for Healthcare Research and Quality. Selecting health outcome measures for clinical quality measurement. Rockville: U.S. Department of Health and Human Services; 2014.

    Google Scholar 

  33. The Agency for Healthcare Research and Quality. Selecting process measures for clinical quality measurement. National Quality Measures Clearinghouse. Rockville: U.S. Department of Health and Human Services; 2014.

    Google Scholar 

  34. Lo E, Rainkie D, Semchuk WM, Gorman SK, Toombs K, Slavik RS, et al. Measurement of clinical pharmacy key performance indicators to focus and improve your hospital pharmacy practice. Can J Hosp Pharm. 2016;69(2):149–55.

    PubMed  PubMed Central  Google Scholar 

  35. Kittelson S, Pierce R, Youngwerth J. Palliative Care Scorecard. J Palliat Med. 2017;20(5):517–27.

    Article  PubMed  Google Scholar 

  36. Shamseer L, Moher D, Clarke M. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349.

  37. Association WM. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. J Am Med Assoc. 2013;310(20):2191–4.

    Article  CAS  Google Scholar 

  38. Frazer EM, Overton JWD Jr, Overton DJW. Safety and quality in medical transport systems: creating an effective culture. Abingdon: Ashgate Publishing, Limited; 2012.

    Google Scholar 

  39. Whiting P, Savović J, Higgins JPT, Caldwell DM, Reeves BC, Shea B, et al. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225–34.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. http://www.ohri.ca/programs/clinical_epidemiology/oxford.aspnd.

  41. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339.

  42. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews: a product from the ESRC Methods Programme. 2006.

    Google Scholar 

  43. Bigham MT, Schwartz HP. Quality metrics in neonatal and pediatric critical care transport: a consensus statement. Pediatric Crit Care Med. 2013;14(5):518–24.

    Article  Google Scholar 

  44. Mertins L, Salbador D, Long JH. The outcome effect – a review and implications for future research. J Account Lit. 2013;31(1):2–30.

    Article  Google Scholar 

  45. Bigham MT, Schwartz HP. Measure, report, improve: the quest for best practices for high-quality care in critical care transport. Clin Pediatric Emerg Med. 2013;14(3).

  46. Saver BG, Martin SA, Adler RN, Candib LM, Deligiannidis KE, Golding J, et al. Care that matters: quality measurement and health Care. PLoS Med. 2015;12(11):e1001902.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Harteloh PPM. The meaning of quality in health care: a conceptual analysis. Health Care Anal. 2003;11(3):259–67.

    Article  CAS  PubMed  Google Scholar 

  48. Newgard CD. In reply. Ann Emerg Med. 2011;57(1):74–5.

    Article  Google Scholar 

  49. Blumenthal D, McGinnis J. Measuring vital signs: an IOM report on core metrics for health and health care progress. J Am Med Assoc. 2015;313(19):1901–2.

    Article  Google Scholar 

  50. Institute of Medicine. Performance measurement: accelerating improvement. Washington, DC: The National Academies Press; 2006. p. 382.

    Google Scholar 

  51. Institute of Medicine. Emergency medical services at the crossroads. Washington, D.C: National Academies Press; 2007.

    Google Scholar 

  52. Zehtabchi S, Nishijima DK, McKay MP, Clay MN. Trauma registries: history, logistics, limitations, and contributions to emergency medicine research. Acad Emerg Med. 2011;18(6):637–43.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Sam Rannard, Liaison Librarian at James Cook University, for her assistance and support in the preliminary research strategy.

Funding

Our systematic review protocol is funded by a grant from the Emergency Medicine Foundation (Australasia) Queensland Program, # EMPJ-370R27, and Central Queensland Hospital and Health Service (CQHHS). The funding will support the process of the review protocol. The views expressed are those of the authors and are not necessarily those of EMF or CQHHS. The funder had no participation in the review protocol. KHE is the recipient of an Australian Government Research Training Program Scholarship.

Author information

Authors and Affiliations

  1. College of Public Health, Medical and Veterinary Sciences, James Cook University, 1 James Cook Drive, Townsville, Queensland, Australia

    Kristin H. Edwards, Richard C. Franklin & Mark Terrell Edwards

  2. Queensland University of Technology, Victoria Park Rd, Kelvin Grove, Brisbane, Queensland, Australia

    Gerard FitzGerald

  3. LifeFlight Retrieval Medicine Australia, Edward Street, Brisbane, Queensland, Australia

    Mark Terrell Edwards

  4. Queensland Health, Emergency Medicine Department Rockhampton, Rockhampton Base Hospital, Canning Street, Rockhampton, Queensland, Australia

    Mark Terrell Edwards

Authors
  1. Kristin H. Edwards
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gerard FitzGerald
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard C. Franklin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mark Terrell Edwards
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The study protocol was conceived by KHE, with critical input from MTE, GF, and RCF. KHE registered the protocol with the PROSPERO database and wrote the first draft of the protocol. MTE, GR, and RCF provided input into the design and edited the draft protocol. All authors commented on the paper for important intellectual content. The authors read and approved the final paper. KHE accepts full responsibility for the finished paper and controlled the decision to publish.

Corresponding author

Correspondence to Kristin H. Edwards.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

PRISMA-P 2015 Checklist.

Additional file 2.

Medical Subject Headings (MeSH) terms.

Additional file 3.

Review of selected article format.

Additional file 4.

Risk of bias in systematic review using ROBIS sample.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Edwards, K.H., FitzGerald, G., Franklin, R.C. et al. Air ambulance outcome measures using Institutes of Medicine and Donabedian quality frameworks: protocol for a systematic scoping review. Syst Rev 9, 72 (2020). https://doi.org/10.1186/s13643-020-01316-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-020-01316-7

Keywords

Systematic Reviews

ISSN: 2046-4053