Impact of trauma system structure on injury outcomes: a systematic review protocol
- Lynne Moore1, 2Email author,
- Howard Champion3,
- Gerard O’Reilly4, 5,
- Ari Leppaniemi6,
- Peter Cameron7,
- Cameron Palmer8,
- Fikri M. Abu-Zidan9,
- Belinda Gabbe5,
- Christine Gaarder10,
- Natalie Yanchar11,
- Henry Thomas Stelfox12,
- Raul Coimbra13,
- John Kortbeek14,
- Vanessa Noonan15, 16,
- Amy Gunning16,
- Luke Leenan16,
- Malcolm Gordon17,
- Monty Khajanchi18,
- Michèle Shemilt2,
- Valérie Porgo1,
- Alexis F. Turgeon1 and
- on behalf of the International Injury Care Improvement Initiative
© The Author(s). 2017
Received: 6 October 2016
Accepted: 6 January 2017
Published: 21 January 2017
Injury represents one of the greatest public health challenges of our time with over 5 million deaths and 100 million people temporarily or permanently disabled every year worldwide. The effectiveness of trauma systems in decreasing injury mortality and morbidity has been well demonstrated. However, the organisation of trauma care varies significantly across trauma systems and we know little about which components of trauma systems contribute to their effectiveness. The objective of the study described in this protocol is to systematically review evidence of the impact of trauma system components on clinically significant outcomes including mortality, function and disability, quality of life, and resource utilization.
We will perform a systematic review of studies evaluating the association between at least one trauma system component (e.g. accreditation by a central agency, interfacility transfer agreements) and at least one injury outcome (e.g. mortality, disability, resource use). We will search MEDLINE, EMBASE, COCHRANE central, and BIOSIS/Web of Knowledge databases, thesis holdings, key injury organisation websites and conference proceedings for eligible studies. Pairs of independent reviewers will evaluate studies for eligibility and extract data from included articles. Methodological quality will be evaluated using elements of the ROBINS-I tool and the Cochrane risk of bias tool for non-randomized and randomized studies, respectively. Strength of evidence will be evaluated using the GRADE tool.
We expect to advance knowledge on the components of trauma systems that contribute to their effectiveness. This may lead to recommendations on trauma system structure that will help policy-makers make informed decisions as to where resources should be focused. The review may also lead to specific recommendations for future research efforts.
Systematic review registration
This protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 28-06-2016. PROSPERO 2016:CRD42016041336 Available from http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42016041336.
KeywordsTrauma system Organizational-level intervention Injury outcomes
Injury is the leading cause of death under 40 years of age, the leading cause of loss of active life years and is second only to cardiovascular diseases in terms of healthcare costs in high-income countries [1, 2]. Low- to middle-income countries carry more than 90% of the burden of injury deaths [3, 4]. Important reductions in injury mortality, disability, and costs have been achieved in many healthcare jurisdictions with the introduction of trauma systems [5–9].
Examples of trauma system definitions from injury control organizations around the world
World Health Organization
A preplanned approach to the provision of the spectrum of trauma services, including but not limited to injury prevention and control initiatives, timely transport from scene of injury to trauma care facility, availability of trauma care providers and services when needed, and rehabilitation
US Department of Health and Human Services
Preplanned, comprehensive, and coordinated statewide and local injury response networks that include all facilities with the capability of care for the injured.
US National Highway Traffic Safety Administration
Organized, coordinated effort in a defined geographic area that delivers the full range of care to all injured patients and is integrated with the local public health system
Australian Institute of Health and Welfare
Integrated and systematic structure designed to facilitate and coordinate a multidisciplinary system response to provide optimal care to injured patients from onset of injury through rehabilitation and return of ideal functioning
Trauma Association of Canada
A preplanned, organized, and coordinated injury control effort in a defined geographic area
UK Trauma network
A model of care designed to care for patients with multiple serious injuries that could result in death or serious disability, including head injuries, life-threatening wounds and multiple fractures
In a model system, key trauma system elements (Leadership, Professional resources, Education and advocacy, Information, Finances, Research, Technology, Disaster preparedness and response) are integrated and coordinated to provide cost-efficient and appropriate services
State of Israel trauma model
A chain of arrangements and preparedness to provide quality response to injured from the site of injury to the appropriate hospital for the full range of care
Trauma system plan
Trauma system advisory committee
Trauma services medical director
Pre-hospital major trauma definition
EMS transport system
Triage and transport protocols
Emergency services medical director
EMS treatment protocols
Communication between EMS and hospitals
Facility designation through an accreditation agency
Sitting of facilities (coverage)
Interfacility transfer agreements/protocols
Communication between transferring hospitals
Integrated rehabilitation services
Data collection–trauma registries
Integration of evaluation throughout the care continuum
Interdisciplinary review committee
Our aim is to systematically review evidence of the impact of trauma system components on clinically significant injury outcomes including mortality, function and disability, quality of life, and resource utilization. Our systematic review protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 20-06-2016 (#42016041336). The review will be conducted between 01-11-2016 and 21-02-2017.
We will conduct a systematic review in accordance with Cochrane guidelines . The protocol is presented using the structure suggested in Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 (Additional file 1) . Any important protocol amendments will be recorded in PROSPERO and reported in the systematic review manuscript.
We will consider randomized and non-randomized controlled trials (RCT) including cluster RCT, interrupted time series studies, controlled before-after studies, and prospective or retrospective observational studies. We will also include studies based on qualitative methods (e.g. preventable death determined by expert consensus).
We will include studies based on injury populations at large as well as studies evaluating population-based injury outcomes (e.g. population rates of injury mortality or hospitalization). No restrictions will be placed on age, injury type, or injury severity. Studies based exclusively on combat injuries, isolated fractures following low falls, burns, bites, foreign bodies, or late effects of injuries will be excluded.
We will include studies evaluating the effectiveness of trauma system components, i.e. organizational-level structural interventions (single or multiple) related to tertiary injury prevention (see Table 2 for examples based on WHO and ACS guidelines). Interventions will be classified as using an adaptation of WHO and ACS categories, i.e. oversight, pre-hospital care, definitive care, rehabilitation, and evaluation.
We will include studies comparing a single or multiple organizational-level structural intervention to either (i) usual trauma system structure or (ii) an alternative organizational structure. In order to be as inclusive as possible and given the variation in definitions of trauma systems (Table 1), we will include studies based on authors’ definition of a trauma system and document that definition. No restrictions will be based on the country or the regulatory nature of the trauma system (e.g. mandatory, non-mandatory, or volunteer). Studies comparing health care jurisdictions with a trauma system to those without organized trauma care will not be included as evidence of the global effectiveness of trauma systems has already been reviewed .
Mortality (e.g. population-based, in-hospital, 30 days, 12 months, preventable)
Functional capacity (e.g. Functional Independence Measure, Glasgow Outcome Scale, return to work, level of dependency)
Quality of life (e.g. Short Form-36, WHOQOL, EQ-5D)
Burden of disease (e.g. years of life lost, Quality-Adjusted Life Years, Disability-Adjusted Life Years)
Adverse events (complications, patient safety events)
Healthcare utilization (e.g. hospital, intensive care unit, ventilator, and rehabilitation length of stay; hospital readmission; emergency department visits; general practitioner visits; paramedical services)
Costs (e.g. acute care, rehabilitation, loss in productivity)
No restrictions will be set on the follow-up of patients for the evaluation of injury outcomes. No language restrictions will be used.
The search strategy is designed to minimize publication bias, including geographical bias. We will systematically search MEDLINE, EMBASE, COCHRANE central, and BIOSIS/Web of Knowledge databases from their inception up to a maximum of 9 months before publication submission for eligible studies. Unpublished clinical studies will be searched using ClinicalTrials and the ISRCTN registry. We will consult thesis repositories to identify additional studies, including Thesis portal Canada, EtHOS, DART-Europe E-Theses Portal, the National Library of Australia’s TROVE and ProQuest Dissertations & Theses Global. We will also search the websites of key healthcare organizations (WHO, public health agencies) and injury organisations including the American College of Surgeons, the Trauma Association of Canada, the International Association for Trauma Surgery and Intensive Care, the Australasian Trauma Society and the Trauma Audit Research Network. We will then screen references of included articles and abstracts of major injury conferences including the International Surgical Week, World Congress of Surgery, American Association for the Surgery of Trauma Congress, European Congress of Trauma and Emergency Surgery, World Trauma Congress, Eastern Society for the Surgery of Trauma Congress, Trauma Association of Canada annual meeting, and Australasian Trauma Society Congress.
We will develop a rigorous systematic search strategy with a health sciences librarian who has systematic review experience using published guidelines of The Cochrane Collaboration (see Additional file 2 for a preliminary version) . The strategy will be developed for MEDLINE and EMBASE using keywords and MeSH (MEDLINE) or EMTREE (EMBASE). To be as inclusive as possible, we will limit the search strategy to terms covering the concept of trauma system. Keywords will be elaborated by co-investigators and collaborators with methodological and clinical expertise. This search strategy will then be adapted to the other databases. The health sciences librarian will conduct a peer review of the search strategy using the Peer Review of Electronic Search Strategies (PRESS) checklist .
Citations will be managed using EndNote software (version X7.0.1, New York City: Thomson Reuters, 2011). Duplicates will be identified and eliminated using electronic and manual screening. Multiple publications based on the same data will be identified by crosschecking authors, dates, and settings. We will identify only one publication for analyses using criteria based on study dates (most recent), sample size (largest), correspondence with inclusion criteria (highest correspondence), and risk of bias (lowest risk).
Pairs of reviewers will independently evaluate citations for potential inclusion by screening titles and abstracts and will assess full publications to determine eligibility for final inclusion. To ensure high agreement on study eligibility, three samples of 500 citations will be independently and consecutively assessed by each reviewer. Between each assessment, results will be discussed to reach a consensus on the interpretation of inclusion criteria. Any further disagreement on study eligibility will be resolved by consensus, and a third reviewer will adjudicate if necessary. If information on eligibility is unavailable or unclear, study authors will be contacted to clarify.
A standard electronic data abstraction form and a detailed instruction manual will be developed and piloted on a representative sample of five studies (Additional file 3). Pairs of reviewers with methodological and content expertise will independently extract information on study setting and design, study population, interventions, outcomes, measures of association with standard errors, and risk adjustment. Abstracts from conference proceedings will be included if they provide information on all of the above.
Risk of bias in individual studies
Risk of bias in observational studies will be evaluated using the ROBINS-I risk of bias assessment tool for non-randomized studies . The tool evaluates baseline and time-varying confounding, co-interventions, selection bias, classification bias (intervention), missing data, and bias in outcome measurement. If any randomized controlled trials are identified, risk of bias will be evaluated using the Cochrane risk of bias tool . Two reviewers will independently evaluate risk of bias and rate studies using respective tools (low, moderate serious, critical, unclear for the ROBINS-I tool and high, low, unclear for the Cochrane risk of bias tool). Disagreement will be resolved using arbitration by a third reviewer.
Measures of treatment effect
For dichotomous outcomes, data will be summarized using odds ratios (OR) or risk ratios (RR), depending on data available and their 95% confidence intervals (CI). For continuous outcomes, we will use weighted or standardized mean difference.
Assessment of heterogeneity
Statistical heterogeneity will be measured using I2 statistics . Heterogeneity will be interpreted as low from 0 to 40%, moderate from 30 to 60%, substantial from 50 to 90% and considerable from 75 to 100% .
If three or more studies have evaluated the same intervention or category of intervention (oversight, prehospital care, definitive care, rehabilitation, evaluation) and the same outcome, we will calculate pooled effect estimates and their 95% confidence intervals using random effects models adapted to the scale of measurement. We will use Review Manager (RevMan) (version 5.1, Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2012). If heterogeneity across studies in terms of populations, design, methods, intervention, and/or outcome (s) is too great to perform meta-analyses, we will present results using a systematic narrative synthesis. We will explore the results according to categories of interventions and outcomes taking account of risk of bias, in line with Centre for Reviews and Dissemination recommendations . The narrative will be written by the lead reviewer and then checked independently by at least one other reviewer. Any disagreements will be adjudicated by a third reviewer.
Subgroup and sensitivity analyses
If the number of studies is sufficient (≥3), we will perform subgroup analyses by age group, injury severity, and injury type (e.g. traumatic brain injury, spinal cord injury), according to authors’ definitions. We will also stratify by length of follow-up, World Bank country economic classifications (low–middle income, high income) and conduct sensitivity analyses excluding studies of low methodological quality.
We will visually inspect funnel plots to evaluate the risk of publication bias.
Strength of the body of evidence
We will evaluate the quality of evidence and strength of recommendations using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group methodology .
Organised trauma systems require significant human and financial resources. Understanding which components of trauma system structure favor optimal injury outcomes is critical to ensure policy-makers can make informed decisions as to where resources should be focused. This systematic review will be a first step to identifying which components of trauma systems relative to tertiary injury care drive optimal outcomes. If summarized evidence is strong enough,  our quantitative or qualitative synthesis may lead to tentative recommendations on trauma system structure and on specific areas for future research.
American College of Surgeons
Grading of Recommendations Assessment, Development and Evaluation
Peer Review of Electronic Search Strategies
International Prospective Register of Systematic Reviews
Randomized controlled trials
World Health Organization
This research is funded by the Fonds de Recherche du Québec–Santé (research career award, LM) and the Canadian Institutes of Health Research (Foundation grant #353374).
Availability of data and materials
LM led the development of the protocol and drafted the manuscript. She acts as guarantor for the review. HC contributed to the development of research objectives and inclusion criteria, elaborated keywords, validated the data extraction form, drafted parts of the manuscript, and approved the final version. GOR defined interventions and clinically significant outcomes, revised the search strategy, elaborated keywords, revised the manuscript, and approved the final version. AL elaborated inclusion and exclusion criteria, developed keywords, revised the manuscript, and approved the final version. PC elaborated inclusion and exclusion criteria and keywords, defined interventions and clinically significant outcomes, revised the manuscript, and approved the final version. CP revised trauma system definitions and keywords, revised the manuscript, and approved the final version. FMAZ elaborated inclusion and exclusion criteria and keywords, revised the manuscript, and approved the final version. BG refined trauma system components, elaborated inclusion and exclusion criteria and keywords, revised the manuscript, and approved the final version. CG elaborated inclusion and exclusion criteria and keywords, revised the manuscript, and approved the final version. NY defined interventions and clinically significant outcomes, developed keywords, revised the manuscript, and approved the final version. HTS defined interventions and clinically significant outcomes, developed keywords, revised the manuscript, and approved the final version. RC developed inclusion criteria and keywords, revised the manuscript, and approved the final version. JK refined ACS-COT trauma system components, defined clinically significant outcomes, revised the manuscript, and approved the final version. VN defined clinically significant outcomes, developed keywords, revised the data extraction form, revised the manuscript, and approved the final version. AG developed inclusion criteria and keywords, revised the manuscript. and approved the final version. LL worked on trauma system definitions, developed inclusion criteria and keywords, revised the manuscript, and approved the final version. MG worked on trauma system definitions, developed keywords, revised the manuscript, and approved the final version. MK refined WHO trauma system components, defined clinically significant outcomes, revised the manuscript, and approved the final version. MS developed the search strategy and the data extraction form, revised the manuscript, and approved the final version. VP validated the search strategy and the data extraction form, revised the manuscript, and approved the final version. AFT elaborated inclusion criteria and clinically significant outcomes, validated the search strategy, elaborated keywords, revised the manuscript, and approved the final version extraction form. All authors read and approved the final manuscript.
The International Injury Care Improvement Initiative (IICII) is a global effort of over 60 injury care experts, harnessing national capabilities in injury control from 30 countries in pursuit of our mission to reduce the global burden of injuries.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- HCUP Facts and Figures: Statistics on hospital-based Care in the United States, 2007. Agency for Healthcare Research and Quality, 2009. Available at: https://www.hcup-us.ahrq.gov/reports/factsandfigures.jsp. Accessed 17 Jan 2017.
- The cost of injury in Canada. Parachute Canada 2015. Available at: http://www.parachutecanada.org/costofinjury. Accessed 17 Jan 2017.
- Hofman K, Primack A, Keusch G, et al. Addressing the growing burden of trauma and injury in low- and middle-income countries. Am J Public Health. 2005;95(1):13–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Mock CN, Jurkovich GJ, Nii-Amon-Kotei D, et al. Trauma mortality patterns in three nations at different economic levels: implications for global trauma system development. J Trauma. 1998;44(5):804–12.View ArticlePubMedGoogle Scholar
- Mackenzie EJ, Rivara FP, Jurkovich GJ, et al. The national study on costs and outcomes of trauma. J Trauma. 2007;63(6 Suppl):S54–67.View ArticlePubMedGoogle Scholar
- Moore L, Turgeon A, Lauzier F, et al. Evolution of patient outcomes over 14 years in a mature, inclusive Canadian trauma system. World J Surg. 2015;39(6):1397–405.View ArticlePubMedGoogle Scholar
- Gabbe BJ, Biostat GD, Lecky FE, et al. The effect of an organized trauma system on mortality in major trauma involving serious head injury: a comparison of the United kingdom and Victoria, Australia. Ann Surg. 2011;253(1):138–43.View ArticlePubMedGoogle Scholar
- Gabbe BJ, Lyons RA, Fitzgerald MC, et al. Reduced population burden of road transport-related major trauma after introduction of an inclusive trauma system. Ann Surg. 2015;261(3):565–72.View ArticlePubMedPubMed CentralGoogle Scholar
- Gabbe BJ, Simpson PM, Sutherland AM, et al. Improved functional outcomes for major trauma patients in a regionalized, inclusive trauma system. Ann Surg. 2012;255(6):1009–15.View ArticlePubMedGoogle Scholar
- Haddon Jr W. On the escape of tigers: an ecologic note. Am J Public Health Nations Health. 1970;60(12):2229–34.View ArticlePubMedPubMed CentralGoogle Scholar
- Moore L, Evans D, Hameed SM, et al. Mortality in Canadian trauma systems: a multicenter Cohort Study. Ann Surg. 2016 Jan 7 [Epub ahead of print].
- American College of Surgeons Committee on Trauma. Regional trauma systems: optimal elements, integration, and assessment. Systems consultation guide. Chicago: American College of Surgeons; 2008. p. 54.Google Scholar
- Celso B, Tepas J, Langland-Orban B, et al. A systematic review and meta-analysis comparing outcome of severely injured patients treated in trauma centers following the establishment of trauma systems. J Trauma. 2006;60(2):371–8.View ArticlePubMedGoogle Scholar
- Kennedy MP, Gabbe BJ, McKenzie BA. Impact of the introduction of an integrated adult retrieval service on major trauma outcomes. Emerg Med J. 2015;32(11):833–9.View ArticlePubMedGoogle Scholar
- Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.View ArticlePubMedGoogle Scholar
- Simon R, Stone M, Cucuzzo J. The impact of a new trauma center on an existing nearby trauma center. J Trauma Inj Infect Crit Care. 2009;67(3):645–50.View ArticleGoogle Scholar
- Sampson M, Mcgowan J, Cogo E, et al. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009;62(9):944–52.View ArticlePubMedGoogle Scholar
- Claridge JA, Allen D, Patterson B, et al. Regional collaboration across hospital systems to develop and implement trauma protocols saves lives within 2 years. Surgery (United States). 2013;154(4):875–84.Google Scholar
- Higgins JP, Altman DG, Gotzsche PC, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.View ArticlePubMedPubMed CentralGoogle Scholar
- Eastman AB. Wherever the dart lands: Toward the ideal trauma system. J Am Coll Surg. 2010;211(2):153–68.View ArticlePubMedGoogle Scholar
- Grading the strength of a body of evidence when assessing health care interventions for the Effective Health Care Program of the Agency for Healthcare Research and Quality: An Update. Agency for Healthcare Research and Quality, 2008. Available at: http://effectivehealthcare.ahrq.gov/index.cfm/search-for-guides-reviews-and-reports/?pageaction=displayproduct&productid=1752. Accessed 17 Jan 2017.