Adherence to Brain Trauma Foundation guidelines for management of traumatic brain injury patients: study protocol for a systematic review and meta-analysis
Systematic Reviews volume 4, Article number: 149 (2015)
Traumatic brain injury (TBI) is a leading cause of death and disability around the world. Management based on Brain Trauma Foundation (BTF) guidelines is widely accepted and thought to improve outcome. The objectives of this systematic review are to give an overview of adherence to the BTF guidelines, describe factors influencing adherence, and study the effect of guideline-based management on outcome.
We will search electronic bibliographic databases: PROSPERO, Medline, EMBASE, SCOPUS, NHS, CINAHL, Cochrane Database, and ProQuest Dissertations and Theses Global. Two investigators will independently screen all titles, abstracts, and articles and select Randomized Controlled Trial (RCT), cohort studies, case-control studies, and case series reporting the adherence rate, factors influencing adherence, and mortality or morbidity. These investigators will also independently extract data using a pre-designed and pilot-tested standardized electronic data extraction form and assess the risk of bias. We will exclude pediatric and military-related TBI studies, studies that included fewer than ten patients or addressed adherence to pre-hospital guidelines. Narrative synthesis and if appropriate, quantitative meta-analysis clustered by type of recommendation will be reported.
This study is expected to demonstrate the current level of professionals’ adherence to BTF guidelines in patients with severe traumatic brain injury, it will describe the factors influencing adherence, which may provide valuable input for development of strategies to successfully increase adherence. In addition, if the studies are sufficiently homogenous, it will describe the effect of these guidelines on patient outcome.
Systematic review registration
Traumatic brain injury (TBI) is a leading cause of death and disability around the world [1, 2]. In the USA, the prevalence of TBI is estimated to be 2 % in the general population . The mortality rate was reported to be 18.4 per 100,000 persons with annual average of 53,014 deaths . A report from the Canadian Institute for Health Information (CIHI) report indicated that there were 16,811 hospitalizations annually for TBI with 1368 (8 %) related deaths . Among residents in a large Canadian health region, the annual incidence of severe TBI was 11.4 per 100,000 persons with a mortality rate of 5.1 per 100,000 persons per year .
Clinical practice guidelines are developed to improve quality of care decrease discrepancy in practice and ensure that evidence is followed . Mostly, these guidelines are developed and distributed by well-recognized organizations. A guideline consists of systematically developed recommendations to guide practitioners in choosing the appropriate health care decision for specific clinical circumstances . A guideline recommendation is defined as “any statement that promotes or advocates a particular course of action in clinical care” . In the treatment of TBI, guidelines are proposed to be an important aspect of patient management.
There are several published guidelines in the management of TBI from different countries. These guidelines target different aspects of TBI management including management during pre-hospital at the emergency department, in-hospital and intensive care unit, indications for surgical management, and computed tomography (CAT) scan of the head [10–14].
Internationally, Brain Trauma Foundation (BTF) guidelines are widely disseminated. They have been translated into over 15 different languages and applied in Europe, South America, and some parts of China . The BTF maintains and revises several TBI guidelines on an approximate 5-year cycles, including Guidelines for Prehospital Management of Traumatic Brain Injury, Guidelines for the Management of Severe Traumatic Brain Injury, Guidelines for the Surgical Management of Traumatic Brain Injury, Guidelines for the Acute Medical Management of Severe Traumatic Brain Injury in Infants, Children, and Adolescents, and Guidelines for the Field Management of Combat Related Head Trauma and Early Indicators of Prognosis of Severe Traumatic Brain Injury. These guidelines are developed and maintained through a collaborative agreement with the American Association of Neurological Surgeons (AANS) and the Congress of Neurological Surgeons (CNS), and in collaboration with the AANS/CNS Joint Section on Neurotrauma and Critical Care, European Brain Injury Consortium, and other stakeholders in TBI patient outcome .
Guidelines for Management of Severe Traumatic Brain Injury addresses key topics useful for in-hospital medical management of severe TBI in adult patients with a Glasgow Coma Scale (GCS) score of 3–8. These include blood pressure and oxygenation hyperosmolar therapy, prophylactic hypothermia, infection prophylaxis, deep vein thrombosis prophylaxis, intracranial pressure monitoring, cerebral perfusion thresholds, brain oxygen monitoring and thresholds, anesthetics, analgesics and sedatives, nutrition, antiseizure prophylaxis, and hyperventilation through steroids use. In 2007, the third edition of these Guidelines was released following the first and second editions in 1995 and 2000. [12, 15, 16].
Guidelines for the Surgical Management of Traumatic Brain Injury addresses acute surgical management of TBI including acute epidural and subdural hematomas, parenchymal mass lesions, depressed skull fractures through posterior fossa lesions with focus on indications, technique, and timing of surgery. These Guidelines were published in 2006 .
Studies suggest that implementation and strict adherence to BTF guidelines results in improvement in the neurological outcomes and reduction in mortality from severe traumatic brain injury [17, 18]. However, there is still significant variability and inconsistency in the management of traumatic brain injury patients [19, 20]. This review will be the first systematic review assessing the adherence to BTF guidelines and its effect on outcome.
The first objective of this study is to present a systematic review of adherence by practitioners to the BTF guidelines for the management of severe TBI. The second objective is to explore the factors influencing adherence to the guidelines. Identification of these factors may provide valuable insight into the development of strategies to increase the adherence. The third objective is to study the outcome of guideline-based management in comparison to non-guideline based management to determine the effectiveness of these guidelines.
Protocol and study overview
Methods of this systematic review and meta-analysis have been developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)  and the Meta-Analysis of Observational Studies in Epidemiology (MOOSE) guidelines . We will begin by developing a comprehensive database containing all published literature that addresses adherence to BTF guidelines in the management of severe TBI. This protocol has been registered in the PROSPERO International Prospective Register of Systematic Reviews (ID: CRD42015017794).
The population of interest will include adult (≥18 years old) hospitalized patients with blunt TBI. Whenever outcome measures are available, the patients who were treated based on the BTF guideline will be compared to the patients who were not treated based on the BTF guideline. Additionally, the population of this study will include the practitioners, mainly the neurosurgeons and critical care physicians, who will be assessed for adherences to guidelines. The assessed guidelines will be (a) in-hospital guidelines regarding blood pressure and oxygenation, hyperosmolar therapy, prophylactic hypothermia, infection prophylaxis, deep vein thrombosis prophylaxis, indications for intracranial pressure monitoring, intracranial pressure monitoring technology, intracranial pressure thresholds, cerebral perfusion thresholds, brain oxygen monitoring and thresholds, anesthetics, analgesics, sedatives, nutrition, antiseizure prophylaxis, hyperventilation, and steroids. (b) Guidelines for surgical management for acute epidural and subdural hematomas, parenchymal lesions, posterior fossa mass lesions, and depress cranial fractures. We will exclude (1) studies addressed adherence to pre-hospital guidelines (the result from studies on pre-hospital management may not reflect the adherence because failure to achieve target recommendation may be an indicator of severe injury), (2) studies focused on military/combat-related TBI, because the results would not be generalizable to the source population of civilian patients with TBI, and (3) studies with majority of pediatric patients.
The main outcome will be the adherence rate with BTF guidelines. In addition, we will identify factors influencing the adherence to the BTF guidelines. The effectiveness of adherence with the BTF guidelines on several clinical outcomes will be assessed. The measured clinical outcomes will include mortality (ICU, in-hospital mortality) and morbidity (Glasgow Outcome Scale (GOS), Modified Rankin Scale (MRS), ventilation days, ICU stay, and hospital stay).
Original searches will include RCT cohort, case-control, and case series. We will exclude studies that included fewer than ten patients.
The primary search strategy was developed by the primary investigator (YK) and in collaboration with an expert searcher/librarian (SC). We will search the following electronic bibliographic databases: PROSPERO Medline (OVID), EMBASE (OVID), EBM Reviews—Cochrane Database of Systematic Reviews, EBM Reviews—ACP Journal Club, EBM Reviews—Database of Abstracts of Reviews of Effects, EBM Reviews—Cochrane Central Register of Controlled Trials, EBM Reviews—Cochrane Methodology Register, EBM Reviews—Health Technology Assessment, EBM Reviews—NHS Economic Evaluation Database, CINAHL Plus with Full Text, ProQuest Dissertations and Theses Full-text, SCOPUS, and Google Scholar using both controlled vocabulary (e.g., EMTREE and MeSH) and keywords to retrieve concepts including Brain Trauma Foundation or brain injur* and guideline* and adhere*. Searches will be limited to adult patients in non-military settings. Animal studies will be excluded. This systematic review will include searching gray literature, reviewing references lists, and contacting experts in the field. (See appendix in Additional file 1 for the final proposed MEDLINE, EMBASE, and EBM Reviews—Cochrane Database of Systematic Reviews search strategy).
Two investigators (YK and IG) will independently screen all title abstracts and articles to identify study meeting inclusion/exclusion criteria. Inclusion disagreement will be discussed and resolved by consensus or arbitration by other researchers (CO and DZ).
Two investigators (YK and IG) will independently extract data from eligible studies using a pre-designed and pilot-tested standardized electronic data extraction form. We will extract data on (1) publication details (year and language of publication name of the publishing journal and country in which the study was conducted). (2) Design: type of study (RCT, cohort, case-control, case series), study temporality (prospective, retrospective). (3) Study participant details: patient characteristics (age, sex, GCS, Injury severity score). (4) Data for percentage adherence to BTF guidelines. From each article, adherence percentages for each recommendation will be extracted. In case of a pre- and post-intervention design for evaluation of intervention (for example introducing a protocol or teaching program), only the post-intervention percentages will be extracted because our interest is in the current clinical practice. (5) Demographic and injury-related characteristics, which may influence adherence to the BTF guidelines: increase age, elevated blood alcohol level, normal CT scan, and planned neurosurgical intervention or other factors reported in the study will be extracted when a statistically significant relationship between these factors and adherence is demonstrated. (6) Outcomes including mortality or morbidity if they compared between patients treated according to the BTF guidelines and patients treated differently and 95% confidence interval are reported. Discrepancies will be discussed and resolved by consensus or arbitration by other researchers (CO and DZ).
Randomized Controlled Trials (RCT)
The quality will be assessed using the Cochrane Handbook “Risk of Bias” assessment tool . Additionally, we will assess the quality of reporting using a checklist, which will be based on the CONSORT (Consolidated Standards of Reporting Trials).
The quality will be assessed using the Cochrane Risk Of Bias Assessment Tool: for Non- Randomized Studies of Interventions (ACROBAT-NRSI)  which evaluates the observational studies based on three domains: (1) Pre-intervention; evaluation of bias due to confounding and bias in selection of participants into the study. (2) At intervention: evaluation of bias in measurement of interventions. (3) Post-intervention: evaluation of biases due to departures from intended interventions bias due to missing data, bias in measurement of outcomes and bias in selection of the reported results. We will assess the quality of reporting of observational studies using a checklist, which will be based on the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) statement.
Two researchers (YK and IG) will address quality assessment of the included studies independently. Differences of opinion will be resolved by a discussion with other researchers (CO and DZ).
Narrative synthesis and where appropriate, quantitative meta-analysis will be used. Synthesis will be based on clustering the selected studies based on type of recommendation. Adherence to BTF-based protocol will be extracted as a separate category if the full description of the protocol and protocol adherence rate was reported. Data synthesis will include description of included studies.
The median adherence and interquartile range for each recommendation will be calculated as well as for overall adherence. Additionally, factors influencing adherence will be examined based on the type of recommendation.
Calculation of pooled estimates of mortality among TBI patients managed based on BTF guidelines and patients managed differently
In preliminary search, odds ratio was used as measure of association in several studies, and we will also use the odds ratio as the summary measure of association in our study. If only the relative risk is reported in a selected study, we will transform the relative risk into an odds ratio using the method described by Deeks and Altman . The cohort studies and RCTs will be pooled separately. We will conduct stratified analyses of pooled estimate of mortality by type of recommendation and outcome (for example in-hospital mortality intensive care unit mortality, 30 days mortality or 6 months mortality). We will examine heterogeneity separately in the pooled estimates by study design (RCT, observational) using the Cochran Q and I2 statistics . In the presence of heterogeneity, random effects models will be used instead of fixed effects models to account for the expected variability beyond the chance and obtain pooled effect estimates across studies . The pooled estimates obtained from these calculations will then be compared to determine if the results are different between experimental and cohort study designs. If the adjustment for confounding variables varies between studies, analysis will be stratified into two parts, one for studies adjusting for several confounding variables (e.g., age, GCS, injury severity score, pupillary response, and CAT scan head finding) and the other one for studies adjusting for a few confounding variables.
If an adequate number of studies are chosen for the meta-analysis, we will conduct meta-regression considering the following covariates: year of publication, country of origin, and study period.
Publication bias will also be assessed using funnel plot and the methods described by Begg and Egger [27, 28]. Meta-analysis will be performed using Review Manager software (RevMan5.3.5 Cochrane Collaboration) and regression analysis will be conducted using Stata Statistical Software version 13.1. (StataCorp LP, College Station, TX, USA).
All data will be extracted by two independent investigators (YK IG). To assess inter-rater reliability, the percent agreement will be calculated on adherence percentage for number of guideline recommendations by third investigator (AS).
This systematic review and meta-analysis will be the first systematic review summarizing relevant literature on guidelines for management of severe traumatic brain injury. In this review, we will demonstrate the current level of professionals’ adherence to BTF guidelines in patients with severe traumatic brain injury. In addition, we will describe the factors influencing adherence, which may provide valuable input for development of strategies to successfully increase adherence. Finally, we will describe the effect of these guidelines on patient outcome if data is sufficiently homogenous. Results of this review are expected to be available near the end of 2015.
The major strength of this systematic review will be the use of several electronic databases and other relevant sources based on established guideline for systematic review. An additional strength of the review will be the use of inter-rater reliability, standard protocol for reporting systematic reviews as well as quality assessment of the included studies. However, there are some limitations in this review. We may not be able to find the non-observational studies due to the nature of the measured effect. Furthermore, this review will be examining adherences with different recommendations at several locations using different clinical determinants. Therefore, a high level of heterogeneity will be expected and may limit our ability to perform meta-analysis.
Brain Trauma Foundation
traumatic brain injury
Cumulative Index to Nursing and Allied Health Literature
Cochrane Central Register of Controlled Trials
Randomized Controlled Trial
American Association of Neurological Surgeons
Congress of Neurological Surgeons
Glasgow Coma Scale
Meta-analysis of Observational Studies in Epidemiology
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
American College of Physicians
Strengthening the Reporting of Observational studies in Epidemiology
Myburgh JA, Cooper DJ, Finfer SR, Venkatesh B, Jones D, Higgins A, et al. Epidemiology and 12-month outcomes from traumatic brain injury in Australia and New Zealand. J Trauma. 2008;64:854–62.
CDC IPaC. Traumatic brain injury. Available at: http://www.cdc.gov/traumaticbraininjury/statistics.html. Accessed June 24, 2015.
Langlois JA, Rutland-Brown W, Wald MM. The epidemiology and impact of traumatic brain injury: a brief overview. J Head Trauma Rehabil. 2006;21(5):375–8.
Coronado VG, Xu L, Basavaraju SV, McGuire LC, Wald MM, Faul MD, et al. Surveillance for traumatic brain injury-Related Deaths—United States, 1997–2007. Cent Dis Control Prev: Morb Mortal Wkly Rep. 2011;60(5):1–36.
Canadian Institute for Health Information: head injuries in Canada: a decade of change (1994–1995 to 2003–2004). https://secure.cihi.ca/estore/productFamily.htm?pf=PFC1360&lang=fr&media=0. Accessed 14 January 2015.
Zygun DA, Laupland KB, Hader WJ, Kortbeek JB, Findlay C, Doig CJ, et al. Severe traumatic brain injury in a large Canadian health region. Can J Neurol Sci. 2005;32(1):87–92.
Thomas LH, Cullum NA, McColl E, Rousseau N, Soutter J. Steen N. Cochrane Database of Systematic Reviews: Guidelines in professions allied to medicine; 2009.
Field MJ. Clinical practice guidelines: directions for a new program. Washington DC: National Academy Press; 1990.
Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009;18:385–92.
Haydel MJ, Preston CA, Mills TJ, Luber S, Blaudeau E, DeBlieux PM. Indications for computed tomography in patients with minor head injury. N Engl J Med. 2000;343:100–5.
The Brain Trauma Foundation. Guidelines for prehospital management of traumatic brain injury, 2nd edition. Prehosp Emerg Care. 2007;12(Suppl):S1–52.
Brain Trauma Foundation; American Association of Neurological Surgeons; Congress of Neurological Surgeons; Joint Section on Neurotrauma and Critical Care, AANS/CNS. Guidelines for the management of severe head injury. J Neurotrauma. 2007;24(Suppl):S-1–S106.
Bullock MR, Chesnut R, Ghajar J, Gordon D, Hartl R, Newell DW, et al. Guidelines for the surgical management of traumatic brain injury. Neurosurgery. 2006;58(Suppl):52-1–52-61.
Guidelines from the Guidelines Committee on the Management of Severe Head Injury; the Japan Society of Neurotraumatology. Guidelines for the management of severe head injury; second edition. Neurol Med Chir (Tokyo). 2012;52:1–30.
Bullock R, Chesnut R, Clifton G, Ghajar J, Marion D, Narayan R, et al. Guidelines for the management of severe head injury. Brain Trauma Foundation, American Association of Neurological Surgeons Joint Section on Neurotrauma and Critical Care. J Neurotrauma. 1996;13:641–734.
Bullock RM, Chesnut RM, Clifton GL, Ghajar J, Marion D, Narayan R, et al. Guidelines for the management of severe traumatic brain injury. J Neurotrauma. 2000;17:449–554.
Palmer S, Bader M, Qureshi A, Palmer J, Shaver T, Borzatta M, et al. The impact of outcomes in a community hospital setting using the AANS Traumatic Brain Injury guidelines. American Association of Neurological Surgeons. J Trauma. 2001;50:657–64.
Vukic L, Negovetic D, Kovac D, Ghajar J, Glavic Z, Gopcevic A. The effect of implementation of guidelines for the management of severe head injury on patient treatment and outcomes. Acta Neurochir. 1999;141:1203–8.
Talving P, Karamanos E, Teixeira PG, Skiada D, Lam L, Belzberg H, et al. Intracranial pressure monitoring in severe head injury: compliance with Brain Trauma Foundation guidelines and effect on outcomes: a prospective study. J Neurosurg. 2013;119:1248–54.
Biersteker HA, Andriessen TM, Horn J, Franschman G, Naalt JV, Hoedemaekers CW, et al. Factors influencing intracranial pressure monitoring guideline compliance and outcome after severe traumatic brain injury. Crit Care Med. 2012;40(6):1914–22.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151:W65–94.
Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283:2008–12.
Sterne JAC, Higgins JPT, Reeves BC on behalf of the development group for ACROBAT- NRSI. A Cochrane Risk Of Bias Assessment Tool: for Non-Randomized Studies of Interventions (ACROBAT- NRSI), Version 1.0.0, 24 September 2014. Available from http://www.riskofbias.info, accessed June 24 2015.
The Cochrane Collaboration. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. Oxford: The Cochrane Collaboration; 2011.
Deeks JJ, Altman DG. Effect measures for meta-analysis of trials with binary outcomes. In: Egger M, Smith GD, Altman DG, editors. Systematic reviews in health care. 2nd ed. London: BMJ Publishing Group; 2001. p. 313–35.
DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177–88.
Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50:1088–101.
Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Br Med J. 1997;315:629–34.
YK is not funded. IG is financially supported by the Vice Deanship of Research Chair, King Saud University, Riyadh, Kingdom of Saudi Arabia. SC is not funded. AS is not funded. CO is not funded. DZ is not funded for this project specifically but is appointed to the Division of Critical Care Medicine, Faculty of Medicine and Dentistry, University of Alberta.
The authors declare that they have no competing interests.
YK and DZ formulated the research question. YK, DZ, and CO designed the study. YK developed the preliminary search strategy and drafted the manuscript. SC refined and executed the search strategy and exported the results. YK, IG, and AS designed the statistical analysis plan. YK, DZ, CO, AS, IG, and SC critically reviewed the manuscript for content. All authors have approved the final version of the manuscript.
YK is a neurosurgery resident and Clinical Epidemiology Master of Sciene student at the University of Alberta, IG is an assistant professor at the Department of Community and Family Medicine, King Saud University, SC is a health sciences librarian at the University of Alberta. AS is a professor (statistics) at the School of Public Health, University of Alberta. CO is an assistant professor in the Division of Neurosurgery, University of Alberta. DZ is a Professor in the Division of Critical Care Medicine, University of Alberta.
Appendix 1. Proposed Medline search strategy; Appendix 2. Proposed Embase search strategy; Appendix 3. Proposed EBM Reviews—Cochrane Database of Systematic Reviews search strategy. (DOCX 24 kb)
About this article
Cite this article
Khormi, Y.H., Gosadi, I., Campbell, S. et al. Adherence to Brain Trauma Foundation guidelines for management of traumatic brain injury patients: study protocol for a systematic review and meta-analysis. Syst Rev 4, 149 (2015). https://doi.org/10.1186/s13643-015-0140-1