Methods for estimating the burden of antimicrobial resistance: a systematic literature review protocol
Systematic Reviews volume 5, Article number: 187 (2016)
Estimates of the burden of antimicrobial resistance (AMR) are needed to ascertain AMR impact, to evaluate interventions, and to allocate resources efficiently. Recent studies have estimated health, cost, and economic burden relating to AMR, with outcomes of interest ranging from drug-bug resistance impact on mortality in a hospital setting to total economic impact of AMR on the global economy. However, recent collation of this information has been largely informal, with no formal quality assessment of the current evidence base (e.g. with predefined checklists). This review therefore aims to establish what perspectives and resulting methodologies have been used in establishing the burden of AMR, whilst also ascertaining the quality of these studies.
The literature review will identify relevant literature using a systematic review methodology. MEDLINE, EMBASE, Scopus and EconLit will be searched utilising a predefined search string. Grey literature will be identified by searching within a predefined list of organisational websites. Independent screening of retrievals will be performed in a two-stage process (abstracts and full texts), utilising a pre-defined inclusion and exclusion criteria. Data will be extracted into a data extraction table and descriptive examination will be performed. Study quality will be assessed using the Newcastle-Ottawa scales and the Philips checklists where appropriate. A narrative synthesis of the results will be presented.
This review will provide an overview of previous health, cost and economic definitions of burden and the resultant impact of these different definitions on the burden of AMR estimated. The review will also explore the methods that have been used to calculate this burden and discuss resulting study quality. This review can therefore act as a guide to methods for future research in this area.
Systematic review registration
Antimicrobial resistance (AMR) can be defined as the phenomenon in which microorganisms persist in the presence of antimicrobials, which are commonly used to prevent and/or treat infectious disease. AMR is a cause for concern within the UK and globally, due to the current and great potential negative impact on population health [1, 2]. AMR-associated burden can be defined as AMR impact on health (mortality or morbidity), impact on healthcare and patient costs or impact on the economy (labour force impact, productivity impact or opportunity cost) depending on study perspective. The AMR review, chaired by Jim O’Neill, has recently published estimates of potential future AMR burden, for example stating global gross domestic product (GDP) loss over the next 40 years could be as great as $3 trillion . These estimates have since been cited by policy makers and the media [3, 4], showing the demand for estimates quantifying the current and potential future problem AMR poses. Accurate estimates of disease-related burden are needed for policy makers to establish disease-related resource need and advocate for appropriate levels of funding and are critical inputs for any health economic evaluations of AMR interventions.
Recent descriptive review articles have discussed methods of burden estimation in the context of AMR, citing a few articles as examples of different methodologies [5–7]. However, since the 2012 rapid review update of a previous systematic review [8, 9], there has been no systematic review which looks into the estimation of burden associated with AMR. None of the aforementioned reviews formally quality assess study methodology, which is needed to highlight methodological issues in establishing the burden of AMR. The 2012 rapid review by Smith and Coast  concluded that the evidence base suggests the burden of AMR is relatively modest due to the narrow perspective taken by most studies, and that a wider societal perspective was needed to capture the true impact. However, with more recent work taking a wider perspective on AMR burden  and many more research articles being published in this area in recent years, a new assessment is required of the current estimates of both health and economic AMR burden.
The aims of this systematic review include the following: (i) to establish what perspectives and resulting methodologies have been used in establishing the burden of AMR, (ii) to see how this impacts on the burden estimates given and (iii) to assess the quality of these studies.
What perspectives and resulting methodologies have been used in establishing the burden of AMR?
Figure 1 depicts an overview of the study procedure.
Any studies that aim to quantify the burden of AMR within humans will be considered in this review, and this includes studies across any microbes, infections and country settings.
The methods used in this systematic review are in line with the PRISMA guidelines . In line with previous published protocols , a completed copy of the PRISMA-P checklist has been completed (see Additional file 1).
The search period will be restricted from 2013 onwards; this date was chosen to avoid retrieval duplication with Smith and Coast . Ovid “Medline and EMBASE”, Scopus and EconLit will be searched, along with grey literature from predetermined agency websites. The following agency websites were defined after consulting a group of AMR researchers. Their content will be searched for reports and articles relating to the population of interest:
Public Health England
Public Health Wales
Health Protection Scotland
NHS Health Scotland
Department of Health (UK)
Health Protection Agency
National Institute for Health and Care Excellence
Centers for Disease Control and Prevention
World Health Organisation
European Commission for Public Health
Review on Antimicrobial Resistance
It has been previously stated that many papers do not mention AMR generally, but rather specific microbes . In an attempt to tackle this, an additional 13 clinically relevant bacteria will be highlighted in the search. These can be identified in the stated search string below (note that this is in the format for Scopus, the same terms are to be reformatted for OVID and EconLit searches):
((TITLE ((excess OR associated OR attributable) W/2 (burden OR morbidity OR mortality OR cost*)) OR ABS ((excess OR associated OR attributable) W/2 (burden OR morbidity OR mortality OR cost*))) OR (TITLE ((economic OR clinical OR global) W/2 (impact OR outcome* OR burden OR cost*)) OR ABS ((economic OR clinical OR global) W/2 (impact OR outcome* OR burden OR cost*)))) AND ((ALL ((“antibiotic” OR “antimicrobial” OR “multidrug” OR “microbial-drug”) PRE/1 resistan*)) OR ((TITLE (enterococc* OR escherichia OR streptococc* OR staphylococc* OR klebsiealla OR pseudomonas OR neisseria OR chlamydia OR clostridi* OR mycobacteri* OR “gram-positive” OR “gram-negative”) OR ABS (enterococc* OR escherichia OR streptococc* OR staphylococc* OR klebsiealla OR pseudomonas OR neisseria OR chlamydia OR clostridia* OR mycobacteri* OR “gram-positive” OR “gram-negative”)) AND ((TITLE (susceptib* OR nonsusceptib* OR resistan*) OR ABS (susceptib* OR nonsusceptib* OR resistan*)) OR (ALL ((“antibiotic” OR “antimicrobial” OR “multidrug” OR “microbial-drug”) PRE/1 resistan*)))))
The lead reviewer (NN) will review all abstracts and full texts. Independent reviewers will perform a parallel review of the abstracts and full texts, with each of these reviewers being assigned a percentage of the total retrieval items. Any discrepancies will be discussed and re-examined until agreement is reached.
Risk of bias in individual studies will be assessed using the Newcastle-Ottowa scales for cohort and case control studies , whilst the Philips checklist will be used for economic models . These tools were chosen as the focus of this review is on study methodology rather than reporting standards.
Risk of bias across studies will be assessed in two groups; studies looking at health burden and studies looking at all other burden, and will simply be assessed based on the sign and significance of the outcome. This is due to the expected heterogeneity in studies (outcome, infection, resistance).
Data collection and analysis
Data will be collected by the lead reviewer (NN). Data will be inputted into a standardised data extraction table (Excel) and independently checked to ensure quality.
The following information will be extracted: study identifiers, study characteristics (perspective, country setting), population characteristics, data setting (hospital or community), study methodology, outcome of interest (mortality, length of stay, cost), results (e.g. resistance has a significant impact on the outcome of interest), stated limitations and information used for risk of bias assessment (informed by the cited checklists).
A descriptive synthesis of the study information and risk of bias structured around the perspectives (health, health system and economic burden) and related methods used will be provided. This will include a results table containing individual level study data, and summary graphical representation of study characteristics such as scatter plots of estimates for excess mortality and monetary cost. We anticipate limited scope for a meta-analysis given the assumed heterogeneous nature of identified outcomes, studies included may differ across perspective, infection site, infection type/causative organism, bug-drug combinations and sub-populations. However, if there are suitable data for one drug-bug combination in similar populations, then forest plots will be constructed utilising hazard ratio as the comparative outcome .
The format of this write-up will be a manuscript which will be submitted for publication in a peer-reviewed journal, it will also contribute to the lead reviewer’s (NN) PhD project as part of the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Healthcare Associated Infections and Antimicrobial Resistance.
Recent estimates for the burden suggest that AMR that it is a significant economic burden to the global economy , whilst previous reviews have suggested that perhaps study outcome and methodology impacts whether AMR is found to have a significant burden or not . Yet, there has been no literature review which formally looks to assess the quality of such studies.
Originally, the leading author ran a similar search strategy independently; however, after discussion with co-authors, it was realised that given the nature of previous reviews, and the lack of quality assessment of previous literature, the original study design did not adequately answer the research question or fill the current research gap. Therefore, the original study was halted (results not published in peer-review) and the study protocol was revised into the protocol written here.
This review will provide an overview of previous health, cost and economic definitions of burden in the context of AMR. The review will also explore the methods that have been used to calculate this burden and discuss resulting study quality. This review can therefore act as a guide to methods for future research.
Gross domestic product
Population, Intervention, Comparison, Outcome
Review on antimicrobial resistance, “Antimicrobial resistance: tackling a crisis for the health and wealth of nations,”. Available: https://amr-review.org/Publications. Accessed 5 Feb 2015.
World Health Organisation. Global report on surveillance. Geneva: World Health Organisation; 2014.
BBC, “Antibiotics crisis could lead to ‘millions of deaths’,” 2015. Available: http://www.bbc.co.uk/news/health-32738332. Accessed 15 May 2016
Public Health England, “New report shows stark effect of antibiotic resistance,” 2014. https://www.gov.uk/government/news/new-report-shows-stark-effect-of-antibiotic-resistance. Accessed 15 May 2016
De Angelis G, D’Inzeo T, Fiori B, Spanu T, Sganga G. “Burden of antibiotic resistant gram negative bacterial infections: evidence and limits”,. J Med Microbiol Diagn. 2014;3:132.
Gandra S, Barter DM, Laxminarayan R. Economic burden of antibiotic resistance: how much do we really know? Clin Microbiol Infect. 2014;20:973–80.
Woolhouse M, Waugh C, Perry MR, Nair H. Global disease burden due to antibiotic resistance—state of the evidence. J Glob Health. 2016;6(1):010306.
Smith R, Coast J. The true cost of antimicrobial resistance. BMJ. 2013;346:f1493.
Wilton P, Smith R, Coast J, Millar M. Strategies to contain the emergence of antimicrobial resistance: a systematic review of effectiveness and cost-effectiveness. J Health Serv Res Policy. 2002;7(2):111–7.
Takizawa C, Thompson PL, van Walsem A, Faure C, Maier WC. Epidemiological and economic burden of Alzheimer’s disease: a systematic literature review of data across Europe and the United States of America. J Alzheimers Dis. 2015;43(4):1271–84.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, PRISMA-P Group. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Rose TC, Adams N, Taylor-Robinson DC, Barr B, Hawker J, O’Brien S, Violato M, Whitehead M. Relationship between socioeconomic status and gastrointestinal infections in developed countries: a systematic review protocol. Syst Rev. 2016;5:13.
Wells GA, Shea B, O’Connell D, Peterson J, Welc V, Losos M, Tugwell P. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2011. www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed 01/02/2016
Philips Z, Ginnelly L, Schulpher M, Claxton K, Golder S, Riemsma R, Woolacoot N, Glanville J. Good practice guidelines for decision-analytic modelling in health technology assessment. Pharmacoeconomics. 2006;24:355–71.
Lewis S, Clarke M. Forest plots: trying to see the wood and the trees. BMJ. 2001;322:1479–80.
The authors would like to acknowledge Prof. Alison Holmes and Dr. Ceire Costelloe for their guidance in correspondence to the nature of this review and systematic literature reviews in general. The research was funded by the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London in partnership with Public Health England (PHE). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR, the Department of Health or Public Health England.
The research was funded by the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London in partnership with Public Health England (PHE). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR, the Department of Health or Public Health England. More information on HPRU and current projects can be found on https://www1.imperial.ac.uk/hpruantimicrobialresistance/.
Availability of data and materials
NN, GK and JR wrote the initial protocol. RA, SS, KK and NZ contributed to revising the protocol into the final format. All authors read and approved the final manuscript.
NN is currently undertaking a PhD funded by the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Healthcare Associated Infections and Antimicrobial Resistance.
The authors declare they have no competing interests.
Consent for publication
Ethics approval and consent to participate
About this article
Cite this article
Naylor, N.R., Silva, S., Kulasabanathan, K. et al. Methods for estimating the burden of antimicrobial resistance: a systematic literature review protocol. Syst Rev 5, 187 (2016). https://doi.org/10.1186/s13643-016-0364-8