- Open Access
- Open Peer Review
Effect of the duration of antimicrobial exposure on the development of antimicrobial resistance (AMR) for macrolide antibiotics: protocol for a systematic review with a network meta-analysis
Systematic Reviewsvolume 7, Article number: 246 (2018)
Antimicrobial resistance generates a huge health and economic burden and has the potential to become the leading cause of death globally, but its underlying drivers are yet to be fully described. The association between a microbe’s exposure to antimicrobials and subsequent development of, or selection for, resistance is well documented, as are the exacerbating microbial and human factors. However, the nature and extent of this risk, and how it varies by antimicrobial class and duration of treatment, is poorly defined. The goal of our systematic review and network meta-analysis is to determine the relationship between the duration of antimicrobial exposure and selection for resistance. We will use macrolides as the antimicrobial class of interest and Streptococcus pneumoniae carriage as an indicator organism. Our secondary outcomes include duration of symptoms, risk of treatment failure and recurrence, and descriptions of resistance mechanisms.
We will conduct a systematic review, selecting studies if they are published randomised controlled trials (RCTs) which report the relationship between taking a macrolide for any indication and incidence of resistant Streptococcus pneumoniae in patients of any age group. We will use a predefined search strategy to identify studies meeting these eligibility criteria in MEDLINE, Embase, Global Health and the Cochrane Central Register of RCTs. Two authors will independently screen titles and abstracts, review the full texts and undertake data extraction. We will use the Cochrane Collaboration’s tool to assess the quality of included RCTs. If feasible, we will perform pair-wise meta-analysis modelling to determine the relationship between the duration of macrolide treatment and development of macrolide resistant Streptococcus pneumoniae. If the identified studies meet the assumptions for a network meta-analysis (NMA), we will additionally model this relationship using indirect comparisons. Our protocol utilises reporting guidance by Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and the extensions for protocols (PRISMA-P) and network meta-analyses (PRISMA for NMA). Our review will also report to these standards.
Establishing the relationship between the duration of antimicrobial exposure and development of, or selection for, resistance will inform the design of antimicrobial prescriptions, treatment guidelines and the behaviour of both physicians and patients. This work will therefore be a strong contribution towards the full realisation of current antimicrobial resistance stewardship strategies.
Systematic review registration
Antimicrobials—organic or synthetic molecules with cytotoxic or cytostatic abilities against microbes—are one of the greatest medical discoveries . Unfortunately, their usefulness is limited by the inherent genetic capacity of microbes to rapidly develop, transfer and acquire resistance-causing mutations [2, 3]. Unnecessary prescription in medical settings, as well as extensive agricultural use, contributes substantially to overall antibiotic drug pressure globally [4,5,6]. The current era is characterised by sharply declining investment from the pharmaceutical industry in the development of effective new antimicrobials; far fewer new compounds are developed annually now than during the 1990s .
In 2016, antimicrobial resistance became one of only four health topics ever to be discussed at the United Nations General Assembly , reflecting its huge health and economic burden [9, 10]. Drug resistance is projected to become the leading cause of death by 2050 .
The development of antimicrobial resistance is, to some extent, inevitable. Billions of doses of antibiotics are taken globally each year. Each human hosts a microbiome of approximately 3.8 × 1013 bacteria , and there is spontaneous (i.e. unselected) drug-resistance within this microbiome at a frequency as high as 10−4 mutations, depending upon the type of antimicrobial [13,14,15]. Under drug pressure, resistance can then be amplified and transmitted through a variety of mechanisms . Despite these risks, use of single-drug regimens remains standard practice for many conditions, because they are often sufficient to cure the patient and they reduce immediate costs and adverse events.
There is unambiguous evidence that the development of, or selection for, resistance occurs following antimicrobial exposure [4, 16,17,18]. The duration of treatment that is necessary for the development of, or selection for, resistance is poorly defined, however. This may differ by the resistance mechanism; for example, the unmasking of any resistant organisms generated during previous treatment periods may rapidly occur following a brief exposure to antimicrobials, while de novo generation may require longer durations. Better quantification of this relationship will inform prescription design, guidelines and behaviour, all of which are key factors in effective antimicrobial resistance control strategies .
To explore this relationship and derive high-quality evidence, it is necessary to choose an antimicrobial or class of antimicrobials with which patients are treated, an indicator organism in which drug resistance develops and a uniform method for assessing resistance. Macrolides are one of the most prescribed antimicrobials in clinical practice [20, 21], which act by inhibiting bacterial protein synthesis . Streptococcus pneumoniae, a major aetiology of clinical illness [23,24,25,26], also harmlessly colonises the upper respiratory tract, creating a window for the assessment of circulating serotypes and resistance patterns. Streptococcus pneumoniae is also a popular indicator bacteria in randomised controlled trials (RCTs) as globally accepted laboratory procedures for its detection exist [27,28,29] and colonisation is more common than invasive pneumococcal disease [30,31,32]. The existence of internationally accepted laboratory standards presents opportunities for between-study comparisons.
Our aim, therefore, is to conduct a systematic review using data from published RCTs to determine the relationship between the duration of antimicrobial exposure and the development of, or selection for, resistance using carriage of Streptococcus pneumoniae as an indicator organism. We will evaluate studies involving healthy individuals or patients with any illness treated with macrolide antimicrobials in whom the development of, or selection for, antimicrobial resistance was assessed using Streptococcus pneumoniae carriage. We have opted to use network meta-analysis (NMA) as the preferred evidence synthesis method because RCTs with head-to-head comparisons of different durations of macrolides will likely be too rare for a meaningful pair-wise meta-analyses. NMAs allow the use of both direct and indirect evidence and are hence the most efficient method for making inferences.
Our primary objective is to determine whether the risk of developing macrolide resistance increases with the duration of macrolide exposure using upper respiratory tract carriage of Streptococcus pneumoniae as indicator organism. Our secondary objectives include exploring the association between the duration of macrolide treatment and (1) symptom duration, (2) treatment failure and (3) disease recurrence.
Protocol and registration
The protocol for this planned systematic review is registered with the International Prospective Register of Systematic Reviews (PROSPERO), CRD42018089275.
We will include studies that fulfil the following criteria:
Population: healthy individuals or patients of any illness or age, treated with macrolide antimicrobials. We will record participant characteristics, including age, sex and the indication for treatment.
Interventions: Any macrolide antimicrobial being given as monotherapy, via any route, for respiratory infections. We are interested in the impact of macrolide treatment on antimicrobial resistance in Streptococcus pneumoniae carriage. We will record the specific macrolide, dose and duration reported in each study. Registered macrolides include azithromycin, clarithromycin, erythromycin, fidaxomicin, telithromycin, carbomycin a, josamycin, kitasamycin, midecamycin, midecamycin acetate, oleandomycin, solithromycin, spiramycin, troleandomycin, tylosin, tylocine and roxithromycin.
Comparators: Other macrolides, other antimicrobials, placebo, or no treatment. Macrolides are commonly used for respiratory tract infections, and amoxicillin and doxycycline are expected to be the most frequent non-macrolide comparators.
Outcomes: The primary outcome will be the incidence/risk of macrolide resistance in Streptococcus pneumoniae carriage among individuals in whom this did not exist before commencing macrolide treatment. Macrolide resistance in Streptococcus pneumoniae results from either ribosomal dimethylation by an enzyme encoded by erm(B), efflux by a two-component efflux pump encoded by mef (E)/mel(msr(D)), or mutations of the ribosomal target site of macrolides . We will include studies that utilised any established laboratory method to demonstrate evidence of macrolide resistance.
Our secondary outcomes include the duration of symptoms (number of symptomatic days from commencement of therapy), risk of treatment failure (persistence of symptoms after completing a dosage of antimicrobials) and disease recurrence (re-emergence of disease within 4 weeks of the resolution of previous symptoms).
Study design: RCTs. Restricting to RCTs will minimise confounding.
Language and time limitations: We will include studies published in any language and on any date. For articles in languages other than English that are eligible for full-text review, we will seek assistance from a native speaker who has been trained in data extraction using an article published in English.
Anticipated network geometry
In NMA geometry, competing interventions are represented by points termed nodes. In this case, nodes are the duration of exposure to any macrolide used in the included RCTs (Fig. 1). We will classify treatment duration as brief if it is ≤ 5 days, short if it is 6 to 10 days, and prolonged if it is > 10 days. These durations are based on an understanding of the current clinical use of macrolides, which are dosed for up to 5 days for community acquired pneumonia, up to 10 days for severe pneumonia, and for prolonged periods of time for inflammatory respiratory illnesses such as cystic fibrosis and non-cystic fibrosis bronchiectasis. Within the network, the lines joining nodes are termed edges and are drawn to a thickness that graphically represents the anticipated amount of evidence or number of comparisons that we expect to find between the particular nodes. For example, it is likely that more RCTs will compare a macrolide to a control than to another macrolide of a different duration. NMAs will allow us to compare different durations of macrolide exposure (brief, short and prolonged) by computing indirect comparisons, provided that any patient meeting our eligibility criteria would, theoretically, have been equally likely to be randomised to any of the interventions of the studies included in the network.
Information sources and search strategy
We will search for studies that meet the eligibility criteria in MEDLINE, Embase, Global Health, Web of Science and Cochrane Central Register of Controlled Trials (CENTRAL: The Cochrane Library). MEDLINE, Embase and Global Health will be searched using the Ovid platform. Papers will not be excluded on the basis of the language of publication and time frame in which they were published. We will only include data from peer-reviewed papers in order to ensure scientific quality.
In Table 1, we present our search strategy for MEDLINE, which we will adapt for the other databases. This strategy was reviewed by an information retrieval expert from the London School of Hygiene & Tropical Medicine (LSHTM) library. After running the search, we will export results to Endnote X8 and remove all duplicates. We will also include any relevant articles identified from the reference lists of included articles.
Investigator THD will implement the search strategy, and then investigators THD and MN will screen the titles and abstracts of resulting papers against the eligibility criteria. THD and MN will independently assess the full texts of the included papers for eligibility using the above criteria. The main reason for non-inclusion at the full-text stage will be documented. Investigator KF will resolve any disagreements.
Publication information will be exported from Endnote into a standardised extraction form in Microsoft Excel Data will be extracted into (Additional file 1). This form is currently in draft format; it will be finalised among the study team once it has been trialled by two people extracting the same five papers. After finalisation of the form, two team members will extract the data independently. Discrepancies will initially be discussed and resolved between the two team members, with a third team member available to resolve disputes. Multiple publications arising from the same study will be combined. Where data gaps are present, the original study authors will be contacted. Once the extraction phase is complete, data will be exported into the analysis software.
Data for assessing methodological comparability of trials
In addition to the data necessary for outcome evaluation, we will extract information on any interventions, or study or population characteristics that may act as effect modifiers, as is necessary for the assessment of the assumptions of the NMA. These are:
Methods: study design, randomisation (individual or cluster), total duration of study, number of study centres and location, study setting, withdrawals and date of study.
Participants: age, number, setting, eligibility criteria and baseline antimicrobial resistance (AMR).
Interventions: indication of treatment, dose of both the macrolide and control interventions and duration of treatment.
Outcomes: authors’ primary and secondary outcomes, timing for assessing AMR in relation to the treatment administration schedule and participant adherence levels. We will attempt to extract outcome data per study arm, as opposed to summary effects.
Additional factors: trial sponsorship, trial funding and important conflicts of interest reported by the authors.
Data from cross-over and cluster randomised trials
The units of analysis in cross-over and cluster randomised trials (CRTs) need special considerations before meta-analysis is undertaken in order to address carry-over effects and clustering, respectively. For cross-over studies we will only extract data from the first period, while for CRTs, we will extract data that accounts for the clustering.
Risk of bias assessment
We will conduct a risk of bias assessment at the level of the study. We will use the revised Cochrane risk-of-bias tool for randomised trials (RoB 2.0), the recommended method for assessing experimental studies . The risk of bias assessment tool interrogates various aspects of selection and information bias. It involves assessing how the allocation sequence was generated, how it was concealed, if blinding was done, how outcomes were ascertained, the quality of follow up, and whether there was selective outcome reporting. The risk of bias assessment will be done independently by two reviewers and disagreements resolved by discussion or by third reviewer.
Guiding counterfactual model
Our analysis will strive, as far as possible, to mimic the counterfactual framework presented in Fig. 2. The ideal study for addressing the primary outcome is one that recruits AMR-free participants of similar demographics, randomises them (1:1:1) to receiving any of the three durations of the same macrolide antimicrobial (brief, short and prolonged), and then follows them for the same duration before assessing for AMR using the same technique. Restricting to the same type of macrolide antimicrobial would limit the impact of the inherent differences in the intervention itself. For example, within the macrolide class, the drugs have different bioavailability and half-lives; this may impact the development of, or selection for, resistance. Additionally, different dosing, routes of administration, and strength of activity against S. pneumoniae are other sources of variability. Furthermore, an optimal study would assess outcomes in each arm at the same time relative to the end of treatment (e.g. 1 day post-treatment), as macrolide AMR has been shown to decrease with time from last date of treatment. The use of the same technique would ensure comparability of results between arms.
While ideal, achieving all these factors in a real-life systematic review is unlikely. Our final statistical analysis plan will therefore be a calculated trade-off of these ideal conditions.
Study and network characteristics
Data will initially be analysed using descriptive statistics, including all the variables described above, in addition to reporting the comparisons performed in each study, indications for antimicrobial therapy, participant characteristics, study setting, and methodological approaches.
We will prepare a network diagram (similar to the hypothetical diagram shown in Fig. 1) in which the size of the nodes reflect the total number of patients randomised to each intervention, the thickness of edges is proportional to the number of direct comparisons, and the colour of each edge will represent the risk of bias. We will use a contribution matrix to understand and rank the influence of various comparisons in the network on the final summary data [35, 36].
Pair-wise and network meta-analysis
If sufficiently methodologically homogeneous studies are identified, we will perform pair-wise meta-analysis for the primary outcome using either fixed effects or random effects modelling approaches, depending on the extent of heterogeneity. We will assess the extent of heterogeneity using the Cochran Q2 and I2 statistics. We will convey the extent of heterogeneity visually using a forest plot.
Next, we will assess whether the identified studies meet the assumptions for a NMA. Apart from having reasonably homogeneous methodologies, the key assumption for ensuring validity of inferences drawn from indirect comparisons within a network is transitivity; the balance of the distributions of patient and study characteristics across studies. Initially, we will determine if this assumption is fulfilled by conducting a qualitative review of the RCT characteristics described earlier (‘Data extraction’ section).
For the subset of eligible studies in which the transitivity assumption holds, we will assume that each of their patients were equally likely to be randomised to any of the antimicrobial agents and treatment durations being investigated, thus establishing the basis for the indirect comparisons. Fixed and random effects NMAs will then be used to synthesise all the evidence for the primary outcome and to rank included treatments. To identify the appropriate model between fixed and random effects NMAs for our data, we will use the deviance information criteria (DIC) to assess their goodness-of-fit. The summary effect measures for all pairwise comparisons will be presented in a league table. We will rank the risk of AMR with various treatments using the surface under the cumulative ranking curve (SUCRA) and mean ranks .
Consistency within the network—the agreement between direct and indirect evidence—will be assessed within each loop of evidence using loop-specific approach  and by employing a global method for evaluating the whole network . We will also estimate the I2 for network heterogeneity and inconsistency [40, 41], but we will exercise caution when interpreting the results, considering the well-established limitations in power . We will use funnel plot to assess for publication bias.
We will perform subgroup, meta-regression and sensitivity NMA analyses. The subgroup analyses will involve running the NMA model stratified by study-level characteristics, i.e. (1) the age groups of participants, (2) country in which the study was conducted, (3) treatment indications, (4) macrolide type and (5) publication calendar period. The meta-regression will include the study-level covariates described earlier (‘Data for assessing methodological comparability of trials’ section), in order to reduce heterogeneity. We will initially add the covariates to the NMA individually, retaining those that have a meaningful impact on the DIC and considering combinations of factors after the initial individual-level assessment. Should we identify additional relevant characteristics during data extraction or analysis for both the subgroup analyses and meta-regression, we will identify such analysis (in our publication) as post hoc. In sensitivity analyses, we will perform the NMA with and without studies that have high risk of bias.
We will perform our analyses and report treatment effects on both relative and absolute difference scales, stating odds ratios (ORs), risk differences (RDs) and respective 95% credible intervals (95%CrI) for all comparisons. We will model using OpenBUGS  and Stata release 15 (StataCorp, College Station, TX, USA). We will use binomial likelihoods with uninformative prior distributions for our Bayesian modelling. The Brooks-Gelman-Rubin diagnostic will be utilised to assess for model convergence [44, 45]. We will primarily use the mvmeta command  in Stata to assess inconsistency and to produce network graphs.
Credibility of the evidence
The credibility of the evidence will be evaluated with respect to its limitations, indirectness, inconsistency, imprecision and publication bias using the approach recommended by the Grade of Recommendation, Assessment, Development and Evaluation (GRADE) system [47, 48].
Dissemination of results
We will present the results of our analyses in a peer-reviewed manuscript using the reporting guidance by the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA)  and the PRISMA Network Meta-Analysis extension statement . This work will also form part of a PhD thesis for THD, which he will submit to the LSHTM.
Our systematic review will use published RCTs of macrolide antimicrobials to establish the relationship between the duration of antimicrobial exposure and the development of, or selection for, resistance using upper respiratory tract carriage of Streptococcus pneumoniae, isolated from patients with respiratory symptoms, as indicator organism. This will inform the design of antimicrobial prescriptions, treatment guidelines and the behaviour of both physicians and patients. This work therefore will therefore be an important contribution towards the realisation of current antimicrobial resistance control strategies .
Where possible, through our secondary objectives, we will attempt to describe the clinical outcomes associated with different macrolide durations. Our results on these outcomes will form the basis for future, detailed, research.
The strengths of our review include publication of the full protocol with PROSPERO and in this peer-reviewed article, with detailed methodology laid out a priori. The internal validity of our review is safeguarded by our restriction of the study type to RCTs. The quality and transparency of our work are ensured by our adherence to both PRISMA and PRISMA NMA guidelines.
The conclusions of our NMA will be weakened if direct comparisons are rare, leading to an overreliance on indirect comparisons. Heterogeneity may be introduced by our broad participant population (all ages, any indication of treatment), global coverage (any setting) and unlimited study period. We will seek to limit this by adding study-level covariates to the NMA model, if required.
To our knowledge, our review and NMA will be the first attempt to systematically examine the association between the duration of exposure to macrolide antimicrobials and subsequent development of, or selection for, resistant Streptococcus pneumonia carriage. Therefore, our review will not only provide direction for AMR stewardship policies, but also guide future AMR research.
Zaman SB, Hussain MA, Nye R, Mehta V, Mamun KT, Hossain N. A review on antibiotic resistance: alarm bells are ringing. Cureus. 2017;9(6):e1403.
Holmes AH, Moore LS, Sundsfjord A, et al. Understanding the mechanisms and drivers of antimicrobial resistance. Lancet. 2016;387(10014):176–87.
World Health Organization. Antimicrobial resistance: global report on surveillance: World Health Organization; 2014.
Goossens H, Ferech M, Vander Stichele R, Elseviers M, Group EP. Outpatient antibiotic use in Europe and association with resistance: a cross-national database study. Lancet. 2005;365(9459):579–87.
Ventola CL. The antibiotic resistance crisis: part 1: causes and threats. P T. 2015;40(4):277–83.
Salmond GPC, Welch M. Antibiotic resistance: adaptive evolution. Lancet. 2008;372:S97–S103.
Brown ED, Wright GD. Antibacterial drug discovery in the resistance era. Nature. 2016;529(7586):336–43.
United Nations General Assembly. Draft political declaration of the high-level meeting of the United Nations General Assembly on antimicrobial resistance. New York: United Nations; 2016.
Control CfD, Prevention. Office of Infectious Disease. Antibiotic resistance threats in the United States, 2013. 2013. 2015.
ECDC E. The bacterial challenge: time to react. Stockholm: European Center for Disease Prevention and Control; 2009.
O’Neill J. Tackling drug-resistant infections globally: final report and recommendations. Review of antimicrobial resistance. London: HM Government and Wellcome trust; 2016.
Sender R, Fuchs S, Milo R. Revised estimates for the number of human and bacteria cells in the body. PLoS Biol. 2016;14(8):e1002533.
Colijn C, Cohen T, Ganesh A, Murray M. Spontaneous emergence of multiple drug resistance in tuberculosis before and during therapy. PLoS One. 2011;6(3):e18327.
Martinez JL, Baquero F. Mutation frequencies and antibiotic resistance. Antimicrob Agents Chemother. 2000;44(7):1771–7.
Wang G, Wilson TJ, Jiang Q, Taylor DE. Spontaneous mutations that confer antibiotic resistance in Helicobacter pylori. Antimicrob Agents Chemother. 2001;45(3):727–33.
Malhotra-Kumar S, Van Heirstraeten L, Coenen S, et al. Impact of amoxicillin therapy on resistance selection in patients with community-acquired lower respiratory tract infections: a randomized, placebo-controlled study. J Antimicrob Chemother. 2016;71(11):3258–67.
Malhotra-Kumar S, Lammens C, Coenen S, Van Herck K, Goossens H. Effect of azithromycin and clarithromycin therapy on pharyngeal carriage of macrolide-resistant streptococci in healthy volunteers: a randomised, double-blind, placebo-controlled study. Lancet. 2007;369(9560):482–90.
Costelloe C, Metcalfe C, Lovering A, Mant D, Hay AD. Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis. BMJ. 2010;340:c2096.
World Health Organization. Global action plan on antimicrobial resistance, 2015.
Dolk FCK, Pouwels KB, Smith DRM, Robotham JV, Smieszek T. Antibiotics in primary care in England: which antibiotics are prescribed and for which conditions? J Antimicrob Chemother. 2018;73(suppl_2):ii2–ii10.
Lee GC, Reveles KR, Attridge RT, et al. Outpatient antibiotic prescribing in the United States: 2000 to 2010. BMC Med. 2014;12(1):96.
Mazzei T, Mini E, Novelli A, Periti P. Chemistry and mode of action of macrolides. J Antimicrob Chemother. 1993;31(suppl_C):1–9.
Musher DM, Thorner AR. Community-acquired pneumonia. N Engl J Med. 2014;371(17):1619–28.
Musicha P, Cornick JE, Bar-Zeev N, et al. Trends in antimicrobial resistance in bloodstream infection isolates at a large urban hospital in Malawi (1998–2016): a surveillance study. Lancet Infect Dis. 2017;17(10):1042–52.
Everett DB, Mukaka M, Denis B, et al. Ten years of surveillance for invasive Streptococcus pneumoniae during the era of antiretroviral scale-up and cotrimoxazole prophylaxis in Malawi. PLoS One. 2011;6(3):e17765.
Gordon SB, Chaponda M, Walsh AL, et al. Pneumococcal disease in HIV-infected Malawian adults: acute mortality and long-term survival. AIDS. 2002;16(10):1409–17.
Murray PR, Baron EJ, Pfaller MA, Tenover FC, Yolken RH. Manual of Clinical Microbiology In: Woods GL, Washington JA (eds). Antimicrobial Agents and Susceptibility Testing. Am. Soc. Microbiol. Washington, DC.. 1995.
Organization WH. Manual for the national surveillance of antimicrobial resistance of S. pneumoniae and H. influenzae: epidemiological and microbiological methods. Geneva and Atlanta: WHO, CDC; 1994.
Driscoll AJ, Karron RA, Morpeth SC, et al. Standardization of laboratory methods for the PERCH study. Clin Infect Dis. 2017;64(suppl_3):S245–S52.
Jochems SP, Weiser JN, Malley R, Ferreira DM. The immunological mechanisms that control pneumococcal carriage. PLoS Pathog. 2017;13(12):e1006665.
Goldblatt D, Hussain M, Andrews N, et al. Antibody responses to nasopharyngeal carriage of Streptococcus pneumoniae in adults: a longitudinal household study. J Infect Dis. 2005;192(3):387–93.
Skalet AH, Cevallos V, Ayele B, et al. Antibiotic selection pressure and macrolide resistance in nasopharyngeal Streptococcus pneumoniae: a cluster-randomized clinical trial. PLoS Med. 2010;7(12):e1000377.
Schroeder MR, Stephens DS. Macrolide resistance in Streptococcus pneumoniae. Front Cell Infect Microbiol. 2016;6:98.
Higgins J, Savović J, Page M, Sterne J. Revised Cochrane risk of bias tool for randomized trials (RoB 2.0): additional considerations for cluster-randomized trials. ROB2 Development Group; 2018.
Chaimani A, Higgins JP, Mavridis D, Spyridonos P, Salanti G. Graphical tools for network meta-analysis in STATA. PLoS One. 2013;8(10):e76654.
Furukawa TA, Miura T, Chaimani A, et al. Using the contribution matrix to evaluate complex study limitations in a network meta-analysis: a case study of bipolar maintenance pharmacotherapy review. BMC Res Notes. 2016;9(1):218.
Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011;64(2):163–71.
Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol. 1997;50(6):683–91.
Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010;29(7–8):932–44.
Higgins JP, Jackson D, Barrett JK, Lu G, Ades AE, White IR. Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies. Res Synth Methods. 2012;3(2):98–110.
Jackson D, Barrett JK, Rice S, White IR, Higgins JP. A design-by-treatment interaction model for network meta-analysis with random inconsistency effects. Stat Med. 2014;33(21):3639–54.
Veroniki AA, Mavridis D, Higgins JPT, Salanti G. Characteristics of a loop of evidence that affect detection and estimation of inconsistency: a simulation study. BMC Med Res Methodol. 2014;14(1):106.
Lunn D, Spiegelhalter D, Thomas A, Best N. The BUGS project: evolution, critique and future directions. Stat Med. 2009;28(25):3049–67.
Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences. Stat Sci. 1992;7(4):457–72.
Brooks SP, Gelman A. General methods for monitoring convergence of iterative simulations. J Comput Graph Stat. 1998;7(4):434–55.
White IR, Barrett JK, Jackson D, Higgins JP. Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression. Res Synth Methods. 2012;3(2):111–25.
Puhan MA, Schünemann HJ, Murad MH, et al. A GRADE working group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ. 2014;349:g5630.
Guyatt G, Oxman AD, Akl EA, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.
Hutton B, Salanti G, Caldwell DM, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777–84.
We would like to thank the staff of the library at LSHTM for their support, especially during the development of the search strategy.
THD is funded by the Commonwealth Scholarship Commission and the Helse Nord RHF. This review is part of his PhD work at LSHTM. ELC is funded by a Wellcome Trust Senior Research Fellowship in Clinical Science: WT200901. HRS is supported by the Medical Research Council [MR/R008345/1].These funding agencies had no role in the preparation of this manuscript, nor will they take part in the systematic review process or its publication.
Ethics approval and consent to participate
This work will not involve direct contact with human subjects or participant identifiable data. Ethical approval is therefore not required for this study.
Consent for publication
All authors have given consent and approval for the manuscript to be submitted for publication.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Data extraction form. The draft form includes the risk of bias assessment tool and documents the data which will be extracted from included studies. (DOCX 26 kb)
About this article
- Antimicrobial resistance
- Network meta-analysis
- Streptococcus pneumoniae
- Treatment duration
- Treatment failure
- Disease recurrence
- Resistance mechanisms