- Open Access
- Open Peer Review
Effect of the duration of antimicrobial exposure on the development of antimicrobial resistance (AMR) for macrolide antibiotics: protocol for a systematic review with a network meta-analysis
© The Author(s). 2018
- Received: 22 February 2018
- Accepted: 13 December 2018
- Published: 23 December 2018
Antimicrobial resistance generates a huge health and economic burden and has the potential to become the leading cause of death globally, but its underlying drivers are yet to be fully described. The association between a microbe’s exposure to antimicrobials and subsequent development of, or selection for, resistance is well documented, as are the exacerbating microbial and human factors. However, the nature and extent of this risk, and how it varies by antimicrobial class and duration of treatment, is poorly defined. The goal of our systematic review and network meta-analysis is to determine the relationship between the duration of antimicrobial exposure and selection for resistance. We will use macrolides as the antimicrobial class of interest and Streptococcus pneumoniae carriage as an indicator organism. Our secondary outcomes include duration of symptoms, risk of treatment failure and recurrence, and descriptions of resistance mechanisms.
We will conduct a systematic review, selecting studies if they are published randomised controlled trials (RCTs) which report the relationship between taking a macrolide for any indication and incidence of resistant Streptococcus pneumoniae in patients of any age group. We will use a predefined search strategy to identify studies meeting these eligibility criteria in MEDLINE, Embase, Global Health and the Cochrane Central Register of RCTs. Two authors will independently screen titles and abstracts, review the full texts and undertake data extraction. We will use the Cochrane Collaboration’s tool to assess the quality of included RCTs. If feasible, we will perform pair-wise meta-analysis modelling to determine the relationship between the duration of macrolide treatment and development of macrolide resistant Streptococcus pneumoniae. If the identified studies meet the assumptions for a network meta-analysis (NMA), we will additionally model this relationship using indirect comparisons. Our protocol utilises reporting guidance by Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and the extensions for protocols (PRISMA-P) and network meta-analyses (PRISMA for NMA). Our review will also report to these standards.
Establishing the relationship between the duration of antimicrobial exposure and development of, or selection for, resistance will inform the design of antimicrobial prescriptions, treatment guidelines and the behaviour of both physicians and patients. This work will therefore be a strong contribution towards the full realisation of current antimicrobial resistance stewardship strategies.
Systematic review registration
- Antimicrobial resistance
- Network meta-analysis
- Streptococcus pneumoniae
- Treatment duration
- Treatment failure
- Disease recurrence
- Resistance mechanisms
Antimicrobials—organic or synthetic molecules with cytotoxic or cytostatic abilities against microbes—are one of the greatest medical discoveries . Unfortunately, their usefulness is limited by the inherent genetic capacity of microbes to rapidly develop, transfer and acquire resistance-causing mutations [2, 3]. Unnecessary prescription in medical settings, as well as extensive agricultural use, contributes substantially to overall antibiotic drug pressure globally [4–6]. The current era is characterised by sharply declining investment from the pharmaceutical industry in the development of effective new antimicrobials; far fewer new compounds are developed annually now than during the 1990s .
In 2016, antimicrobial resistance became one of only four health topics ever to be discussed at the United Nations General Assembly , reflecting its huge health and economic burden [9, 10]. Drug resistance is projected to become the leading cause of death by 2050 .
The development of antimicrobial resistance is, to some extent, inevitable. Billions of doses of antibiotics are taken globally each year. Each human hosts a microbiome of approximately 3.8 × 1013 bacteria , and there is spontaneous (i.e. unselected) drug-resistance within this microbiome at a frequency as high as 10−4 mutations, depending upon the type of antimicrobial [13–15]. Under drug pressure, resistance can then be amplified and transmitted through a variety of mechanisms . Despite these risks, use of single-drug regimens remains standard practice for many conditions, because they are often sufficient to cure the patient and they reduce immediate costs and adverse events.
There is unambiguous evidence that the development of, or selection for, resistance occurs following antimicrobial exposure [4, 16–18]. The duration of treatment that is necessary for the development of, or selection for, resistance is poorly defined, however. This may differ by the resistance mechanism; for example, the unmasking of any resistant organisms generated during previous treatment periods may rapidly occur following a brief exposure to antimicrobials, while de novo generation may require longer durations. Better quantification of this relationship will inform prescription design, guidelines and behaviour, all of which are key factors in effective antimicrobial resistance control strategies .
To explore this relationship and derive high-quality evidence, it is necessary to choose an antimicrobial or class of antimicrobials with which patients are treated, an indicator organism in which drug resistance develops and a uniform method for assessing resistance. Macrolides are one of the most prescribed antimicrobials in clinical practice [20, 21], which act by inhibiting bacterial protein synthesis . Streptococcus pneumoniae, a major aetiology of clinical illness [23–26], also harmlessly colonises the upper respiratory tract, creating a window for the assessment of circulating serotypes and resistance patterns. Streptococcus pneumoniae is also a popular indicator bacteria in randomised controlled trials (RCTs) as globally accepted laboratory procedures for its detection exist [27–29] and colonisation is more common than invasive pneumococcal disease [30–32]. The existence of internationally accepted laboratory standards presents opportunities for between-study comparisons.
Our aim, therefore, is to conduct a systematic review using data from published RCTs to determine the relationship between the duration of antimicrobial exposure and the development of, or selection for, resistance using carriage of Streptococcus pneumoniae as an indicator organism. We will evaluate studies involving healthy individuals or patients with any illness treated with macrolide antimicrobials in whom the development of, or selection for, antimicrobial resistance was assessed using Streptococcus pneumoniae carriage. We have opted to use network meta-analysis (NMA) as the preferred evidence synthesis method because RCTs with head-to-head comparisons of different durations of macrolides will likely be too rare for a meaningful pair-wise meta-analyses. NMAs allow the use of both direct and indirect evidence and are hence the most efficient method for making inferences.
Our primary objective is to determine whether the risk of developing macrolide resistance increases with the duration of macrolide exposure using upper respiratory tract carriage of Streptococcus pneumoniae as indicator organism. Our secondary objectives include exploring the association between the duration of macrolide treatment and (1) symptom duration, (2) treatment failure and (3) disease recurrence.
Protocol and registration
The protocol for this planned systematic review is registered with the International Prospective Register of Systematic Reviews (PROSPERO), CRD42018089275.
Population: healthy individuals or patients of any illness or age, treated with macrolide antimicrobials. We will record participant characteristics, including age, sex and the indication for treatment.
Interventions: Any macrolide antimicrobial being given as monotherapy, via any route, for respiratory infections. We are interested in the impact of macrolide treatment on antimicrobial resistance in Streptococcus pneumoniae carriage. We will record the specific macrolide, dose and duration reported in each study. Registered macrolides include azithromycin, clarithromycin, erythromycin, fidaxomicin, telithromycin, carbomycin a, josamycin, kitasamycin, midecamycin, midecamycin acetate, oleandomycin, solithromycin, spiramycin, troleandomycin, tylosin, tylocine and roxithromycin.
Comparators: Other macrolides, other antimicrobials, placebo, or no treatment. Macrolides are commonly used for respiratory tract infections, and amoxicillin and doxycycline are expected to be the most frequent non-macrolide comparators.
Outcomes: The primary outcome will be the incidence/risk of macrolide resistance in Streptococcus pneumoniae carriage among individuals in whom this did not exist before commencing macrolide treatment. Macrolide resistance in Streptococcus pneumoniae results from either ribosomal dimethylation by an enzyme encoded by erm(B), efflux by a two-component efflux pump encoded by mef (E)/mel(msr(D)), or mutations of the ribosomal target site of macrolides . We will include studies that utilised any established laboratory method to demonstrate evidence of macrolide resistance.
Study design: RCTs. Restricting to RCTs will minimise confounding.
Language and time limitations: We will include studies published in any language and on any date. For articles in languages other than English that are eligible for full-text review, we will seek assistance from a native speaker who has been trained in data extraction using an article published in English.
Anticipated network geometry
Information sources and search strategy
We will search for studies that meet the eligibility criteria in MEDLINE, Embase, Global Health, Web of Science and Cochrane Central Register of Controlled Trials (CENTRAL: The Cochrane Library). MEDLINE, Embase and Global Health will be searched using the Ovid platform. Papers will not be excluded on the basis of the language of publication and time frame in which they were published. We will only include data from peer-reviewed papers in order to ensure scientific quality.
Search strategy for MEDLINE using Ovid platform
drug resista* or exp drug resistance, microbial/
1 or 2 or 3
(Azithromycin or Clarithromycin or Erythromycin or Fidaxomicin or Telithromycin or Carbomycin A or Josamycin or Kitasamycin or Midecamycin or midecamycin acetate or Oleandomycin or Solithromycin or Spiramycin or Troleandomycin or Tylosin or tylocine or Roxithromycin).ti,ab.
5 or 6
Antimicrobial resistance studies that use macrolides (any design)
4 and 7
MEDLINE filter for clinical trials
randomised controlled trial.pt.
controlled clinical trial.pt.
9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17
exp animals/ not humans.sh.
19 not 18
Antimicrobial resistance studies that use macrolides in clinical trials
8 and 20
Investigator THD will implement the search strategy, and then investigators THD and MN will screen the titles and abstracts of resulting papers against the eligibility criteria. THD and MN will independently assess the full texts of the included papers for eligibility using the above criteria. The main reason for non-inclusion at the full-text stage will be documented. Investigator KF will resolve any disagreements.
Publication information will be exported from Endnote into a standardised extraction form in Microsoft Excel Data will be extracted into (Additional file 1). This form is currently in draft format; it will be finalised among the study team once it has been trialled by two people extracting the same five papers. After finalisation of the form, two team members will extract the data independently. Discrepancies will initially be discussed and resolved between the two team members, with a third team member available to resolve disputes. Multiple publications arising from the same study will be combined. Where data gaps are present, the original study authors will be contacted. Once the extraction phase is complete, data will be exported into the analysis software.
Data for assessing methodological comparability of trials
Methods: study design, randomisation (individual or cluster), total duration of study, number of study centres and location, study setting, withdrawals and date of study.
Participants: age, number, setting, eligibility criteria and baseline antimicrobial resistance (AMR).
Interventions: indication of treatment, dose of both the macrolide and control interventions and duration of treatment.
Outcomes: authors’ primary and secondary outcomes, timing for assessing AMR in relation to the treatment administration schedule and participant adherence levels. We will attempt to extract outcome data per study arm, as opposed to summary effects.
Additional factors: trial sponsorship, trial funding and important conflicts of interest reported by the authors.
Data from cross-over and cluster randomised trials
The units of analysis in cross-over and cluster randomised trials (CRTs) need special considerations before meta-analysis is undertaken in order to address carry-over effects and clustering, respectively. For cross-over studies we will only extract data from the first period, while for CRTs, we will extract data that accounts for the clustering.
Risk of bias assessment
We will conduct a risk of bias assessment at the level of the study. We will use the revised Cochrane risk-of-bias tool for randomised trials (RoB 2.0), the recommended method for assessing experimental studies . The risk of bias assessment tool interrogates various aspects of selection and information bias. It involves assessing how the allocation sequence was generated, how it was concealed, if blinding was done, how outcomes were ascertained, the quality of follow up, and whether there was selective outcome reporting. The risk of bias assessment will be done independently by two reviewers and disagreements resolved by discussion or by third reviewer.
Guiding counterfactual model
While ideal, achieving all these factors in a real-life systematic review is unlikely. Our final statistical analysis plan will therefore be a calculated trade-off of these ideal conditions.
Study and network characteristics
Data will initially be analysed using descriptive statistics, including all the variables described above, in addition to reporting the comparisons performed in each study, indications for antimicrobial therapy, participant characteristics, study setting, and methodological approaches.
We will prepare a network diagram (similar to the hypothetical diagram shown in Fig. 1) in which the size of the nodes reflect the total number of patients randomised to each intervention, the thickness of edges is proportional to the number of direct comparisons, and the colour of each edge will represent the risk of bias. We will use a contribution matrix to understand and rank the influence of various comparisons in the network on the final summary data [35, 36].
Pair-wise and network meta-analysis
If sufficiently methodologically homogeneous studies are identified, we will perform pair-wise meta-analysis for the primary outcome using either fixed effects or random effects modelling approaches, depending on the extent of heterogeneity. We will assess the extent of heterogeneity using the Cochran Q2 and I2 statistics. We will convey the extent of heterogeneity visually using a forest plot.
Next, we will assess whether the identified studies meet the assumptions for a NMA. Apart from having reasonably homogeneous methodologies, the key assumption for ensuring validity of inferences drawn from indirect comparisons within a network is transitivity; the balance of the distributions of patient and study characteristics across studies. Initially, we will determine if this assumption is fulfilled by conducting a qualitative review of the RCT characteristics described earlier (‘Data extraction’ section).
For the subset of eligible studies in which the transitivity assumption holds, we will assume that each of their patients were equally likely to be randomised to any of the antimicrobial agents and treatment durations being investigated, thus establishing the basis for the indirect comparisons. Fixed and random effects NMAs will then be used to synthesise all the evidence for the primary outcome and to rank included treatments. To identify the appropriate model between fixed and random effects NMAs for our data, we will use the deviance information criteria (DIC) to assess their goodness-of-fit. The summary effect measures for all pairwise comparisons will be presented in a league table. We will rank the risk of AMR with various treatments using the surface under the cumulative ranking curve (SUCRA) and mean ranks .
Consistency within the network—the agreement between direct and indirect evidence—will be assessed within each loop of evidence using loop-specific approach  and by employing a global method for evaluating the whole network . We will also estimate the I2 for network heterogeneity and inconsistency [40, 41], but we will exercise caution when interpreting the results, considering the well-established limitations in power . We will use funnel plot to assess for publication bias.
We will perform subgroup, meta-regression and sensitivity NMA analyses. The subgroup analyses will involve running the NMA model stratified by study-level characteristics, i.e. (1) the age groups of participants, (2) country in which the study was conducted, (3) treatment indications, (4) macrolide type and (5) publication calendar period. The meta-regression will include the study-level covariates described earlier (‘Data for assessing methodological comparability of trials’ section), in order to reduce heterogeneity. We will initially add the covariates to the NMA individually, retaining those that have a meaningful impact on the DIC and considering combinations of factors after the initial individual-level assessment. Should we identify additional relevant characteristics during data extraction or analysis for both the subgroup analyses and meta-regression, we will identify such analysis (in our publication) as post hoc. In sensitivity analyses, we will perform the NMA with and without studies that have high risk of bias.
We will perform our analyses and report treatment effects on both relative and absolute difference scales, stating odds ratios (ORs), risk differences (RDs) and respective 95% credible intervals (95%CrI) for all comparisons. We will model using OpenBUGS  and Stata release 15 (StataCorp, College Station, TX, USA). We will use binomial likelihoods with uninformative prior distributions for our Bayesian modelling. The Brooks-Gelman-Rubin diagnostic will be utilised to assess for model convergence [44, 45]. We will primarily use the mvmeta command  in Stata to assess inconsistency and to produce network graphs.
Credibility of the evidence
The credibility of the evidence will be evaluated with respect to its limitations, indirectness, inconsistency, imprecision and publication bias using the approach recommended by the Grade of Recommendation, Assessment, Development and Evaluation (GRADE) system [47, 48].
Dissemination of results
We will present the results of our analyses in a peer-reviewed manuscript using the reporting guidance by the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA)  and the PRISMA Network Meta-Analysis extension statement . This work will also form part of a PhD thesis for THD, which he will submit to the LSHTM.
Our systematic review will use published RCTs of macrolide antimicrobials to establish the relationship between the duration of antimicrobial exposure and the development of, or selection for, resistance using upper respiratory tract carriage of Streptococcus pneumoniae, isolated from patients with respiratory symptoms, as indicator organism. This will inform the design of antimicrobial prescriptions, treatment guidelines and the behaviour of both physicians and patients. This work therefore will therefore be an important contribution towards the realisation of current antimicrobial resistance control strategies .
Where possible, through our secondary objectives, we will attempt to describe the clinical outcomes associated with different macrolide durations. Our results on these outcomes will form the basis for future, detailed, research.
The strengths of our review include publication of the full protocol with PROSPERO and in this peer-reviewed article, with detailed methodology laid out a priori. The internal validity of our review is safeguarded by our restriction of the study type to RCTs. The quality and transparency of our work are ensured by our adherence to both PRISMA and PRISMA NMA guidelines.
The conclusions of our NMA will be weakened if direct comparisons are rare, leading to an overreliance on indirect comparisons. Heterogeneity may be introduced by our broad participant population (all ages, any indication of treatment), global coverage (any setting) and unlimited study period. We will seek to limit this by adding study-level covariates to the NMA model, if required.
To our knowledge, our review and NMA will be the first attempt to systematically examine the association between the duration of exposure to macrolide antimicrobials and subsequent development of, or selection for, resistant Streptococcus pneumonia carriage. Therefore, our review will not only provide direction for AMR stewardship policies, but also guide future AMR research.
We would like to thank the staff of the library at LSHTM for their support, especially during the development of the search strategy.
THD is funded by the Commonwealth Scholarship Commission and the Helse Nord RHF. This review is part of his PhD work at LSHTM. ELC is funded by a Wellcome Trust Senior Research Fellowship in Clinical Science: WT200901. HRS is supported by the Medical Research Council [MR/R008345/1].These funding agencies had no role in the preparation of this manuscript, nor will they take part in the systematic review process or its publication.
All authors substantially contributed to the conception and design of the study and reviewed all documents and materials. THD developed the first draft of the protocol and manuscript, the search strategy and data extraction forms and performed the final review of the manuscript. ELC critically reviewed the protocol and the manuscript and contributed towards development of the search strategy and data extraction forms. HRS contributed to the overall study design and the NMA methodological design and critically reviewed the final protocol and manuscript. MN and DS contributed to the study concept and reviewed the manuscript. NF contributed the scientific concept and reviewed the final manuscript. KF contributed to the conception, study design, search strategy and methodological design and critically reviewed the final protocol and manuscript. TD is the guarantor for this work. All authors read and approved the final manuscript.
Ethics approval and consent to participate
This work will not involve direct contact with human subjects or participant identifiable data. Ethical approval is therefore not required for this study.
Consent for publication
All authors have given consent and approval for the manuscript to be submitted for publication.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Zaman SB, Hussain MA, Nye R, Mehta V, Mamun KT, Hossain N. A review on antibiotic resistance: alarm bells are ringing. Cureus. 2017;9(6):e1403.PubMedPubMed CentralGoogle Scholar
- Holmes AH, Moore LS, Sundsfjord A, et al. Understanding the mechanisms and drivers of antimicrobial resistance. Lancet. 2016;387(10014):176–87.PubMedView ArticleGoogle Scholar
- World Health Organization. Antimicrobial resistance: global report on surveillance: World Health Organization; 2014.Google Scholar
- Goossens H, Ferech M, Vander Stichele R, Elseviers M, Group EP. Outpatient antibiotic use in Europe and association with resistance: a cross-national database study. Lancet. 2005;365(9459):579–87.PubMedView ArticleGoogle Scholar
- Ventola CL. The antibiotic resistance crisis: part 1: causes and threats. P T. 2015;40(4):277–83.PubMedPubMed CentralGoogle Scholar
- Salmond GPC, Welch M. Antibiotic resistance: adaptive evolution. Lancet. 2008;372:S97–S103.View ArticleGoogle Scholar
- Brown ED, Wright GD. Antibacterial drug discovery in the resistance era. Nature. 2016;529(7586):336–43.PubMedView ArticleGoogle Scholar
- United Nations General Assembly. Draft political declaration of the high-level meeting of the United Nations General Assembly on antimicrobial resistance. New York: United Nations; 2016.Google Scholar
- Control CfD, Prevention. Office of Infectious Disease. Antibiotic resistance threats in the United States, 2013. 2013. 2015.Google Scholar
- ECDC E. The bacterial challenge: time to react. Stockholm: European Center for Disease Prevention and Control; 2009.Google Scholar
- O’Neill J. Tackling drug-resistant infections globally: final report and recommendations. Review of antimicrobial resistance. London: HM Government and Wellcome trust; 2016.Google Scholar
- Sender R, Fuchs S, Milo R. Revised estimates for the number of human and bacteria cells in the body. PLoS Biol. 2016;14(8):e1002533.PubMedPubMed CentralView ArticleGoogle Scholar
- Colijn C, Cohen T, Ganesh A, Murray M. Spontaneous emergence of multiple drug resistance in tuberculosis before and during therapy. PLoS One. 2011;6(3):e18327.PubMedPubMed CentralView ArticleGoogle Scholar
- Martinez JL, Baquero F. Mutation frequencies and antibiotic resistance. Antimicrob Agents Chemother. 2000;44(7):1771–7.PubMedPubMed CentralView ArticleGoogle Scholar
- Wang G, Wilson TJ, Jiang Q, Taylor DE. Spontaneous mutations that confer antibiotic resistance in Helicobacter pylori. Antimicrob Agents Chemother. 2001;45(3):727–33.PubMedPubMed CentralView ArticleGoogle Scholar
- Malhotra-Kumar S, Van Heirstraeten L, Coenen S, et al. Impact of amoxicillin therapy on resistance selection in patients with community-acquired lower respiratory tract infections: a randomized, placebo-controlled study. J Antimicrob Chemother. 2016;71(11):3258–67.PubMedView ArticleGoogle Scholar
- Malhotra-Kumar S, Lammens C, Coenen S, Van Herck K, Goossens H. Effect of azithromycin and clarithromycin therapy on pharyngeal carriage of macrolide-resistant streptococci in healthy volunteers: a randomised, double-blind, placebo-controlled study. Lancet. 2007;369(9560):482–90.PubMedView ArticleGoogle Scholar
- Costelloe C, Metcalfe C, Lovering A, Mant D, Hay AD. Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis. BMJ. 2010;340:c2096.PubMedView ArticleGoogle Scholar
- World Health Organization. Global action plan on antimicrobial resistance, 2015.Google Scholar
- Dolk FCK, Pouwels KB, Smith DRM, Robotham JV, Smieszek T. Antibiotics in primary care in England: which antibiotics are prescribed and for which conditions? J Antimicrob Chemother. 2018;73(suppl_2):ii2–ii10.PubMedView ArticleGoogle Scholar
- Lee GC, Reveles KR, Attridge RT, et al. Outpatient antibiotic prescribing in the United States: 2000 to 2010. BMC Med. 2014;12(1):96.PubMedPubMed CentralView ArticleGoogle Scholar
- Mazzei T, Mini E, Novelli A, Periti P. Chemistry and mode of action of macrolides. J Antimicrob Chemother. 1993;31(suppl_C):1–9.PubMedView ArticleGoogle Scholar
- Musher DM, Thorner AR. Community-acquired pneumonia. N Engl J Med. 2014;371(17):1619–28.PubMedView ArticleGoogle Scholar
- Musicha P, Cornick JE, Bar-Zeev N, et al. Trends in antimicrobial resistance in bloodstream infection isolates at a large urban hospital in Malawi (1998–2016): a surveillance study. Lancet Infect Dis. 2017;17(10):1042–52.PubMedPubMed CentralView ArticleGoogle Scholar
- Everett DB, Mukaka M, Denis B, et al. Ten years of surveillance for invasive Streptococcus pneumoniae during the era of antiretroviral scale-up and cotrimoxazole prophylaxis in Malawi. PLoS One. 2011;6(3):e17765.PubMedPubMed CentralView ArticleGoogle Scholar
- Gordon SB, Chaponda M, Walsh AL, et al. Pneumococcal disease in HIV-infected Malawian adults: acute mortality and long-term survival. AIDS. 2002;16(10):1409–17.PubMedPubMed CentralView ArticleGoogle Scholar
- Murray PR, Baron EJ, Pfaller MA, Tenover FC, Yolken RH. Manual of Clinical Microbiology In: Woods GL, Washington JA (eds). Antimicrobial Agents and Susceptibility Testing. Am. Soc. Microbiol. Washington, DC.. 1995.Google Scholar
- Organization WH. Manual for the national surveillance of antimicrobial resistance of S. pneumoniae and H. influenzae: epidemiological and microbiological methods. Geneva and Atlanta: WHO, CDC; 1994.Google Scholar
- Driscoll AJ, Karron RA, Morpeth SC, et al. Standardization of laboratory methods for the PERCH study. Clin Infect Dis. 2017;64(suppl_3):S245–S52.PubMedPubMed CentralView ArticleGoogle Scholar
- Jochems SP, Weiser JN, Malley R, Ferreira DM. The immunological mechanisms that control pneumococcal carriage. PLoS Pathog. 2017;13(12):e1006665.PubMedPubMed CentralView ArticleGoogle Scholar
- Goldblatt D, Hussain M, Andrews N, et al. Antibody responses to nasopharyngeal carriage of Streptococcus pneumoniae in adults: a longitudinal household study. J Infect Dis. 2005;192(3):387–93.PubMedView ArticleGoogle Scholar
- Skalet AH, Cevallos V, Ayele B, et al. Antibiotic selection pressure and macrolide resistance in nasopharyngeal Streptococcus pneumoniae: a cluster-randomized clinical trial. PLoS Med. 2010;7(12):e1000377.PubMedPubMed CentralView ArticleGoogle Scholar
- Schroeder MR, Stephens DS. Macrolide resistance in Streptococcus pneumoniae. Front Cell Infect Microbiol. 2016;6:98.PubMedPubMed CentralView ArticleGoogle Scholar
- Higgins J, Savović J, Page M, Sterne J. Revised Cochrane risk of bias tool for randomized trials (RoB 2.0): additional considerations for cluster-randomized trials. ROB2 Development Group; 2018.Google Scholar
- Chaimani A, Higgins JP, Mavridis D, Spyridonos P, Salanti G. Graphical tools for network meta-analysis in STATA. PLoS One. 2013;8(10):e76654.PubMedPubMed CentralView ArticleGoogle Scholar
- Furukawa TA, Miura T, Chaimani A, et al. Using the contribution matrix to evaluate complex study limitations in a network meta-analysis: a case study of bipolar maintenance pharmacotherapy review. BMC Res Notes. 2016;9(1):218.PubMedPubMed CentralView ArticleGoogle Scholar
- Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011;64(2):163–71.PubMedView ArticleGoogle Scholar
- Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol. 1997;50(6):683–91.PubMedView ArticleGoogle Scholar
- Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010;29(7–8):932–44.PubMedView ArticleGoogle Scholar
- Higgins JP, Jackson D, Barrett JK, Lu G, Ades AE, White IR. Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies. Res Synth Methods. 2012;3(2):98–110.PubMedPubMed CentralView ArticleGoogle Scholar
- Jackson D, Barrett JK, Rice S, White IR, Higgins JP. A design-by-treatment interaction model for network meta-analysis with random inconsistency effects. Stat Med. 2014;33(21):3639–54.PubMedPubMed CentralView ArticleGoogle Scholar
- Veroniki AA, Mavridis D, Higgins JPT, Salanti G. Characteristics of a loop of evidence that affect detection and estimation of inconsistency: a simulation study. BMC Med Res Methodol. 2014;14(1):106.PubMedPubMed CentralView ArticleGoogle Scholar
- Lunn D, Spiegelhalter D, Thomas A, Best N. The BUGS project: evolution, critique and future directions. Stat Med. 2009;28(25):3049–67.PubMedView ArticleGoogle Scholar
- Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences. Stat Sci. 1992;7(4):457–72.View ArticleGoogle Scholar
- Brooks SP, Gelman A. General methods for monitoring convergence of iterative simulations. J Comput Graph Stat. 1998;7(4):434–55.Google Scholar
- White IR, Barrett JK, Jackson D, Higgins JP. Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression. Res Synth Methods. 2012;3(2):111–25.PubMedPubMed CentralView ArticleGoogle Scholar
- Puhan MA, Schünemann HJ, Murad MH, et al. A GRADE working group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ. 2014;349:g5630.PubMedView ArticleGoogle Scholar
- Guyatt G, Oxman AD, Akl EA, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.PubMedView ArticleGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.PubMedPubMed CentralView ArticleGoogle Scholar
- Hutton B, Salanti G, Caldwell DM, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777–84.PubMedView ArticleGoogle Scholar