- Open Access
- Open Peer Review
Comparative effectiveness of the different components of care provided in heart failure clinics—protocol for a systematic review and network meta-analysis
Systematic Reviewsvolume 8, Article number: 40 (2019)
Heart failure (HF) is a complex chronic condition, leading to frequent hospitalization, decreased quality of life, and increased mortality. Current guidelines recommend that multidisciplinary care be provided in specialized HF clinics. A number of studies have demonstrated the effectiveness of these clinics; however, there is a wide range in the services provided across different clinics. This network meta-analysis will aim to identify the aspects of HF clinic care that are associated with the best outcomes: a reduction in mortality, hospitalization, and visits to emergency department (ED) and improvements to quality of life.
Relevant electronic databases will be systematically searched to identify eligible studies. Controlled trials and observational cohort studies of adult (≥ 18 years of age) patients will be eligible for inclusion if they evaluate at least one component of guideline-based HF clinic care and report all-cause or HF-related mortality, hospitalizations, or ED visits or health-related quality of life assessed after a minimum follow-up of 30 days. Both controlled trials and observational studies will be included to allow us to compare the efficacy of the interventions in an ideal context versus their effectiveness in the real world. Two reviewers will independently perform both title and abstract full-text screenings and data abstraction. Study quality will be assessed through a modified Cochrane risk of bias tool for randomized controlled trials (RCTs) or the ROBINS-I tool for observational studies. The strength of evidence will be assessed using a modified Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) system. Network meta-analysis methods will be applied to synthesize the evidence across included studies. To contrast findings between study designs, data from RCTs will be analyzed separately from non-randomized controlled trials and cohort studies. We will estimate both the probability that a particular component of care is the most effective and treatment effects for specified combinations of care.
To our knowledge, this will be the first study to evaluate the comparative effectiveness of the different components of care offered in HF clinics. The findings from this systematic review will provide valuable insight about which components of HF clinic care are associated with improved outcomes, potentially informing clinical guidelines as well as the design of future care interventions in dedicated HF clinics.
Systematic review registration
Heart failure (HF) is a complex chronic condition associated with a high rate of comorbidity, significant impairment of quality of life, frequent hospitalization, progressive disability, and reduced survival [1,2,3]. Recent estimates suggest that HF affects one million Canadians, with at least 50,000 new patients diagnosed each year [1, 2]. HF patients have a shorter life expectancy than most cancer patients, with a median survival of 1.7 years for men and 3.2 years for women .
HF is also associated with an enormous economic burden. It is one of the most costly chronic conditions in developed countries , costing Canada an estimated $3 billion each year . The majority of these costs are attributable to hospitalization and other healthcare services, medications, and missed days of work . HF-related hospitalizations are one of the major drivers of avoidable admissions [5, 7,8,9]. Roughly 25% of patients who are hospitalized for HF are readmitted within 30 days of discharge . The costs of hospital admissions related to HF alone are currently estimated to be $482 million per year; this is projected to increase to $722 million by 2030 .
Current Canadian guidelines recommend that HF care be provided in multidisciplinary, specialized HF clinics . A number of studies have demonstrated the effectiveness of these clinics [13,14,15,16,17,18]; a systematic review and meta-analysis by Holland et al. reported significant reductions in all-cause hospital admissions, HF-related admissions, and all-cause mortality . A more recent study demonstrated a significant reduction in unplanned admissions among patients treated in HF specialist clinics . Although studies have demonstrated the effectiveness of HF clinic care, the optimal model for management of patients in these HF clinics is unknown [8, 19]. HF clinics are very heterogeneous in structure, population, and patient management [8, 20, 21]; this heterogeneity may considerably undermine their effectiveness . Recent studies have reported variability in the effectiveness of different models of care offered in HF clinics, emphasizing the gap in knowledge and practice regarding the optimal components of HF care [22,23,24].
The objective of this systematic review and network meta-analysis is to determine which components of care provided in HF clinics are the most effective in reducing mortality, emergency department visits, and hospitalizations and improving patient quality of life.
This systematic review will be designed based on the Cochrane review methods  and will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement . The protocol follows the Preferred Reporting Items for Systematic Review and Meta-analysis Protocols (PRISMA-P) and checklist (Additional file 1) [27, 28] and the PRISMA extension for network meta-analyses (PRISMA-NMA) . This protocol is registered with PROSPERO as CRD42017058003.
The population will consist of adult patients (18 years of age and older) who are receiving treatment for a diagnosis of HF. Studies with participants who were treated by a HF clinic prior to study enrollment will be excluded. Studies that included both eligible and ineligible participants will be excluded unless they report data for the subgroup of patients who are eligible for this study.
Studies must evaluate at least one component of multidisciplinary HF clinic care (or any combination of care components) with a defined intervention [18, 30,31,32]. Based on Canadian and US guidelines [31, 32], we anticipate including the following interventional components: education and counseling, medication management and optimization, social/peer support, clinical monitoring, referral for diagnostic testing, referral for devices (e.g., implantable cardioverter defibrillator [ICD], cardiac resynchronization therapy [CRT]), and referral for cardiac rehabilitation. This is not an exhaustive list of care components, so we will include others that have been studied in the literature.
Studies must include at least one comparator arm. Comparisons can be made between other care components or to standard care. Non-comparative studies reporting a single intervention or component of care will be excluded.
Studies will be included if they report on at least one of the following outcomes, assessed after a follow-up of 30 days or more: all-cause or HF-related mortality, all-cause or HF-related hospitalizations or emergency department visits, or health-related quality of life (HRQoL) using a validated measure or a composite end-point of any of these.
This systematic review will include both randomized and non-randomized controlled trials and observational cohort studies evaluating at least one component, or any combination, of multidisciplinary HF clinic care with a defined intervention [18, 30,31,32]. Including both controlled trials and observational studies will allow us to compare findings between these study designs, comparing the efficacy of the interventions in an ideal context versus the effectiveness in the real world.
Study designs other than controlled trials or observational cohort studies will be excluded, as will other types of publications, including letters, commentaries, and editorials. Previous systematic reviews will be used to identify relevant studies. Studies that use duplicate study populations will be reviewed to ensure that they provide different information; otherwise, only the most recent study will be included.
Restrictions on the type of setting will not be imposed.
Both English and non-English language articles will be considered. Non-English articles will be translated into English for the purpose of inclusion in the systematic review.
Eligible studies will be identified through a systematic, comprehensive search of the following databases: MEDLINE and MEDLINE In-Process (Ovid), EMBASE (Ovid), CINHAL (Ebsco), Cochrane Database of Systematic Reviews (CDSR), DARE (Database of Abstracts of Reviews of Effectiveness), LILACS, International Clinical Trials Registry Platform (ICTRP), Science Citation Index Expanded (SCI-EXPANDED; Web of Science), PsycINFO, and Conference Proceedings Citation Index-Science (CPCI-S; Web of Science), as well as ProQuest Dissertations and Theses Global. HF disease management programs were launched in the 1990s; as such, a database search from 1990 onward is considered sufficient. The PROSPERO registry will also be searched for all active or completed systematic reviews. Electronic database searches will be supplemented with inspection of reference lists of relevant articles and hand searching of pertinent journals.
The search strategy will be designed and conducted by an information specialist experienced in systematic reviews, following the Cochrane systematic review methodology . It will include MeSH and natural language terms in the following concept areas: heart failure and eligible interventions. No language restrictions will be applied. The search will be updated closer to the end of our review to ensure that the most recent eligible articles are captured. A detailed preliminary search strategy for MEDLINE (Ovid) is provided in Additional file 2. The final Medline strategy will be translated into syntax appropriate for each database used in the search.
The results of the literature search will be collected in an EndNote library, where duplicate studies will be flagged and removed. Each reviewer will receive a copy of the library for the stepwise review process. A coding scheme will be developed and used within the EndNote software to indicate eligibility status at each stage of the screening process (i.e., title/abstract, full-text screening).
Study selection and screening process
A stepwise review process will be utilized . Using a study eligibility form (Additional file 3) based on the Data Collection Form for Cochrane Reviews , two reviewers will independently screen in duplicate the titles and abstracts of studies identified by the search strategy. All studies deemed eligible by either reviewer will be selected for full-text review. The same reviewers will then screen the full article text and apply the eligibility criteria stated above. During the full-text screening phase, both reviewers will record the reason for exclusion in a standardized data abstraction document based on the Data Collection Form for Cochrane Reviews . Disagreements during this screening phase will be resolved through discussion with a senior author. For each stage of the review process, agreement will be measured through a weighted kappa statistic.
The eligibility criteria will be pilot tested on a sample of citations at both stages of screening. This will ensure that both reviewers understand the eligibility criteria and allow for refinement if needed. These sets of citations will not be included in the calculation of overall agreement at the end of full-text screening.
A standardized data abstraction document will be developed based on the Data Collection Form for Cochrane Reviews . Two independent reviewers will extract data for each included study. Any discrepancies will be resolved through discussion with the reviewers and a senior author. If necessary, corresponding authors of the eligible studies will be contacted. Where possible, data will be extracted for the intent-to-treat analyses.
All abstracted data will be collected and organized into a MS Excel spreadsheet.
For each included study, information related to the study characteristics, patient population, and outcomes of HF care assessed will be extracted. Study characteristics will include study design, component(s) of care assessed in the comparison groups, length of follow-up, setting (i.e., hospital, home, community), sample size, year of study conduct, year of publication, and country of origin. Data regarding the patient population will include age, gender, and severity of HF. In addition, the following outcomes will be extracted where applicable: all-cause and HF-related mortality, all-cause and HF-related hospitalizations, all-cause and HF-related emergency department visits, and health-related quality of life.
Risk of bias and quality assessment
We will use the modified Cochrane risk of bias tool  to assess the risk of bias in each included randomized controlled trial (RCT) in the following domains: random sequence generation, allocation concealment, blinding of outcome assessment, incomplete outcome data, and selective reporting. The Cochrane tool includes a domain to assess blinding of patients or participants; however, for the purpose of this study, this domain is not relevant due to the procedural nature of the intervention(s). Through the Cochrane bias tool, each reviewer assigns a judgment of “high,” “low,” or “unclear” risk for each domain item.
The Risk Of Bias In Non-randomized Studies of Interventions (ROBINS-I) tool will be used to assess bias in each included non-randomized controlled trial or observational study  in the following domains: confounding; participant selection; intervention classification; deviations from intended intervention; missing data, including loss to follow-up or missing data on intervention status or other important variables; outcome measurement; and selection of reported results. Risk of bias for each domain is categorized as “low,” “moderate,” “serious,” or “critical.”
Two reviewers will independently assess bias for each included study using the appropriate tool. Any disagreements will be resolved by discussion with a senior author.
Strength of the evidence assessment
Two reviewers will independently assess the quality of evidence using the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) system  for each included study. We will take into account the risk of bias at the study level, inconsistency, imprecision, indirectness, publication bias, gradient response, large effect, and bias against a significant association [37,38,39,40,41,42]. Confidence will be rated as high, moderate, low, or very low , and disagreements will be resolved by discussion with a senior author. Funnel plots will be used to assess publication bias [44, 45].
Synthesis of results
The data extracted from the included RCTs will be analyzed separately from the non-randomized controlled trials and cohort studies using network meta-analytic (NMA) techniques to allow us to contrast findings between these study designs, comparing their effectiveness in an ideal context versus in a pragmatic, real-world setting.
In an approach similar to previous work evaluating the effectiveness of different components of psychological care for coronary heart disease , four increasingly complex models of the effects of the core components of HF clinic care will be fit for each outcome:
Single-effect model. All HF clinic care components will be grouped together as a single treatment, estimating the overall effect of HF clinic care. This is similar to traditional meta-analytic methods that compare HF clinic care to standard care.
Additive main effects model. This assumes a separate treatment effect for each of the HF clinic care components. The effect of having two or more components is additive. Each arm of each trial will be coded based on the presence or absences of the particular care component. This decomposes the effect in any given arm into the sum of effects of the components present in that arm.
Two-way interaction model. This is an extension of the main effects model that allows for synergistic or antagonistic effects of combinations of each pair of the components of HF clinic care. For example, the effect of component X (e.g., education and counseling) and Y (e.g., clinical monitoring) is not simply the effect of X + Y but could be larger or smaller.
Full interaction model. This model assumes that each possible combination of the core components has a distinct effect that cannot be computed from their individual effects or the sums of the two-way interactions. In practice, this model assumes that each different combination of HF clinic care components is a different intervention.
We will choose the simplest model that is consistent with the data and choose between models using the deviance information criterion (DIC). The hazard ratio (HR) and its 95% credible interval (CrI) for each core HF clinic component will be estimated for the mortality, hospitalizations, and emergency department visits outcomes using Markov chain Monte Carlo (MCMC) simulations implemented in JAGS software run through R . For health- related quality of life outcomes, we will estimate the median difference and its 95% CrI. We will run three parallel MCMC chains with a sufficiently large number of iterations and ensure convergence using Gelman-Rubin diagnostic trace plots. Heterogeneity and model fit of the NMA will be assessed through standard approaches [48, 49]. Posterior predictive checks will also be used to identify outlying observations (arms or trials)  in the models examining core components. This simulation framework will allow for the presentation of key data summaries of clinical and policy interest, such as the probability that a particular component of care is the most effective for each outcome and the estimated treatment effects for any specified combination of care components.
As we hypothesize that the effectiveness of HF clinic care may differ across a variety of factors, we will explore any potential causes of heterogeneity through the following subgroup analyses, conditional upon data availability: gender, follow-up period, HF severity, method of enrollment and referral (i.e., self-report, systematic referral, or other processes), setting, and number of sites. In addition, as the intensity of care components may vary between studies (i.e., providing one education and counseling session versus providing five sessions), we will define a subjective measure of “intensity” for each component of care, as agreed upon by the study team, and perform stratified analyses to assess the impact of component intensity on effectiveness. We will also consider the country and year of study as standard care may differ between countries and changed over time (i.e., the introduction of new medications and medication protocols in 2016 ). Sensitivity analyses including and excluding low-quality studies will be conducted to assess the effect of study quality on our findings.
The global burden of HF is enormous, affecting approximately 26 million people worldwide  and reaching yearly global costs of $108 billion . While HF clinic care has been proven beneficial for patients, they have been implemented in widely different formats [8, 20, 21]. Unfortunately, this heterogeneity may considerably undermine their effectiveness . Given limited healthcare resources, identifying the parts of HF clinic care that are associated with better outcomes may allow not only improved care but also reduced costs. As such, it is crucial to understand which components of care offered in HF clinics are the most effective and central to quality patient care.
Studies have attempted to partially address this via traditional systematic review and meta-analysis; for example, a recent Cochrane systematic review and meta-analysis of 25 trials assessed the effectiveness of disease management interventions for patients with HF . The authors note that they were unable to determine the optimal components of HF management programs; however, the study was not designed to address this important question. We believe that the use of network meta-analysis will allow us to identify which components of HF clinic care are associated with improved outcomes.
Care offered to patients in HF clinics is an example of a complex intervention that involves multiple components and multidisciplinary healthcare providers [54,55,56,57]. Traditional approaches for evidence synthesis, such as meta-analysis and meta-regression, are not sufficient to handle the assessment of complex health interventions such as HF clinic care [58, 59]. Traditional meta-analysis works well with simple interventions but is unable to separate the effects of individual components of complex interventions. NMA not only allows information from indirect comparisons to be integrated with head-to-head comparisons used in traditional meta-analysis, but will also allow us to model the effects of individual components of HF clinic care. Most commonly based on a framework of Bayesian statistics, NMA has been developed to assess the relative effectiveness of several interventions, synthesizing evidence across a network of randomized trials and observational studies [60,61,62,63,64,65,66]. The method simultaneously analyzes direct evidence (studies that directly compare the interventions of interest) and indirect evidence (studies that compare interventions of interest through a common comparator) [67,68,69,70], allowing comparison of interventions that have not been evaluated head-to-head. Increasingly, NMA is being used [46, 69, 71,72,73,74,75] to answer questions such as ‘Which type of intervention has the greatest possibility of being most effective?’ or ‘Which combination of components are likely to be most effective?’. As such, we feel that a NMA is a more appropriate method to address our research question.
To our knowledge, this will be the first study to evaluate the comparative effectiveness of the different components of care offered in HF clinics. The findings of this systematic review and network meta-analysis may inform HF guidelines and recommendations regarding the key components of HF clinic care. While referral to and enrollment in HF clinics are currently low, with only one-seventh of HF patients being referred , we anticipate growing referral rates as the aging population increases. With limited resources for healthcare, it is critical to understand which components of care yield the best outcomes.
Cochrane Database of Systematic Reviews
Conference Proceedings Citation Index-Science
Cardiac resynchronization therapy
Database of Abstracts of Reviews of Effectiveness
Deviance information criterion
Grades of Recommendation, Assessment, Development, and Evaluation
Health-related quality of life
Implantable cardioverter defibrillator
International Clinical Trials Registry Platform
Markov chain Monte Carlo
Preferred Reporting Items for Systematic Reviews and Meta-analyses
Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols
Randomized controlled trials
Science Citation Index Expanded
Ross H, Howlett J, Arnold JM, Liu P, O'Neill BJ, Brophy JM, Simpson CS, Sholdice MM, Knudtson M, Ross DB, et al. Treating the right patient at the right time: access to heart failure care. Can J Cardiol. 2006;22:749–54.
Blais C, Dai S, Waters C, Robitaille C, Smith M, Svenson LW, Reimer K, Casey J, Puchtinger R, Johansen H, et al. Assessing the burden of hospitalized and community-care heart failure in Canada. Can J Cardiol. 2014;30:352–8.
Zannad F, Agrinier N, Alla F. Heart failure burden and therapy. Europace. 2009;11(Suppl 5):v1–9.
Ho KK, Pinsky JL, Kannel WB, Levy D. The epidemiology of heart failure: the Framingham Study. J Am Coll Cardiol. 1993;22:6A–13A.
Lee WC, Chavez YE, Baker T, Luce BR. Economic burden of heart failure: a summary of recent literature. Heart Lung. 2004;33:362–71.
Wijeysundera HC, Machado M, Wang X, Van Der Velde G, Sikich N, Witteman W, Tu JV, Lee DS, Goodman SG, Petrella R, et al. Cost-effectiveness of specialized multidisciplinary heart failure clinics in Ontario, Canada. Value Health. 2010;13:915–21.
Beattie WS, Wijeysundera DN. The growing burden of perioperative heart failure. Anesth Analg. 2014;119:506–8.
Wijeysundera HC, Trubiani G, Abrahamyan L, Mitsakakis N, Witteman W, Paulden M, van der Velde G, Kingsbury K, Krahn M. Specialized multi-disciplinary heart failure clinics in Ontario, Canada: an environmental scan. BMC Health Serv Res. 2012;12:236.
Canadian Institute for Health Information (CIHI). All-cause readmission to acute care and return to the emergency department. Ottawa, ON: Canadian Institute for Health Information; 2012.
Krumholz HM, Merrill AR, Schone EM, Schreiner GC, Chen J, Bradley EH, Wang Y, Wang Y, Lin Z, Straube BM, et al. Patterns of hospital performance in acute myocardial infarction and heart failure 30-day mortality and readmission. Circ Cardiovasc Qual Outcomes. 2009;2:407–13.
Tran DT, Ohinmaa A, Thanh NX, Howlett JG, Ezekowitz JA, McAlister FA, Kaul P. The current and future financial burden of hospital admissions for heart failure in Canada: a cost analysis. CMAJ Open. 2016;4:E365–70.
Arnold JM, Liu P, Demers C, Dorian P, Giannetti N, Haddad H, Heckman GA, Howlett JG, Ignaszewski A, Johnstone DE, et al. Canadian Cardiovascular Society consensus conference recommendations on heart failure 2006: diagnosis and management. Can J Cardiol. 2006;22:23–45.
McAlister FA, Stewart S, Ferrua S, McMurray JJ. Multidisciplinary strategies for the management of heart failure patients at high risk for admission: a systematic review of randomized trials. J Am Coll Cardiol. 2004;44:810–9.
Gohler A, Januzzi JL, Worrell SS, Osterziel KJ, Gazelle GS, Dietz R, Siebert U. A systematic meta-analysis of the efficacy and heterogeneity of disease management programs in congestive heart failure. J Card Fail. 2006;12:554–67.
Roccaforte R, Demers C, Baldassarre F, Teo KK, Yusuf S. Effectiveness of comprehensive disease management programmes in improving clinical outcomes in heart failure patients. A meta-analysis. Eur J Heart Fail. 2005;7:1133–44.
Whellan DJ. Heart failure disease management: implementation and outcomes. Cardiol Rev. 2005;13:231–9.
Holland R, Battersby J, Harvey I, Lenaghan E, Smith J, Hay L. Systematic review of multidisciplinary interventions in heart failure. Heart. 2005;91:899–906.
Thomas R, Huntley A, Mann M, Huws D, Paranjothy S, Elwyn G, Purdy S. Specialist clinics for reducing emergency admissions in patients with heart failure: a systematic review and meta-analysis of randomised controlled trials. Heart. 2013;99:233–9.
Jaarsma T, Stromberg A. Heart failure clinics are still useful (more than ever?). Can J Cardiol. 2014;30:272–5.
Gravely S, Ginsburg L, Stewart DE, Mak S, Grace SL, Cardiac Rehabilitation Care Continuity Through Automatic Referral Evaluation I. Referral and use of heart failure clinics: what factors are related to use? Can J Cardiol. 2012;28:483–9.
Jaarsma T, Stromberg A, De Geest S, Fridlund B, Heikkila J, Martensson J, Moons P, Scholte op Reimer W, Smith K, Stewart S, Thompson DR. Heart failure management programmes in Europe. Eur J Cardiovasc Nurs. 2006;5:197–205.
Jaarsma T, van der Wal MH, Lesman-Leegte I, Luttik ML, Hogenhuis J, Veeger NJ, Sanderman R, Hoes AW, van Gilst WH, Lok DJ, et al. Effect of moderate or intensive disease management program on outcome in patients with heart failure: Coordinating Study Evaluating Outcomes of Advising and Counseling in Heart Failure (COACH). Arch Intern Med. 2008;168:316–24.
Angermann CE, Stork S, Gelbrich G, Faller H, Jahns R, Frantz S, Loeffler M, Ertl G, Competence Network Heart F. Mode of action and effects of standardized collaborative disease management on mortality and morbidity in patients with systolic heart failure: the Interdisciplinary Network for Heart Failure (INH) study. Circ Heart Fail. 2012;5:25–35.
Stewart S, Carrington MJ, Marwick TH, Davidson PM, Macdonald P, Horowitz JD, Krum H, Newton PJ, Reid C, Chan YK, Scuffham PA. Impact of home versus clinic-based management of chronic heart failure: the WHICH? (Which Heart Failure Intervention Is Most Cost-Effective & Consumer Friendly in Reducing Hospital Care) multicenter, randomized trial. J Am Coll Cardiol. 2012;60:1239–48.
Chandler J, Hopewell S. Cochrane methods--twenty years experience in developing systematic review methods. Syst Rev. 2013;2:76.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62:1006–12.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, Group P-P. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, Group P-P. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.
Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, Ioannidis JP, Straus S, Thorlund K, Jansen JP, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162:777–84.
Takeda A, Taylor SJ, Taylor RS, Khan F, Krum H, Underwood M. Clinical service organisation for heart failure. Cochrane Database Syst Rev. 2012;(9):CD002752.
Howlett JG, McKelvie RS, Costigan J, Ducharme A, Estrella-Holder E, Ezekowitz JA, Giannetti N, Haddad H, Heckman GA, Herd AM, et al. The 2010 Canadian Cardiovascular Society guidelines for the diagnosis and management of heart failure update: heart failure in ethnic minority populations, heart failure and pregnancy, disease management, and quality improvement/assurance programs. Can J Cardiol. 2010;26:185–202.
Yancy CW, Jessup M, Bozkurt B, Butler J, Casey DE Jr, Drazner MH, Fonarow GC, Geraci SA, Horwich T, Januzzi JL, et al. 2013 ACCF/AHA guideline for the management of heart failure: executive summary: a report of the American College of Cardiology Foundation/American Heart Association Task Force on practice guidelines. Circulation. 2013;128:1810–52.
Data collection forms for intervention reviews [https://training.cochrane.org/interactivelearning/module-4-selecting-studies-and-collecting-data].
Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.
Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ, Group GW. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–6.
Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, Devereaux PJ, Montori VM, Freyschuss B, Vist G, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol. 2011;64:1283–93.
Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Falck-Ytter Y, Jaeschke R, Vist G, et al. GRADE guidelines: 8. Rating the quality of evidence--indirectness. J Clin Epidemiol. 2011;64:1303–10.
Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Glasziou P, Jaeschke R, Akl EA, et al. GRADE guidelines: 7. Rating the quality of evidence--inconsistency. J Clin Epidemiol. 2011;64:1294–302.
Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, Alonso-Coello P, Djulbegovic B, Atkins D, Falck-Ytter Y, et al. GRADE guidelines: 5. Rating the quality of evidence--publication bias. J Clin Epidemiol. 2011;64:1277–82.
Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, Atkins D, Kunz R, Brozek J, Montori V, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol. 2011;64:1311–6.
Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, et al. GRADE guidelines: 4. Rating the quality of evidence--study limitations (risk of bias). J Clin Epidemiol. 2011;64:407–15.
Iorio A, Spencer FA, Falavigna M, Alba C, Lang E, Burnand B, McGinn T, Hayden J, Williams K, Shea B, et al. Use of GRADE for assessment of evidence about prognosis: rating confidence in estimates of event rates in broad categories of patients. BMJ. 2015;350:h870.
Light RJ, Pillemer DB. Summing up: the science of reviewing research. Cambridge, MA: Harvard University Press; 1984.
Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629–34.
Welton NJ, Caldwell DM, Adamopoulos E, Vedhara K. Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. Am J Epidemiol. 2009;169:1158–65.
Plummer M: rjags: Bayesian graphical models using MCMC. February 19, 2016 edition; 2016.
Dias S, Sutton AJ, Welton NJ, Ades AE. Evidence synthesis for decision making 3: heterogeneity--subgroups, meta-regression, bias, and bias-adjustment. Med Decis Mak. 2013;33:618–40.
Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Mak. 2013;33:641–56.
Zhang J, Fu H, Carlin BP. Detecting outlying trials in network meta-analysis. Stat Med. 2015;34:2695–707.
Yancy CW, Jessup M, Bozkurt B, Butler J, Casey DE Jr, Colvin MM, Drazner MH, Filippatos G, Fonarow GC, Givertz MM, et al. 2016 ACC/AHA/HFSA focused update on new pharmacological therapy for heart failure: an update of the 2013 ACCF/AHA guideline for the management of heart failure: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Failure Society of America. J Am Coll Cardiol. 2016;68:1476–88.
Ambrosy AP, Fonarow GC, Butler J, Chioncel O, Greene SJ, Vaduganathan M, Nodari S, Lam CSP, Sato N, Shah AN, Gheorghiade M. The global health and economic burden of hospitalizations for heart failure: lessons learned from hospitalized heart failure registries. J Am Coll Cardiol. 2014;63:1123–33.
Cook C, Cole G, Asaria P, Jabbour R, Francis DP. The annual global economic burden of heart failure. Int J Cardiol. 2014;171:368–76.
Davidson PM, Newton PJ, Tankumpuan T, Paull G, Dennison-Himmelfarb C. Multidisciplinary management of chronic heart failure: principles and future trends. Clin Ther. 2015;37:2225–33.
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council G. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Craig P, Petticrew M. Developing and evaluating complex interventions: reflections on the 2008 MRC guidance. Int J Nurs Stud. 2013;50:585–7.
Greco T, Zangrillo A, Biondi-Zoccai G, Landoni G. Meta-analysis: pitfalls and hints. Heart Lung Vessel. 2013;5:219–25.
Mitka M. US government kicks off program for comparative effectiveness research. JAMA. 2010;304:2230–1.
Lu G, Ades AE. Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004;23:3105–24.
Lu G, Ades AE. Assessing evidence inconsistency in mixed treatment comparisons. J Am Stat Assoc. 2006;101:447–59.
Salanti G, Higgins JP, Ades AE, Ioannidis JP. Evaluation of networks of randomized trials. Stat Methods Med Res. 2008;17:279–301.
Higgins JP, Whitehead A. Borrowing strength from external trials in a meta-analysis. Stat Med. 1996;15:2733–49.
Ades AE, Sculpher M, Sutton A, Abrams K, Cooper N, Welton N, Lu G. Bayesian methods for evidence synthesis in cost-effectiveness analysis. Pharmacoeconomics. 2006;24:1–19.
Caldwell DM, Ades AE, Higgins JP. Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005;331:897–900.
Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, Lee K, Boersma C, Annemans L, Cappelleri JC. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health. 2011;14:417–28.
Mills EJ, Ioannidis JP, Thorlund K, Schunemann HJ, Puhan MA, Guyatt GH. How to use an article reporting a multiple treatment comparison meta-analysis. JAMA. 2012;308:1246–53.
Mills EJ, Thorlund K, Ioannidis JP. Demystifying trial networks and network meta-analysis. BMJ. 2013;346:f2914.
Greco T, Biondi-Zoccai G, Saleh O, Pasin L, Cabrini L, Zangrillo A, Landoni G. The attractiveness of network meta-analysis: a comprehensive systematic and narrative review. Heart Lung Vessel. 2015;7:133–42.
Hoaglin DC, Hawkins N, Jansen JP, Scott DA, Itzler R, Cappelleri JC, Boersma C, Thompson D, Larholt KM, Diaz M, Barrett A. Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value Health. 2011;14:429–37.
Roberts KA, Dixon-Woods M, Fitzpatrick R, Abrams KR, Jones DR. Factors affecting uptake of childhood immunisation: a Bayesian synthesis of qualitative and quantitative evidence. Lancet. 2002;360:1596–9.
Palmerini T, Benedetto U, Bacchi-Reggiani L, Della Riva D, Biondi-Zoccai G, Feres F, Abizaid A, Hong MK, Kim BK, Jang Y, et al. Mortality in patients treated with extended duration dual antiplatelet therapy after drug-eluting stent implantation: a pairwise and Bayesian network meta-analysis of randomised trials. Lancet. 2015;385:2371–82.
Palmerini T, Biondi-Zoccai G, Della Riva D, Stettler C, Sangiorgi D, D'Ascenzo F, Kimura T, Briguori C, Sabate M, Kim HS, et al. Stent thrombosis with drug-eluting and bare-metal stents: evidence from a comprehensive network meta-analysis. Lancet. 2012;379:1393–402.
Simpson SH, Lee J, Choi S, Vandermeer B, Abdelmoneim AS, Featherstone TR. Mortality risk among sulfonylureas: a systematic review and network meta-analysis. Lancet Diabetes Endocrinol. 2015;3:43–51.
Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol. 1997;50:683–91.
We thank the Ted Rogers Centre for Heart Research, the Peter Munk Cardiac Centre (University Health Network) and Canadian Institutes of Health Research for funding this project.
This systematic review is funded by the Ted Rogers Centre for Heart Research, the Peter Munk Cardiac Centre (University Health Network) and a Canadian Institutes of Health Research Health System Impact Fellowship.
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.