Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

The effectiveness of opioid substitution treatments for patients with opioid dependence: a systematic review and multiple treatment comparison protocol

  • Brittany Burns Dennis1, 2,
  • Leen Naji3,
  • Monica Bawor2, 4,
  • Ashley Bonner1,
  • Michael Varenbut5,
  • Jeff Daiter5,
  • Carolyn Plater5,
  • Guillaume Pare1, 9,
  • David C Marsh5, 6,
  • Andrew Worster5, 7,
  • Dipika Desai2, 9,
  • Zainab Samaan1, 2, 8, 9 and
  • Lehana Thabane1, 9, 10, 11, 12Email author
Contributed equally
Systematic Reviews20143:105

DOI: 10.1186/2046-4053-3-105

Received: 27 June 2014

Accepted: 3 September 2014

Published: 19 September 2014

Abstract

Background

Opioids are psychoactive analgesic drugs prescribed for pain relief and palliative care. Due to their addictive potential, effort and vigilance in controlling prescriptions is needed to avoid misuse and dependence. Despite the effort, the prevalence of opioid use disorder continues to rise. Opioid substitution therapies are commonly used to treat opioid dependence; however, there is minimal consensus as to which therapy is most effective. Available treatments include methadone, heroin, buprenorphine, as well as naltrexone. This systematic review aims to assess and compare the effect of all available opioid substitution therapies on the treatment of opioid dependence.

Methods/Design

The authors will search Medline, EMBASE, PubMed, PsycINFO, Web of Science, Cochrane Library, Cochrane Clinical Trials Registry, World Health Organization International Clinical Trials Registry Platform Search Portal, and the National Institutes for Health Clinical Trials Registry. The title, abstract, and full-text screening will be completed in duplicate. When appropriate, multiple treatment comparison Bayesian meta-analytic methods will be performed to deduce summary statistics estimating the effectiveness of all opioid substitution therapies in terms of retention and response to treatment (as measured through continued opioid abuse).

Discussion

Using evidence gained from this systematic review, we anticipate disseminating an objective review of the current available literature on the effectiveness of all opioid substitution therapies for the treatment of opioid use disorder. The results of this systematic review are imperative to the further enhancement of clinical practice in addiction medicine.

Systematic review registration

PROSPERO CRD42013006507.

Keywords

Opioid substitution therapies Opioid dependence Methadone Buprenorphine/naloxone Naltrexone Heroin Systematic review Network meta-analysis

Background

Opioids are psychoactive analgesic drugs prescribed for pain relief and palliative care [1]. Due to their addictive nature, effort and vigilance in controlling prescriptions is needed to avoid misuse and dependence. Despite such effort, opioid use disorder is commonly associated with both illicit and prescription opioid use [2]. The DSM-5 characterizes opioid use disorder as a ‘problematic pattern of opioid use leading to clinically significant impairment or distress’ [3]. Characteristics of opioid use disorder include increased tolerance, continued use despite personal and social problems, as well as withdrawal and tolerance, among other behavioral changes [3]. Opioid use has been on the rise for the past several years, although common and available treatment options have not adjusted to meet the increasing demand for therapy [4].

The rapid rise in opioid prescriptions worldwide in conjunction with the increase in misuse and addiction is concerning [2, 5]. Opioid-related deaths in ON, Canada have doubled between 1991 and 2004 [6, 7]. In the United States, opioid sales have surged 627% between 1997 and 2007 [8]. Accompanying this dramatic rise in prescription opioid sales, the number of opioid-related overdoses in the United States has increased tenfold since 1990 [9]. Aside from the negative impact of drug use on the patient's lifestyle and psychological state, many physical health issues are associated with opioid abuse. For instance, IV opioid use is found to be associated with serious cardiac abnormalities such as infective endocarditis [10, 11]. Furthermore, opioid use has been correlated with increase HIV risk and susceptibility to other opportunistic infections such as hepatitis C and tuberculosis [12].

Today, opioid substitution treatment (OST) is used to treat opioid dependence. This medical intervention employs strategies to control rather than prevent drug use in attempts to limit the incidence of adverse events. This involves prescribing controlled amounts of longer acting but less euphoric opioids to reduce cravings and prevent withdrawal symptoms [13]. Currently, the most commonly used substitute opioid is methadone [14, 15]. First introduced for the treatment of opioid use disorder in 1965, methadone maintenance treatment (MMT) has been shown to be effective in ameliorating symptoms of opioid craving and reducing the negative effects that illicit drug use has on individuals, such as increased HIV risk [16]. It has also been shown to alleviate some of the burden that illicit drug use places on society, including criminal acts and the spread of infectious disease to others [15, 1721]. Reported methadone effectiveness varies by studies, with some investigations reporting as low as 20% to as high as 70% [1012]. These rates are largely accounted for by the numerous definitions of methadone effectiveness reported in the literature. Interindividual variability in clinical responses to methadone and dose requirements depend on several factors including age, diet, metabolism, protein binding, medications, genetic variants, and other substance use [2226].

MMT is used by 20%–25% of opioid-dependent individuals in North America, leaving approximately 75% of the opioid-dependent population on another intervention or without any treatment at all [27]. While methadone is claimed to be an effective treatment for patients with opioid use disorder, it is important to note that alternative therapies are on the rise. Suboxone® is a relatively new drug approved in Canada since 2007, comprised of a combination of buprenorphine and naloxone in a 4:1 ratio [28]. When taken sublingually, only buprenorphine exerts its partial agonistic effects because naloxone is not adequately absorbed. However, in case of parenteral abuse, the administration naloxone exerts a withdrawal effect in opioid-dependent patients [29, 30]. Therefore, the role of this combination is to ultimately alleviate withdrawal symptoms while also deterring intravenous use of the medication. Suboxone's effects are less prominent than full opioid agonists, as such it induces less physical dependence than other full opioid agonists such as heroin, morphine, and methadone [31]. It is also associated with less dysphoric effects than methadone, encouraging a greater portion of patients to continue in treatment. As well, it has a ceiling effect, such that its effectiveness remains constant beyond a certain dose, thus helping to control use and limit abuse [32].

According to one study, buprenorphine/naloxone patients reported significantly improved social life, educational level, and response to treatment (measured through urine toxicology screens), as compared to patients on MMT [33]. However, further studies including a 17-week randomized single-center trial reported no significant difference in the proportion of opioid-negative urine samples between patients on buprenorphine relative to methadone [31].

Naltrexone, another alternative opioid substitution therapy, is a competitive opioid receptor antagonist that blocks the euphoric effects of opioids by acting on receptors in the brain [34]. The oral form has been available since 1980s but due to the lack of patients' adherence to the therapy, it has been deemed ineffective until the recent introduction of long-acting injections and implants of naltrexone [34]. Long-lasting injectable naltrexone therapy was approved by the FDA in 2010 after a 6-month placebo-controlled trial showed that over 50% of patients remained on treatment and refrained from using illicit drugs for the entire study period [34, 35]. A double-blinded randomized controlled trial (RCT) (n = 60) investigating the efficacy of injectable naltrexone against placebo demonstrated a significantly reduced ‘need’ for heroin, as per patient reporting, after treatment (192 or 384 mg) in comparison to placebo [36]. Naltrexone is easy to administer, does not induce tolerance over time, and it is not addictive [37].

However, naltrexone removes tolerance to opioids and thus increases the risk of overdose should patients choose to abstain from therapy and return to illicit opioid use. According to a search of the National Coronial Information System (2000–2003), deaths associated with oral naltrexone use are three to seven times higher than those of methadone [38].

Heroin-assisted therapy (HAT) is a novel and controversial treatment for opioid dependence which involves the administration of injectable diacetylmorphine, the active ingredient of heroin. HAT is more effective than oral methadone in terms of both reduction of illicit drug use (67.0% and 47.7%) and increase in retention in treatment (87.8% vs 54.1%). A study by Oviedo-Joekes et al. has shown that HAT is slightly more effective than methadone for increasing quality of life years gained (7.46 vs 7.92) [39]. As well, the study shows that HAT is more cost effective in terms of long-term incurred societal costs compared to methadone, primarily due to the fact that patients adhere to treatment longer and are less likely to relapse, resulting in less criminal activity [40].

Due to the aforementioned concerns and inconsistent findings related to the effectiveness of OSTs currently available, it is important to determine the most effective OST for increasing patient retention and restraining illicit opioid use. This systematic review will investigate the effectiveness of methadone, buprenorphine/naloxone, naltrexone, heroin-assisted therapy (HAT) and any other OST in terms of the continued opioid use (response to treatment) retention in treatment, physical and psychological well-being, social implication (criminal activity), as well as incidence of adverse events or toxic effects from the opioid intervention.

Objectives

This systematic review aims to assess and compare the effectiveness of all available OSTs in the treatment of opioid use disorder, including but not limited to methadone, buprenorphine/naloxone (Suboxone®), naltrexone, and heroin (diacetylmorphine)-assisted therapy. Specifically, the objectives of this investigation include:
  1. 1)

    Assessing the effectiveness of the aforementioned therapies based on retention in treatment and continued opioid use (response to treatment).

     
  2. 2)

    Conduct direct comparisons using random effects meta-analytic models and when appropriate, conduct a network meta-analysis to synthesize a mean difference, relative risk, or odds ratio that encompasses results from multiple studies.

     
  3. 3)

    Critically evaluate current literature and identify important areas of addiction medicine that future research should address.

     
  4. 4)

    Offer unbiased report of the effectiveness of different treatments in relation to one another to enhance current clinical treatment of opioid use disorders.

     

Research question

Among patients being treated for opioid use disorder, which OST (methadone, buprenorphine/naloxone, naltrexone, HAT, and/or other) is most effective for increasing retention in treatment and restraining continued opioid use?

Methods/Design

Data sources and search strategy

In order to conduct a comprehensive search of the available literature, we will use a set of predetermined and separate key terms to search the following online databases: Medline, EMBASE, PubMed, PsycINFO, Web of Science, Cochrane Library, Cochrane Clinical Trials Registry, World Health Organization (WHO) International Clinical Trials Registry Platform Search Portal, and the National Institutes for Health (NIH) Clinical Trials Registry. Searches will be performed independently by two authors (LN and BD). The authors will perform additional manual searches of all completed Cochrane reviews examining the effect of different OSTs. The manual search will be used to identify any RCT or observational study on OSTs that have been combined statistically and narratively in a Cochrane review, as Cochrane is the leader and gold standard in systematic reviews. We will also contact each primary investigator listed on the NIHs Clinical Trial Registry from studies deemed eligible during the title screening, where we will inform the investigators of our review and ask for information regarding any publications resulting from their trial. We will also contact a librarian from the McMaster Faculty of Health Sciences Library with expertise in systematic reviews throughout the process of devising the search strategy and conducting the literature search. The two authors (LN and BD) will then independently refer to the bibliographies of articles that pass the initial abstract screening. No constraints will be set on language or date of publication in order to allow for a more thorough search of the literature. However, only human studies will be included. As well, we will eliminate incomplete studies, as they would not provide sufficient data for extraction. We will inform the authors of the eligible articles about the review during the data extraction process to consult them for clarification of their data when needed. Please refer to Table 1 for full search strategy.
Table 1

Defined search strategy for the extraction of pertinent studies from multiple databases

CINAHL search strategy search = ___

1. (MH ‘methadone+’)

2. (MH ‘suboxone+’)

3. (MH ‘heroin assisted treatment+’)

4. (MH ‘diacetylmorphine+’)

5. (MH ‘heroin adjusted therapy+’)

6. (MH ‘buprenorphine+’)

7. (MH ‘Revia+’)

8. (MH ‘Depade+’)

9. (MH ‘Naltrexone+’)

10. 1 or 2 or 3 or 4 or 5 or 6 or 7 or 8 or 9

11. (MH ‘disorder, substance abuse’) or (MH ‘substance withdrawal syndrome+’) or (MH ‘substitute opioid therapy+’)

12. 10 AND 11

Medline search strategy search = ____

1. methadone/th [Therapy]

2. limit 1 to humans

3. opioid substitution treatment/ae mo [adverse effects, mortality]

4. limit 3 to humans

5. substance-Related Disorders/de, ep, th [Drug Effects, Epidemiology, Therapy]

6. Limit 5 to humans

7. Opiate Substitution Treatment/or Naloxone/or Buprenorphine/or Opioid-Related Disorders/or Heroin Dependence/or Substance Withdrawal Syndrome/or Narcotic Antagonists/

8. Limit 7 to humans

9. Naltrexone/ae, ag, ai, tu [Adverse Effects, Agonists, Antagonists & Inhibitors, Therapeutic Use]

10. Limit 9 to humans

11. Substance Abuse Treatment Centers/or Substance Abuse, Intravenous/or Heroin/or Heroin Dependence/or Opioid-Related Disorders/or Randomized Controlled Trials as Topic/or Methadone/

12. Limit 11 to humans

13. methadone/

14. limit 13 to humans

15. 2 OR 4 OR 8 OR 10 OR 12 OR 14

16. 15 AND 6

Web of science search strategy search = _____

1. Topic = (‘methadone’ OR ‘methadone maintenance therapy’ OR ‘naltrexone’ OR ‘suboxone’ OR ‘buprenorphine’ OR ‘heroin assisted treatment’)

2. Topic = (‘substitute opioid therapy’ OR ‘opioid substitution therapy’)

3. 1 AND 2

EMBASE search strategy Search = ___

1. methadone treatment/or methadone/or methadone plus naloxone/

2. limit 1 to human

3. buprenorphine plus naloxone/

4. limit 3 to human

5. morphine sulfate plus naltrexone/or naltrexone/

6. limit 5 to human

7. opiate addiction/or heroin dependence/or methadone/or diamorphine/

8. limit 7 to human

9. opiate substitution treatment/ae [Adverse Drug Reaction]

10. methadone/or buprenorphine/or opiate addiction/or substitute opioid therapy.mp.

11. 9 or 10

12. 2 or 4 or 6 or 8

13. 11 and 12

14. substance abuse/or addiction/or drug dependence/

15. 13 and 14

16. randomized controlled trial/

17. 15 and 16

PsycINFO search strategy search = _____

1. exp Methadone Maintenance/or exp Methadone/

2. limit 1 to human

3. exp Treatment Outcomes/or exp Drug Therapy/or exp Methadone Maintenance/or exp Drug Dependency/or exp Maintenance Therapy/or exp Methadone/or exp Heroin/

4. limit 3 to human

5. exp Drug Addiction/or exp Clinics/or exp Drug Therapy/or exp Drug Dependency/or exp ‘Recovery (Disorders)’/or exp Maintenance Therapy/

6. limit 5 to humans

7. exp naltrexone/

8. limit 7 to humans

9. exp Maintenance Therapy/or exp Naloxone/or exp Drug Therapy/or exp Drug Dependency/or exp Heroin Addiction/

10. limit 7 to humans

11. exp Treatment Outcomes/or exp Clinical Trials/or exp Drug Therapy/or exp Heroin Addiction/or exp Methadone Maintenance/

12. limit 9 to humans

13. 2 and 8 and 10

14. 2 and 10

15. 2 and 12

16. 2 and 6 and 12

17. 13 or 14 or 15 or 16

Cochrane library search strategy search = __

1. search title, abstract, keywords: methadone

2. search title, abstract, keywords: buprenorphine

3. search title, abstract, keywords: naltrexone

4. search title, abstract, keywords: heroin assisted treatment

Clinical Trials Registry through National Institutes for Health search strategy Search = ____

‘methadone’ OR ‘suboxone’ OR ‘Buprenorphine’ OR ‘substitute opioid therapy’ OR ‘naltrexone’ OR ‘heroin assisted treatment’ OR ‘heroin adjustment therapy’ AND ‘opioid addiction’, with additional criteria including: Completed studies, exclude unknown status, adult age requirements, and all trials had to be listed as Phase 3, 4

Cochrane Central Register of Controlled Trials search strategy Search = ____

‘substitute opioid therapy’ OR ‘methadone’ OR ‘naltrexone’ OR ‘buprenorphine’ OR ‘heroin assisted treatment’ OR ‘heroin adjustment therapy’ in title abstract keywords and opioid addiction in title abstract keywords in Trials

Selection of studies

The authors (LN and BD) will independently conduct a primary title search, title screening, abstract screening, and full-text extraction. We will refer to the inclusion and exclusion criteria throughout the screening process. All data extraction forms will be pilot tested before use. In the case of a disagreement during the search and selection process, we will engage in a discussion to reach a mutual agreement. However, should the conflict persist, we will resort to a third author (ZS) to facilitate the resolution. Agreement level between reviewers will also be assessed using the kappa statistic [41]. As per guidelines set by the Meta-analysis of Observational Studies in Epidemiology (MOOSE) and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), we will include both a flow diagram displaying screening process (Figure 1) and a detailed table of the studies selected in the systematic review [42, 43].
Figure 1

Flow diagram of screening process.

Inclusion and exclusion criteria

The authors will limit the studies included in this review to RCTs and observational studies evaluating the effectiveness of methadone, buprenorphine/naloxone, naltrexone, HAT, and/or any other unlisted OST for the treatment of opioid dependence. The study will have had to examine the effectiveness of one of the aforementioned treatments with one or more of the outcomes of interest: retention in treatment, response to treatment (as measured through continued opioid use), criminal activity (as measured by self-report), mortality, physical and psychological health, as well as incidence of toxic and adverse events. No age restrictions will be set. In addition, we will also exclude articles examining specialized populations such as prisoners examined within penitentiaries or other settings as well as pregnant women. All studies must also be primary investigations with comparison groups (separated by a treatment or placebo), we will not allow studies such as case reports or case series to be included in the review, arguably due to their lack of an appropriate comparison group. We have noted that we are primarily interested in patient important long-term outcomes such as illicit substance abuse behavior, retention in treatment, and side effects; we will not be including studies whose primary objective is to determine dosing and detoxification effects or precipitated withdrawal. Our primary concern is the influence of OSTs on retention in treatment and restraining continued opioid use. We are not interested in studies determining the effectiveness of OSTs on other substances such as cocaine or alcohol. We will not include pilot studies or RCTs at phases 0, 1, and 2. We will review any studies indexed within the databases allotted time frame and no restrictions on publication date will be set. All studies selected for inclusion into the manuscript will be required to demonstrate appropriate ethics committee approval in accordance with the objectives stated within the Helsinki Declaration. This investigation will not require direct human experimentation; however, we will still comply with all objectives of the Helsinki Declaration.

Quality assessment of individual studies

Two authors (LN and BD) will independently conduct a methodological quality assessment of the studies selected for the systematic review. We will use the Newcastle-Ottawa Scale (NOS) for observational studies to assess the risk of bias [44]. We will use the Cochrane risk of bias tool to assess the risk of bias for RCTs [45]. Discussions will be used to resolve any discrepancies that should arise. A third author (ZS) will be contacted to facilitate resolution in the case that a mutual consensus is not reached. When assessing risk of bias using the Cochrane tool for RCTs, scores of 1, 2, or 3 will be assigned for each domain that is ranked as ‘low risk’, ‘unclear’, or ‘high risk’ of bias, respectively. Scores from all the domains addressed by the Cochrane risk of bias tool will be added to give a total score out of 18, with higher scores indicating a higher risk of bias. When assessing risk of bias using the modified Newcastle Ottawa Scale for observational studies, scores of 1, 2, or 3 will be assigned for domains ranked as ‘high risk’, ‘unclear’, or ‘low risk’ of bias. Scores from all the domains will be totaled to a score of 21, with higher scores indicating lower risk of bias.

Outcome measures

This systematic review will compare methadone, buprenorphine/naloxone, naltrexone, and HAT among other substitute opioid therapies in terms of retention and response to treatment (as measured through continued opioid use). Retention in treatment has multiple definitions and measurements across studies, where some chose to define retention as a continuous value such as the number of days a patient continued in treatment until the last day of receiving an intervention receipt [46]; other studies chose to measure retention as a binary outcome such as the percentage of patients who completed their treatment course [47]; and lastly, some studies chose to report the number of patients who received the treatment for a predefined number of treatment days [39]. Due to the numerous ways retention is defined, measured, and reported, we will collect any information the articles offer on patient retention. We will statistically combine results from studies that similarly report, measure, and define retention. We will contact authors of studies who uniquely measure/report patient retention results in an effort to obtain results in the more commonly defined retention method.

Furthermore, we define response to treatment as abstinence from use of illicit opioids as indicated by absence of any opioids not pertaining to the treatment in urine toxicology screening. We will compare the percentage of opioid-negative urine samples between treatments, calculated by dividing the number of opioid-negative urine screens by the total number of urine samples provided as used in the studies by Mattick et al. (2003) and Samaan et al. (2014) [48, 49]. Please refer to Table 2 for detailed information on how these variables are defined and measured in the current literature.
Table 2

Definitions of outcomes in opioid substitution investigations

Outcome

Definition

Measurement of variable (units)

Statistical estimates and measurement of association of this outcome

Studies

Continued illicit drug abuse

Abstaining from illicit opioid use throughout treatment.

-Urine toxicology screening

OR, rate ratio

[39, 46, 47, 50, 51]

-Self-reported drug use

 

Retention in treatment

Proportion or participants completing treatment and days in treatment from beginning of the study until the last day of therapy.

-Number of days patient remains in treatment (days)

Comparing means (SD), HR, adjusted HR using Cox model, rate ratio, Kaplan-Meier estimator

[39, 47, 5254]

Adverse events

Reaction to drugs and/or change in health status during course of therapy.

-Interviews

t-test

[30, 39, 51, 54]

-Physical examination

-Randomly recorded at visits

-Total number of adverse events per day

Data abstraction

For the purpose of this review, we will construct full-text extraction forms. Data will be later transferred from these forms and entered into a Microsoft Excel 2011 document. The data abstraction forms were pilot tested in duplicate to ensure their feasibility in this review. These forms are available upon request. Any contention that arises during the extraction process will be resolved through discussion, and if necessary, a third author (ZS) will be brought in. The data extraction forms will allow us to adequately manage the large amount of information being extracted from individual studies. This information includes: title of the journal, number of study participants, study methodology (i.e. RCT and cohort), participant mean age, outcomes assessed, methods of statistical measurement, covariates measured in regression models, outcome statistical association value, p-value, confidence intervals, data quality (i.e. percentage of missing data and how missing data were handled), and methods used to correct for multiple testing.

Statistical analysis plan

When summarizing the evidence of multiple therapies, we often find that there are a limited number of studies providing direct comparisons. For example, a number of systematic reviews compare new therapies (i.e. Naltrexone and heroin-assisted treatment) only to placebo or the standard of care, this being methadone. Using novel statistical approaches to multiple treatment comparisons (MTC) such as the network meta-analysis (NMA), we will provide the pooled effect estimates of all OSTs for continued opioid abuse and patient retention, disseminating both direct and indirect comparisons of all therapies. The results of this review will be summarized both narratively and statistically where possible. For this review, we will provide summary estimates (pooled odds ratios for binary outcomes and standardized mean differences for continuous outcomes) calculated using direct and indirect sources of evidence, as well as those arising from mixing both direct and indirect evidence, provided the assumption of consistency is reasonable.

Due to the stark differences in methodology, we will not be pooling data retrieved from observational studies with data from RCTs. All direct estimates will be pooled separately based on study design (randomized vs non-randomized). While some studies suggest the differences in treatment estimates obtained from well-designed observational research do not differ greatly from RCTs of the same topic [55, 56], pooling data from observational studies and RCTs is highly cautioned against [57, 58]. This separation stems largely from the inherent differences between RCTs and observational designs, whereby non-randomized designs face high susceptibility to selection bias [57].

Direct comparisons

Direct evidence will be pooled using a random-effect meta-analysis with Knapp-Hartung (KH) estimator [59]. All analyses will be performed using the metafor and rmeta packages in R [60].

Pooled results from the direct comparisons will be presented in forest plots. The most commonly used estimator is DerSimonian-Laird (DL) and is most often the default estimator in statistical software packages like Review Manager [61]. The DL estimator is demonstrated to be inadequate in capturing study heterogeneity, producing narrow confidence intervals and over-inflating treatment effects [61, 62]. The KH estimator works on assumptions that variances are estimated from small samples, in addition to constructing confidence intervals based on the t-distribution (with k-1 degrees of freedom) [59, 63]. Direct comparisons will weight studies eligible for inclusion using the inverse of the variance. For the direct comparison meta-analyses pooling the results from studies investigating retention in treatment, data will be pooled using risk ratios. The standardized mean difference will be used when pooling the results of studies investigating continued opioid abuse when measured as a continuous variable (mean number of opioid-positive urine screens per treatment arm). Provided we have an appropriate number of studies, we will use an Egger's plot to assess for publication bias.

We anticipate differences in outcome measurement and methodological quality to be important factors for explaining heterogeneity. These differences will be captured in our methodological quality assessment using the modified Newcastle-Ottawa Scale for observational studies and the Cochrane risk of bias tool for RCTs. Scores from these tools are determined from a thorough assessment of study design features such as: sampling strategy, methodological design (e.g. blinding), and outcome measurement (e.g. urine toxicology screening vs self-report). We will conduct subgroup analyses to address the robustness of our results when stratified by methodology quality based on the risk bias assessment scores. Studies will be separated into ‘high and low’ quality based on their scoring, where studies scoring 5 or lower on the Newcastle Ottawa scale and 6 points or higher on the Cochrane risk of bias tool will be assessed. These are standard methodological scoring cut offs used in previous reviews [64]. Provided the data is suitable, we will perform subgroup analyses based on the scoring procedures described above.

Some studies suggest using an I2 test statistic cut off of 40% or greater as an indication of heterogeneity among the pooled studies [57]; however, using such thresholds may be ‘misleading’ since heterogeneity represented in the I2 statistic is influenced by multiple factors [57]. We will rely on multiple thresholds set forth by the Cochrane Collaboration to aid in our I2 statistic interpretation, these include I2 of 0%–40% (might not be important), 30%–60% (moderate heterogeneity), 50%–90% (substantial heterogeneity), and 75%–100% (considerable heterogeneity) [57].

Direct and indirect evidence: the network meta-analysis

We propose using a Bayesian hierarchical model for binary outcomes, where we can account for sampling variability, treatment heterogeneity, and inconsistency while also applying maximum likelihood estimation [65]. The statistical model for the MTC we propose to use allows for an additional random effect, representing change in the treatment effect as a result of the comparison being made [65]. Variation in this random effect across comparisons will be interpreted as inconsistency [65]. Assumptions guiding NMA dictate that trials must be equivalent in their study design and population selection or the statistical results may be compromised [66]; thus, we will only be including evidence from RCTs into the NMA model. When trials evaluating a specific treatment are fundamentally distinct from other trials within that collection, the statistical results may be compromised by inconsistency [66]. To identify inconsistency, we will compare direct and indirect evidence using an approach known as node splitting [67, 68]. Comparing inconsistency using this approach allows us to identify the loops with large inconsistency and ultimately consider this during interpretation of the results. Within the Bayesian framework, we will also use the deviance information criterion (DIC) to inform how parsimonious the data are, with a lower value being desired [67].

Provided the data is suitable, we will also address inconsistency using meta-regression to adjust for covariates (effect modifiers) across studies. We will perform a regression using study level data such as OST dose (mg/day), publication date, or study design features (blinding) to examine the improve or change in model fit after covariates are included into the model [67].

We will present our results with probability statements of treatment effects, by which ranking these probabilities allows the advantage of clarifying the sometimes over-complex reporting of pairwise p-values [69]. Ranking probabilities allows us to disseminate as a chance percentage, which treatment ranks the highest [69]. After displaying these rank probabilities graphically, we will construct the surface under the cumulative ranking (SUCRA) line for each treatment, in an effort to the graphically displayed probability ranks [69].

GRADE framework

We will assess the summary estimates of this investigation using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidelines [70]. Both direct and indirect estimates obtained from the NMA will be subject to thorough review using the GRADE framework. Evidence from indirect comparisons will be subject to additional scrutiny due to our inability to reliably show that the features of trial design (participants, interventions, outcome measures) are not impacting the observed treatment effect [71].

Discussion

We anticipate disseminating an objective review of the current available literature on the effectiveness of all substitute opioid therapies for the treatment of opioid use disorder. This review will allow us to evaluate not only the relationship between all substitute opioid therapies and the patient important outcomes, but also, this review will allow us to evaluate the methodological quality of current available evidence. We seek to understand whether there are inconsistencies in the research and what reasons may account for them. Gaining insight into the predictors of patient response characteristics in opioid use disorder will help physicians develop patient-centered treatment regimes. This will be the first systematic review available in the literature looking at all possible substitute opioid therapies at one time. Thus, the dissemination of these results is imperative to the further enhancement of clinical practice through guideline development.

Notes

Abbreviations

OST: 

Opioid Substitution Treatment

MMT: 

Methadone Maintenance Therapy

WHO: 

World Health Organization

HAT: 

Heroin-assisted therapy

EMBASE: 

Excerpta Medica DataBase

RCT: 

Randomized controlled trial

MOOSE: 

Meta-analysis of Observational Studies in Epidemiology

PRISMA: 

Preferred Reporting Items for Systematic reviews and Meta-Analyses

NOS: 

Newcastle-Ottawa Scale.

Declarations

Acknowledgements

We report no competing interests for this investigation. This work was supported by CIHR Drug Safety and Effectiveness Network (DSEN) grant (Grant No. 126639). The funders had no role in study design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.

Authors’ Affiliations

(1)
Department of Clinical Epidemiology and Biostatistics, McMaster University
(2)
Population Genomic Program, Chanchlani Research Centre, McMaster University
(3)
Michael G. DeGroote School of Medicine, McMaster University
(4)
McMaster Integrative Neuroscience Discovery & Study (MiNDS) Program, McMaster University
(5)
Ontario Addiction Treatment Centres
(6)
Northern Ontario School of Medicine
(7)
Department of Medicine, Hamilton General Hospital
(8)
Department of Psychiatry and Behavioral Neurosciences, McMaster University
(9)
Population Health Research Institute, Hamilton Health Sciences
(10)
Department of Pediatrics and Anesthesia, McMaster University
(11)
Centre for Evaluation of Medicine, St Joseph's Healthcare—Hamilton
(12)
Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare—Hamilton

References

  1. Franklin GM, Rahman EA, Turner JA, Daniell WE, Fulton-Kehoe D: Opioid use for chronic low back pain: A prospective, population-based study among injured workers in Washington state, 2002-2005. Clin J Pain. 2009, 25 (9): 743-751. 10.1097/AJP.0b013e3181b01710.View ArticlePubMedGoogle Scholar
  2. Webster PC: Medically induced opioid addiction reaching alarming levels. CMAJ. 2012, 184 (3): 285-286. 10.1503/cmaj.109-4088.View ArticlePubMedPubMed CentralGoogle Scholar
  3. Association AP: Diagnostic and statistical manual of mental disorders. 2013, Arlington, VA: American Psychiatric Publishing, 5Google Scholar
  4. Gugelmann HM, Perrone J: Can prescription drug monitoring programs help limit opioid abuse?. JAMA. 2011, 306 (20): 2258-2259.View ArticlePubMedGoogle Scholar
  5. Sproule B, Brands B, Li S, Catz-Biro L: Changing patterns in opioid addiction: characterizing users of oxycodone and other opioids. Can Fam Physician. 2009, 55 (1): 68-69. 69.e61-65PubMedPubMed CentralGoogle Scholar
  6. Nicholls L, Bragaw L, Ruetsch C: Opioid dependence treatment and guidelines. J Manag Care Pharm. 2010, 16 (1 Suppl B): S14-S21.PubMedGoogle Scholar
  7. Dhalla IA, Mamdani MM, Sivilotti ML, Kopp A, Qureshi O, Juurlink DN: Prescribing of opioid analgesics and related mortality before and after the introduction of long-acting oxycodone. CMAJ. 2009, 181 (12): 891-896. 10.1503/cmaj.090784.View ArticlePubMedPubMed CentralGoogle Scholar
  8. National Vital Statistics System (WONDER).http://wonder.cdc.gov/,
  9. CfDCa P: Policy impact: prescription painkiller overdoses. 2013, USA, AtlantaGoogle Scholar
  10. Chong E, Poh KK, Shen L, Yeh IB, Chai P: Infective endocarditis secondary to intravenous Subutex abuse. Singap Med J. 2009, 50 (1): 34-42.Google Scholar
  11. Ho RC, Ho EC, Tan CH, Mak A: Pulmonary hypertension in first episode infective endocarditis among intravenous buprenorphine users: case report. Am J Drug Alcohol Abuse. 2009, 35 (3): 199-202. 10.1080/00952990902939719.View ArticlePubMedGoogle Scholar
  12. Zhang L, Zhang D, Chen W, Zou X, Ling L: High prevalence of HIV, HCV and tuberculosis and associated risk behaviours among new entrants of methadone maintenance treatment clinics in Guangdong Province. China PLoS One. 2013, 8 (10): e76931-10.1371/journal.pone.0076931.View ArticlePubMedGoogle Scholar
  13. Methadone maintenance treatment program standards and clinical guidelines. 2011, Toronto, Canada: The College of Physicians and Surgeons of Ontario, 4Google Scholar
  14. The world health report 2002 — Reducing Risks, Promoting Healthy Life.http://www.who.int/whr/2002/en/,
  15. Ezzati M, Lopez AD, Rodgers A, Vander Hoorn S, Murray CJ: Selected major risk factors and global and regional burden of disease. Lancet. 2002, 360 (9343): 1347-1360. 10.1016/S0140-6736(02)11403-6.View ArticlePubMedGoogle Scholar
  16. Metzger DS, Woody GE, McLellan AT, O'Brien CP, Druley P, Navaline H, DePhilippis D, Stolley P, Abrutyn E: Human immunodeficiency virus seroconversion among intravenous drug users in- and out-of-treatment: an 18-month prospective follow-up. J Acquir Immune Defic Syndr. 1993, 6 (9): 1049-1056.PubMedGoogle Scholar
  17. Zou S, Tepper M, Giulivi A: Current status of hepatitis C in Canada. Can J Public Health. 2000, 91 (Suppl 1): S10-S15. s10–16PubMedGoogle Scholar
  18. Wall R, Rehm J, Fischer B, Brands B, Gliksman L, Stewart J, Medved W, Blake J: Social costs of untreated opioid dependence. J Urban Health. 2000, 77 (4): 688-722. 10.1007/BF02344032.View ArticlePubMedPubMed CentralGoogle Scholar
  19. Oppenheimer E, Tobutt C, Taylor C, Andrew T: Death and survival in a cohort of heroin addicts from London clinics: a 22-year follow-up study. Addiction. 1994, 89 (10): 1299-1308. 10.1111/j.1360-0443.1994.tb03309.x.View ArticlePubMedGoogle Scholar
  20. Seal KH, Kral AH, Gee L, Moore LD, Bluthenthal RN, Lorvick J, Edlin BR: Predictors and prevention of nonfatal overdose among street-recruited injection heroin users in the San Francisco Bay Area, 1998-1999. Am J Public Health. 2001, 91 (11): 1842-1846. 10.2105/AJPH.91.11.1842.View ArticlePubMedPubMed CentralGoogle Scholar
  21. Coutinho RA: HIV and hepatitis C among injecting drug users. BMJ. 1998, 317 (7156): 424-425. 10.1136/bmj.317.7156.424.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Li Y, Kantelip JP, Gerritsen-van Schieveen P, Davani S: Interindividual variability of methadone response: impact of genetic polymorphism. Mol Diagn Ther. 2008, 12 (2): 109-124. 10.1007/BF03256276.View ArticlePubMedGoogle Scholar
  23. Crettol S, Monnat M, Eap CB: Could pharmacogenetic data explain part of the interindividual sensitivity to methadone-induced respiratory depression?. Crit Care. 2007, 11 (1): 119-10.1186/cc5699.View ArticlePubMedPubMed CentralGoogle Scholar
  24. Eap CB, Buclin T, Baumann P: Interindividual variability of the clinical pharmacokinetics of methadone: implications for the treatment of opioid dependence. Clin Pharmacokinet. 2002, 41 (14): 1153-1193. 10.2165/00003088-200241140-00003.View ArticlePubMedGoogle Scholar
  25. Eap CB, Bertschy G, Baumann P, Finkbeiner T, Gastpar M, Scherbaum N: High interindividual variability of methadone enantiomer blood levels to dose ratios. Arch Gen Psychiatry. 1998, 55 (1): 89-90. 10.1001/archpsyc.55.1.89.View ArticlePubMedGoogle Scholar
  26. Yang F, Tong X, McCarver DG, Hines RN, Beard DA: Population-based analysis of methadone distribution and metabolism using an age-dependent physiologically based pharmacokinetic model. J Pharmacokinet Pharmacodyn. 2006, 33 (4): 485-518. 10.1007/s10928-006-9018-0.View ArticlePubMedGoogle Scholar
  27. Fischer B, Chin AT, Kuo I, Kirst M, Vlahov D: Canadian illicit opiate users' views on methadone and other opiate prescription treatment: an exploratory qualitative study. Subst Use Misuse. 2002, 37 (4): 495-522. 10.1081/JA-120002807.View ArticlePubMedGoogle Scholar
  28. Simon-Sanchez J, Singleton AB: Sequencing analysis of OMI/HTRA2 shows previously reported pathogenic mutations in neurologically normal controls. Hum Mol Genet. 2008, 17 (13): 1988-1993. 10.1093/hmg/ddn096.View ArticlePubMedPubMed CentralGoogle Scholar
  29. Mendelson J, Jones RT, Welm S, Baggott M, Fernandez I, Melby AK, Nath RP: Buprenorphine and naloxone combinations: the effects of three dose ratios in morphine-stabilized, opiate-dependent volunteers. Psychopharmacology (Berl). 1999, 141 (1): 37-46. 10.1007/s002130050804.View ArticleGoogle Scholar
  30. Bell J, Byron G, Gibson A, Morris A: A pilot study of buprenorphine-naloxone combination tablet (Suboxone) in treatment of opioid dependence. Drug Alcohol Rev. 2004, 23 (3): 311-317. 10.1080/09595230412331289473.View ArticlePubMedGoogle Scholar
  31. Orman JS, Keating GM: Buprenorphine/naloxone: a review of its use in the treatment of opioid dependence. Drugs. 2009, 69 (5): 577-607. 10.2165/00003495-200969050-00006.View ArticlePubMedGoogle Scholar
  32. Whelan PJ, Remski K: Buprenorphine vs methadone treatment: A review of evidence in both developed and developing worlds. J Neurosci Rural Pract. 2012, 3 (1): 45-50. 10.4103/0976-3147.91934.View ArticlePubMedPubMed CentralGoogle Scholar
  33. Curcio F, Franco T, Topa M, Baldassarre C: Buprenorphine/naloxone versus methadone in opioid dependence: a longitudinal survey. Eur Rev Med Pharmacol Sci. 2011, 15 (8): 871-874.PubMedGoogle Scholar
  34. Sullivan MA, Bisaga A, Mariani JJ, Glass A, Levin FR, Comer SD, Nunes EV: Naltrexone treatment for opioid dependence: does its effectiveness depend on testing the blockade?. Drug Alcohol Depend. 2013, 133 (1): 80-85. 10.1016/j.drugalcdep.2013.05.030.View ArticlePubMedPubMed CentralGoogle Scholar
  35. FDA approves Perjeta for neoadjuvant breast cancer treatment.http://www.fda.gov/newsevents/newsroom/pressannouncements/ucm370393.htm,
  36. Comer SD, Sullivan MA, Yu E, Rothenberg JL, Kleber HD, Kampman K, Dackis C, O'Brien CP: Injectable, sustained-release naltrexone for the treatment of opioid dependence: a randomized, placebo-controlled trial. Arch Gen Psychiatry. 2006, 63 (2): 210-218. 10.1001/archpsyc.63.2.210.View ArticlePubMedPubMed CentralGoogle Scholar
  37. Krupitsky E, Zvartau E, Woody G: Use of naltrexone to treat opioid addiction in a country in which methadone and buprenorphine are not available. Curr Psychiatry Rep. 2010, 12 (5): 448-453. 10.1007/s11920-010-0135-5.View ArticlePubMedPubMed CentralGoogle Scholar
  38. Gibson AE, Degenhardt LJ: Mortality related to pharmacotherapies for opioid dependence: a comparative analysis of coronial records. Drug Alcohol Rev. 2007, 26 (4): 405-410. 10.1080/09595230701373834.View ArticlePubMedGoogle Scholar
  39. Oviedo-Joekes E, Brissette S, Marsh DC, Lauzon P, Guh D, Anis A, Schechter MT: Diacetylmorphine versus methadone for the treatment of opioid addiction. N Engl J Med. 2009, 361 (8): 777-786. 10.1056/NEJMoa0810635.View ArticlePubMedGoogle Scholar
  40. Nosyk B, Guh DP, Bansback NJ, Oviedo-Joekes E, Brissette S, Marsh DC, Meikleham E, Schechter MT, Anis AH: Cost-effectiveness of diacetylmorphine versus methadone for chronic opioid dependence refractory to treatment. CMAJ. 2012, 184 (6): E317-E328. 10.1503/cmaj.110669.View ArticlePubMedPubMed CentralGoogle Scholar
  41. Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20 (1): 37-46. 10.1177/001316446002000104.View ArticleGoogle Scholar
  42. Stroup DFBJ, Morton SC, Olkin I, Williamson GD, Rennie D: Meta-analysis of Observational Studies in Epidemiology. JAMA. 2000, 283 (15): 2008-2012. 10.1001/jama.283.15.2008.View ArticlePubMedGoogle Scholar
  43. Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010, 8 (5): 336-341. 10.1016/j.ijsu.2010.02.007.View ArticlePubMedGoogle Scholar
  44. Wells GA SB, O’Connell D, Peterson J, Welch V, Losos M: The Newcastle-Ottawa Scale (NOS) for assessing the quality if nonrandomized studies in meta-analyses. 2009,Available from URL: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp,Google Scholar
  45. Research Projects: Cochrane Risk of Bias tool.http://bmg.cochrane.org/research-projectscochrane-risk-bias-tool,
  46. Hser YI, Anglin D, Powers K: A 24-year follow-up of California narcotics addicts. Arch Gen Psychiatry. 1993, 50 (7): 577-584. 10.1001/archpsyc.1993.01820190079008.View ArticlePubMedGoogle Scholar
  47. Maas J, Barton G, Maskrey V, Pinto H, Holland R: Economic evaluation: A comparison of methadone versus buprenorphine for opiate substitution treatment. Drug Alcohol Depend. 2013, 133 (2): 494-501. 10.1016/j.drugalcdep.2013.07.018.View ArticlePubMedGoogle Scholar
  48. Mattick RP, Ali R, White JM, O'Brien S, Wolk S, Danz C: Buprenorphine versus methadone maintenance therapy: a randomized double-blind trial with 405 opioid-dependent patients. Addiction (Abingdon, England). 2003, 98 (4): 441-452. 10.1046/j.1360-0443.2003.00335.x.View ArticleGoogle Scholar
  49. Samaan Z, Bawor M, Dennis B, Plater C, Worster A, Varenbut M, Daiter J, Marsh DC, Desai D, Thabane L, Pare G: Genetic influence in methadone dose and response to treatment in patients undergoing Methadone Maintenance Treatment (MMT) for opioid addiction: A pilot study. J Neuropsychiatr Dis Treat. 2014Google Scholar
  50. Fudala PJ, Bridge TP, Herbert S, Williford WO, Chiang CN, Jones K, Collins J, Raisch D, Casadonte P, Goldsmith RJ, Malkerneker U, McNicholas L, Renner J, Stine S, Tusel D, Buprenorphine/Naloxone Collaborative Study Group: Office-based treatment of opiate addiction with a sublingual-tablet formulation of buprenorphine and naloxone. N Engl J Med. 2003, 349 (10): 949-958. 10.1056/NEJMoa022164.View ArticlePubMedGoogle Scholar
  51. Ling W, Amass L, Shoptaw S, Annon JJ, Hillhouse M, Babcock D, Brigham G, Harrer J, Reid M, Muir J, Buchan B, Orr D, Woody G, Kreici J, Ziedonis D, Buprenorphine Study Protocol Group: A multi-center randomized trial of buprenorphine-naloxone versus clonidine for opioid detoxification: findings from the National Institute on Drug Abuse Clinical Trials Network. Addiction. 2005, 100 (8): 1090-1100. 10.1111/j.1360-0443.2005.01154.x.View ArticlePubMedPubMed CentralGoogle Scholar
  52. Hser YI, Saxon AJ, Huang D, Hasson A, Thomas C, Hillhouse M, Jacobs P, Teruya C, McLaughlin P, Wiest K, Cohen A, Ling W: Treatment retention among patients randomized to buprenorphine/naloxone compared to methadone in a multi-site trial. Addiction. 2014, 109 (1): 79-87. 10.1111/add.12333.View ArticlePubMedGoogle Scholar
  53. Deck D, Carlson MJ: Retention in publicly funded methadone maintenance treatment in two Western States. J Behav Health Serv Res. 2005, 32 (1): 43-60. 10.1007/BF02287327.View ArticlePubMedGoogle Scholar
  54. Apelt SM, Scherbaum N, Golz J, Backmund M, Soyka M: Safety, effectiveness and tolerance of buprenorphine-naloxone in the treatment of opioid dependence: results from a nationwide non-interventional study in routine care. Pharmacopsychiatry. 2013, 46 (3): 94-107.View ArticlePubMedGoogle Scholar
  55. Concato J, Shah N, Horwitz RI: Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000, 342 (25): 1887-1892. 10.1056/NEJM200006223422507.View ArticlePubMedPubMed CentralGoogle Scholar
  56. Benson K, Hartz AJ: A comparison of observational studies and randomized, controlled trials. N Engl J Med. 2000, 342 (25): 1878-1886. 10.1056/NEJM200006223422506.View ArticlePubMedGoogle Scholar
  57. The Cochrane Collaboration. The Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. Edited by: Higgins JPT, Green S. 2011Google Scholar
  58. Navarese EP, Kozinski M, Pafundi T, Andreotti F, Buffon A, Servi SD, Kubica J: Practical and updated guidelines on performing meta-analyses of non-randomized studies in interventional cardiology. Cardiol J. 2011, 18 (1): 3-7.PubMedGoogle Scholar
  59. Knapp G, Hartung J: Improved tests for a random effects meta-regression with a single covariate. Stat Med. 2003, 22 (17): 2693-2710. 10.1002/sim.1482.View ArticlePubMedGoogle Scholar
  60. R: RDCT: R: A language for statistical computing. Vienna R Foundation for Statistical Computing.Google Scholar
  61. Cornell JE, Mulrow CD, Localio R, Stack CB, Meibohm AR, Guallar E, Goodman SN: Random-effects meta-analysis of inconsistent effects: a time for change. Ann Intern Med. 2014, 160 (4): 267-270.View ArticlePubMedGoogle Scholar
  62. DerSimonian R, Kacker R: Random-effects model for meta-analysis of clinical trials: an update. Contemp Clin Trials. 2007, 28 (2): 105-114. 10.1016/j.cct.2006.04.004.View ArticlePubMedGoogle Scholar
  63. Mills EJ, Ioannidis JP, Thorlund K, Schunemann HJ, Puhan MA, Guyatt GH: How to use an article reporting a multiple treatment comparison meta-analysis. JAMA. 2012, 308 (12): 1246-1253. 10.1001/2012.jama.11228.View ArticlePubMedGoogle Scholar
  64. Silva PS, Reis ME, Aguiar VE, Fonseca MC: Unplanned extubation in the neonatal ICU: a systematic review, critical appraisal, and evidence-based recommendations. Respir Care. 2013, 58 (7): 1237-1245. 10.4187/respcare.02164.View ArticlePubMedGoogle Scholar
  65. Lumley T: Network meta-analysis for indirect treatment comparisons. Stat Med. 2002, 21 (16): 2313-2324. 10.1002/sim.1201.View ArticlePubMedGoogle Scholar
  66. Veroniki AA, Vasiliadis HS, Higgins JP, Salanti G: Evaluation of inconsistency in networks of interventions. Int J Epidemiol. 2013, 42 (1): 332-345. 10.1093/ije/dys222.View ArticlePubMedGoogle Scholar
  67. Higgins J: Identifying and addressing inconsistency in network meta-analysis. Cochrane Comparing Multiple Interventions Methods Group Oxford Training Event: 2013. 2013, Cochrane CollaborationGoogle Scholar
  68. Dias S, Welton NJ, Caldwell DM, Ades AE: Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010, 29 (7–8): 932-944.View ArticlePubMedGoogle Scholar
  69. Salanti G, Ades AE, Ioannidis JP: Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011, 64 (2): 163-171. 10.1016/j.jclinepi.2010.03.016.View ArticlePubMedGoogle Scholar
  70. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, Norris S, Falck-Ytter Y, Glasziou P, DeBeer H, Jaeschke R, Rind D, Meerpohl J, Dahm P, Schünemann HJ: GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011, 64 (4): 383-394. 10.1016/j.jclinepi.2010.04.026.View ArticlePubMedGoogle Scholar
  71. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Falck-Ytter Y, Jaeschke R, Vist G, Akl EA, Post PN, Norris S, Meerpohl J, Shukla VK, Nasser M, Schünemann HJ, GRADE Working Group: GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol. 2011, 64 (12): 1303-1310. 10.1016/j.jclinepi.2011.04.014.View ArticlePubMedGoogle Scholar

Copyright

© Dennis et al.; licensee BioMed Central Ltd. 2014

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement