N-acetylcysteine for non-paracetamol drug-induced liver injury: a systematic review protocol
© Chughlay et al. 2015
Received: 24 November 2014
Accepted: 5 June 2015
Published: 12 June 2015
Drug-induced liver injury (DILI) refers to acute or chronic liver injury that may occur as a consequence of using drugs and herbal or dietary supplements. Specific therapies for DILI are limited. There is considerable evidence for efficacy and safety of N-acetylcysteine (NAC) in management of paracetamol-induced liver injury. More recently, research has explored the use of NAC in non-paracetamol drug-induced liver injury. It is important to summarise the evidence of NAC for non-paracetamol DILI to determine if NAC may be considered a therapeutic option in this condition.
We will conduct a systematic review of the benefit and harm of NAC in non-paracetamol drug-induced liver injury. Primary and secondary outcomes of interest are pre-specified. Primary outcomes include all-cause mortality, mortality due to DILI, time to normalisation of liver biochemistry (e.g. return of alanine transaminase to <100 U/l and/or international normalized ratio (INR) <1.5) and adverse events. Secondary outcomes include transplantation rate, time to transplantation, transplant-free survival and duration of hospitalisation. We will include randomized controlled trials (RCTs) and prospective cohort studies. RCTs will contribute to the evaluation of safety and efficacy of NAC, whereas, the cohort studies will contribute exclusively to the evaluation of safety. We will search several bibliographic databases (including PubMed, Scopus, CINAHL, CENTRAL), grey literature sources, conference proceedings and ongoing trials. Following data extraction and assessment of the risk of bias, we will conduct a meta-analysis if feasible, as well as subgroup analyses. We will assess and explore clinical and statistical heterogeneity.
The aim of this review is to provide evidence on the effectiveness and safety of NAC in non-paracetamol DILI. We anticipate that the results could aid health care practitioners, researchers and policymakers in the decision-making regarding the use of NAC in patients with non-paracetamol DILI.
Systematic review registration
KeywordsN-acetylcysteine Acetylcysteine Drug-induced Hepatitis Liver Liver failure Non-paracetamol Non-acetaminophen
Drug-induced liver injury (DILI) refers to acute or chronic liver injury that may occur as a consequence of using drugs and herbal or dietary supplements [1, 2]. According to recent estimates, the yearly incidence of DILI is estimated to be between 14–19 cases per 100,000 [3, 4]. While this may suggest that the condition is uncommon, there is still a considerable potential for harm. In the USA, it is the most common cause of acute liver failure, with 11 % of cases due to idiosyncratic DILI . Moreover, the true incidence of DILI may be underestimated due to diagnostic difficulty as well as underreporting .
A number of risk factors are thought to be associated with the development of DILI. In general, older age is a risk factor, with DILI occurring more commonly in adults compared with children . While there seems to be a biological basis for age as a risk factor, it may also reflect that adults are more frequently exposed to potential hepatotoxins compared with children. However, age as a risk factor does not always hold true, such that for certain drugs, the risk is greater in children e.g. DILI caused by valproic acid is more common in children. Females appear to be at a greater risk compared to their male counterparts . Certain genetic variations place individuals at risk of DILI due to specific drugs e.g. isoniazid DILI and N-acetyltransferase 2 gene polymorphism as well as the HLA-*B5701 genotype and flucloxacillin . While these genetic variations have been shown to increase the risk for the development of DILI, they do not predict severity of injury. Pre-existing liver disease is a further independent risk factor, with this being observed in patients coinfected with viral hepatitis and tuberculosis who develop DILI in response to antiviral and antituberculous drugs [9, 10]. Furthermore, alcohol abuse and malnutrition are also risk factors associated with the development of DILI .
The general management of DILI consists of the discontinuation of the offending drug in combination with supportive treatment . Patients often require prolonged hospital stays which may be costly to both patient and health service. Therapeutic re-challenge with the offending drug is generally not recommended but may be attempted in certain instances after a thorough consideration of the risks and potential benefits. There are specific therapies available for DILI caused by certain drugs. However, these are limited to carnitine for valproic acid and N-acetylcysteine (NAC) for paracetamol overdose [11, 12]. This limited availability highlights the need for further research into therapies for DILI.
NAC was first used as a treatment for paracetamol overdose in 1979 . Since then, it has been firmly established as an effective and safe treatment for this condition . NAC has also been shown to be safe and effective outside of paracetamol overdose. NAC has been evaluated as a treatment option for non-paracetamol acute liver failure in adults and paediatric patients. In a randomised clinical trial comparing NAC with placebo in adults with non-paracetamol acute liver failure, NAC was associated with an improvement in transplant-free survival in a subgroup of patients with grade 1 and grade 2 encephalopathy . In a prospective study conducted in adults with non-paracetamol acute liver failure at a centre without the facility for transplantation, the use of NAC was associated with a mortality benefit . In a retrospective study in paediatric patients with non-paracetamol acute liver failure, NAC was associated with a shorter hospital stay and improved survival post-transplantation . Furthermore, in a case series of patients with DILI secondary to Amanita phalloides mushroom poisoning, 10 out of 11 patients recovered fully after receiving NAC in combination with other therapies .
NAC has also been evaluated for non-liver related clinical indications. These indications include its use as a mucolytic agent in pulmonary diseases, in the prevention of radio-contrast associated nephrotoxicity and for the treatment of certain ophthalmic conditions [18–21].
In paracetamol overdose, a form of non-idiosyncratic DILI, the pathogenesis underlying hepatotoxicity is fairly well understood. Here, the metabolism of paracetamol produces an excess of the hepatotoxic metabolite N-acetyl-p-benzo-quinone imine (NAPQI). NAPQI is normally inactivated by hepatic glutathione; however, glutathione is depleted in paracetamol overdose. This results in an accumulation of NAPQI with consequent hepatic cell injury and death. NAC is thought to replenish hepatic glutathione stores, which forms the basis for its efficacy in this condition . In contrast, the mechanism underlying hepatotoxicity in idiosyncratic DILI does not involve glutathione depletion. However, the precise pathogenesis in idiosyncratic DILI is not clearly defined . The proposed pathogenic mechanisms in idiosyncratic DILI include direct cell injury, immune mediated damage and mitochondrial injury. These mechanisms, especially those that lead to mitochondrial damage, have significant implications. Mitochondria are involved in protecting hepatocytes against oxidative stress from oxygen-free radicals in the liver. The damage and loss of mitochondria leads to an accumulation of oxygen-free radicals and subsequent oxidative cell damage. NAC may be of benefit in this context through its antioxidant effect [24, 25]. Furthermore, additional benefits of NAC in this context involve the improvement of systemic haemodynamics and tissue oxygen delivery, as well as other favourable effects on the injured liver [26, 27].
The aim of this systematic review is to review the evidence of safety and effectiveness including improvement in time, if any, to normalisation of liver function tests and of NAC in non-paracetamol drug-induced liver injury. NAC has already been established as a safe and effective treatment for paracetamol-induced liver injury. Recently, the research focus has shifted to investigating the use of NAC in non-paracetamol drug-induced liver injury. It is important to review the evidence of NAC safety and efficacy in this setting to determine if NAC may be considered as a treatment option in non-paracetamol drug-induced liver injury. The evidence from this research may then be used to inform the decisions made by policymakers, health care practitioners, as well as researchers in this area.
This review protocol is registered in the PROSPERO International Prospective Register of systematic reviews, registration number CRD42014008771.
Criteria for considering studies for this review
Types of studies
We will include randomized controlled trials (RCTs) and prospective cohort studies. RCTs will contribute to the evaluation of safety and efficacy of NAC, whereas, the cohort studies will contribute exclusively to the evaluation of safety.
Language and timing
No language and time restrictions will apply.
Types of participants
Types of interventions
Intervention, N-acetylcysteine administered intravenously or orally.
Control, placebo or standard of care (as described in the study) or alternative therapy.
There will be no restriction on dose, timing and route of administration of NAC.
Types of outcome measures
Results must include quantitative data for outcomes measured.
All-cause mortality, mortality due to DILI, time to normalisation of liver biochemistry (e.g. return of alanine transaminase to <100 U/l and/or international normalized ratio (INR) <1.5), adverse events (graded using the Common Terminology Criteria for Adverse Events) .
Transplantation rate, time to transplantation, transplant-free survival, duration of hospitalisation.
Search methods for identification of studies
We will perform a comprehensive search of databases and conference proceedings to identify all relevant studies available by October 2014, regardless of language or publication status. We will search both peer-reviewed journal articles and grey literature (unpublished, internal or non-reviewed papers and reports).
We will search the following electronic databases: Cochrane Library, Medline via PubMed, SCOPUS, Web of Science (SciELO), and EBSCO (CINAHL, Africa-Wide, Academic Search Premier). We will use both text words and medical subject heading (MeSH) terms. The literature search strategy will be adapted to suit each database. Briefly, we will use a combination of the following terms: N-acetylcysteine, Acetylcysteine, Drug-induced, Hepatitis, Liver, Liver Failure, Non-paracetamol, Non-acetaminophen.
The detailed search strategy is provided in Additional file 1.
We will conduct a manual search of relevant abstracts or proceedings of the following conferences (2000 to present): American Association for the Study of Liver Diseases (AASLD) Drug-Induced Liver Injury Conference, AASLD-FDA-NIH-PhRMA-Hepatotoxicity Special Interest Group Conferences, European Association for the Study of Liver (EASL), The International Liver Congress and Digestive Diseases Week (DDW). If conference abstracts are not adequately comprehensive, we will use the information from these abstracts to search for the full text articles. We will attempt to contact the authors of the conference abstracts if we are unable to track down the full text articles. If we are unable to obtain the full text articles and contact the authors, we will list the studies as potentially relevant.
We will obtain reference lists of relevant studies identified, and the full text articles reviewed for inclusion in the review will be checked for additional information.
Searching other sources
Grey Literature will include Google Scholar, SCOPUS for conference proceedings. www.opengrey.eu and www.greylit.org. For ongoing studies, we will search the Pan African National Clinical Trials Registry (PACTR), World Health Organisation (WHO) International Clinical Trials Registry Platform (ICTRP), and ClinicalTrials.gov and NHS Clinical Trials. Individuals and organisations working in the field of drug-induced liver injury will be consulted for information regarding unpublished data and work in progress.
Data collection and analysis
The methods for data collection and analysis will be based on the Cochrane Handbook of Systematic Reviews for Interventions .
Selection of studies
Two review authors (MFC and NK) will independently review all relevant material identified from the above search. After reading the titles and abstracts of the identified articles, we will acquire the full text articles of all citations deemed to meet the inclusion criteria. These articles will be independently inspected to verify that they meet the pre-specified inclusion criteria. We will resolve disagreements between the two reviewers regarding study eligibility through discussion with a third author (KC). For all studies excluded by the assessors, we will describe the reasons for exclusion.
Data extraction and management
MFC and NK will use a standardised data extraction form to extract data from the included studies and to assess the study quality. Extracted information will include administrative details, verification assessment of the diagnosis of DILI, details of the intervention, details of comparators, details of outcomes and information for assessment of the risk of bias. A pilot data extraction will be performed using the data extraction form, and the form will be modified if required. Any discrepancies will be resolved via discussion of the original articles with a third author (KC). We will request missing data from study authors. References will be managed using Mendeley Desktop reference manager and data will be analysed using Review Manager 5.3 (RevMan5) software. MFC and NK will both enter data and conduct crosschecks to ensure that there are no data entry errors.
Assessment of risk of bias in included studies
MFC and NK will independently assess the risk of bias in each of the included studies. The assessment will include information on the following: sequence generation, allocation concealment, blinding, incomplete outcome data or missing data, selective outcome reporting, other sources of bias and overall risk of bias. Each methodological component will be assessed, and the RCTs will be described as having a low, unclear or high risk of bias, as per the Cochrane Handbook of Systematic Reviews of Interventions . The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta-analyses tool will be used for assessing the risk of bias of the included cohort studies . More specifically, we will use an adapted version of the modified NOS (see Additional file 2) to assess the risk of bias of the included cohort studies . This modified NOS includes seven questions amongst four domains of risk assessment: methods for selecting study participants (selection bias), methods to control for confounding (performance bias), statistical methods (detection bias) and methods of exposure and outcome assessment (information bias). Risk of bias will be measured using a scale ranging from 0 (high risk of bias) to 3 (low risk of bias), and question-specific descriptions including examples of varying degrees of bias are included. Items from the original NOS pertaining to adequacy of follow-up, selection of participants (representativeness of cohort) and assessment of outcomes will be retained in the adapted modified NOS.
The two authors will resolve disagreements in the assessment of risk of bias by discussion and consensus, consulting KC to resolve any persistent disagreements.
Measures of treatment effect
Data will be analysed using RevMan5. The type of outcomes may include dichotomous, continuous and time-to-event data. For dichotomous data, a summary statistic will be calculated (e.g. odds ratio and risk ratio) with accompanying confidence interval (e.g. 95 % CI). For continuous data, a summary statistic such as a mean difference or standardised mean difference will be calculated. Two methods of summarising the time-to-event data will be considered. The first will use the methods of survival analysis and express the intervention effect as a hazard ratio. For the second method, the time-to-event data may be analysed as dichotomous data if the status of all study participants at a fixed time point are known and further summarised as an odds ratio or risk ratio with accompanying confidence interval. Every effort will be made to contact the original authors or investigators of the selected articles to assist with missing or incomplete data.
Dealing with missing data
In the cases of absent or incomplete evidence found in the included studies, authors will be contacted for further information. We will report unclear issues as presented rather than make assumptions. Should they be necessary, we will be explicit about assumptions made.
Data synthesis, assessment/investigation of heterogeneity
0–40 % = might not be important
30–60 % = moderate
50–90 % = substantial
75–100 % = considerable
Where heterogeneity is statistically significant, subgroup analysis using the variables of age group, sex and setting (e.g. geographical region), as well as sensitivity analysis, will be conducted to explore the potential sources of heterogeneity. Symmetry of funnel plots will be used to assess for publication or selective reporting bias.
We will attempt primary meta-analyses of the included RCTs for both effectiveness and harm outcomes. If meta-analysis of RCTs is feasible, a random effects model will be constructed. We plan to quantify the statistical reliability of data in the cumulative meta-analysis by undertaking sequential analysis. Should small study effects be found, we will conduct a meta-regression on small study effects. If the identified RCTs are of substantial heterogeneity rendering meta-analysis not feasible, the findings will be presented in narrative form and will include relevant tables and figures to aid in data presentation. We will consider conducting separate secondary meta-analyses for prospective cohort studies limited to the outcomes of harm. If this is not feasible, the findings from the included cohort studies will be presented in a narrative form. All authors will contribute to the narrative review.
In addition to evaluating all DILI participants, we also plan to explore differences in outcomes between the following subgroups: sex, age strata, geographical region, diagnostic certainty of DILI and exclusion of other possible causes, aetiology of DILI (e.g. antituberculous, HIV antiretrovirals, antiepileptics, herbal supplements), coma grade, severity of DILI (using severity scales such as Drug-Induced Liver Injury Network 5-point scale where severity of liver injury is based upon the presence of jaundice, hospitalisation, signs of hepatic or other organ failure, ultimate outcome and graded as 1+ mild, 2+ moderate, 3+ moderate-severe, 4+ severe, 5+ fatal) and pattern of liver injury (hepatocellular, mixed and cholestatic). For the analyses of outcomes within subgroups, the same methods of analyses for measuring treatment effects as a whole will be applied.
We will use the grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to assess the quality of evidence .
A sensitivity analysis of the findings from primary meta-analysis is planned, and the aim is to determine whether the findings are robust to decisions made during the review process . Amongst others, we will explore the impact of including or excluding particular studies and the chosen method for analysis. Lastly, we will also evaluate the impact of excluding studies deemed as having a high risk of bias.
Presenting and reporting of results
This systematic review will be reported according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement .
This review will provide evidence on the effectiveness and safety of NAC in non-paracetamol DILI. We anticipate that the findings could aid health care practitioners and policymakers in the decision-making regarding the use of NAC in patients with non-paracetamol DILI. Furthermore, the findings may benefit researchers by providing guidance for the focus of future research through the identification of gaps in the existing evidence and advise on the conduct of future high-quality research through the identification of the shortcomings in previously conducted research.
Digestive Diseases Week
drug-induced liver injury
European Association for the Study of Liver
International Clinical Trials Registry Platform
international normalized ratio
Pan African National Clinical Trials Registry
randomized controlled trial
World Health Organization
The research team would like to acknowledge of the following:
● Sameera Allie for her editorial support and valuable input during protocol development
● The critical input and support of the University of Cape Town (UCT) Evidence-based Medicine Research Support Unit funding through the Incentivising research in the Faculty of Health Sciences funding scheme
● Tamzyn Suliaman from the UCT Health Sciences Library, as well as Tamara Kredo and Joy Oliver from the South African Cochrane Centre, for assisting with the development of the search strategy.
- Davern TJ. Drug-induced liver disease. Clin Liver Dis. 2012;16:231–45.View ArticlePubMedGoogle Scholar
- Leise MD, Poterucha JJ, Talwalkar JA. Drug-induced liver injury. Mayo Clin Proc. 2014;89:95–106.View ArticlePubMedGoogle Scholar
- Björnsson ES, Bergmann OM, Björnsson HK, Kvaran RB, Olafsson S. Incidence, presentation, and outcomes in patients with drug-induced liver injury in the general population of Iceland. Gastroenterology. 2013;144:1419–25. 1425.e1–3; quiz e19–20.View ArticlePubMedGoogle Scholar
- Sgro C, Clinard F, Ouazir K, Chanay H, Allard C, Guilleminet C, et al. Incidence of drug-induced hepatic injuries: a French population-based study. Hepatology. 2002;36:451–5.View ArticlePubMedGoogle Scholar
- Navarro VJ, Senior JR. Drug-related hepatotoxicity. N Engl J Med. 2006;354:731–9.View ArticlePubMedGoogle Scholar
- Abboud G, Kaplowitz N. Drug-induced liver injury. Drug Saf. 2007;30:277–94.View ArticlePubMedGoogle Scholar
- Chalasani N, Fontana RJ, Bonkovsky HL, Watkins PB, Davern T, Serrano J, et al. Causes, clinical features, and outcomes from a prospective study of drug-induced liver injury in the United States. Gastroenterology. 2008;135:1924–34. 1934.e1–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Huang Y-S, Chern H-D, Su W-J, Wu J-C, Lai S-L, Yang S-Y, et al. Polymorphism of the N-acetyltransferase 2 gene as a susceptibility risk factor for antituberculosis drug-induced hepatitis. Hepatology. 2002;35:883–9.View ArticlePubMedGoogle Scholar
- Wong WM, Wu PC, Yuen MF, Cheng CC, Yew WW, Wong PC, et al. Antituberculosis drug-related liver dysfunction in chronic hepatitis B infection. Hepatology. 2000;31:201–6.View ArticlePubMedGoogle Scholar
- Sulkowski MS, Thomas DL, Chaisson RE, Moore RD. Antiretroviral therapy in adults infected with human immunodeficiency virus and the role of hepatitis C or B virus infection. JAMA. 2000;283:74–80.View ArticlePubMedGoogle Scholar
- Lheureux PER, Hantson P. Carnitine in the treatment of valproic acid-induced toxicity. Clin Toxicol (Phila). 2009;47:101–11.View ArticlePubMedGoogle Scholar
- Brok J, Buckley N, Gluud C. Interventions for paracetamol (acetaminophen) overdose. Cochrane Database Syst Rev. 2006:CD003328.
- Prescott LF, Illingworth RN, Critchley JA, Stewart MJ, Adam RD, Proudfoot AT. Intravenous N-acetylcystine: the treatment of choice for paracetamol poisoning. Br Med J. 1979;2:1097–100.View ArticlePubMedPubMed CentralGoogle Scholar
- Lee WM, Hynan LS, Rossaro L, Fontana RJ, Stravitz RT, Larson AM, et al. Intravenous N-acetylcysteine improves transplant-free survival in early stage non-acetaminophen acute liver failure. Gastroenterology. 2009;137:856–64. 864.e1.View ArticlePubMedPubMed CentralGoogle Scholar
- Mumtaz K, Azam Z, Hamid S, Abid S, Memon S, Ali Shah H, et al. Role of N-acetylcysteine in adults with non-acetaminophen-induced acute liver failure in a center without the facility of liver transplantation. Hepatol Int. 2009;3:563–70.View ArticlePubMedPubMed CentralGoogle Scholar
- Kortsalioudaki C, Taylor RM, Cheeseman P, Bansal S, Mieli-Vergani G, Dhawan A. Safety and efficacy of N-acetylcysteine in children with non-acetaminophen-induced acute liver failure. Liver Transpl. 2008;14:25–30.View ArticlePubMedGoogle Scholar
- Montanini S, Sinardi D, Praticò C, Sinardi A. Use of acetylcysteine as the life-saving antidote in Amanita phalloides (death cap) poisoning. Case report on 11 patients. Arzneimittelforschung. 1999;49:1044–7.PubMedGoogle Scholar
- Nair GB, Ilowite JS. Pharmacologic agents for mucus clearance in bronchiectasis. Clin Chest Med. 2012;33:363–70.View ArticlePubMedGoogle Scholar
- Fishbane S. N-acetylcysteine in the prevention of radiocontrast-induced nephropathy. J Am Soc Nephrol. 2004;15:251–60.View ArticlePubMedGoogle Scholar
- Yalçin E, Altin F, Cinhüseyinoglue F, Arslan MO. N-acetylcysteine in chronic blepharitis. Cornea. 2002;21:164–8.View ArticlePubMedGoogle Scholar
- Akyol-Salman I, Azizi S, Mumcu U, Baykal O. Efficacy of topical N-acetylcysteine in the treatment of meibomian gland dysfunction. J Ocul Pharmacol Ther. 2010;26:329–33.View ArticlePubMedGoogle Scholar
- Smilkstein MJ, Bronstein AC, Linden C, Augenstein WL, Kulig KW, Rumack BH. Acetaminophen overdose: a 48-hour intravenous N-acetylcysteine treatment protocol. Ann Emerg Med. 1991;20:1058–63.View ArticlePubMedGoogle Scholar
- Suk KT, Kim DJ. Drug-induced liver injury: present and future. Clin Mol Hepatol. 2012;18:249–57.View ArticlePubMedPubMed CentralGoogle Scholar
- Smilkstein MJ, Knapp GL, Kulig KW, Rumack BH. Efficacy of oral N-acetylcysteine in the treatment of acetaminophen overdose. Analysis of the National Multicenter Study (1976 to 1985). N Engl J Med. 1988;319:1557–62.View ArticlePubMedGoogle Scholar
- Harrison PM, Keays R, Bray GP, Alexander GJM, Williams R. Improved outcome of paracetamol-induced fulminant hepatic failure by late administration of acetylcysteine. Lancet. 1990;335:1572–3.View ArticlePubMedGoogle Scholar
- Harrison P, Wendon J, Williams R. Evidence of increased guanylate cyclase activation by acetylcysteine in fulminant hepatic failure. Hepatology. 1996;23:1067–72.View ArticlePubMedGoogle Scholar
- Keays R, Harrison PM, Wendon JA, Forbes A, Gove C, Alexander GJ, et al. Intravenous acetylcysteine in paracetamol induced fulminant hepatic failure: a prospective controlled trial. BMJ. 1991;303:1026–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Danan G, Benichou C. Causality assessment of adverse reactions to drugs—I. A novel method based on the conclusions of international consensus meetings: application to drug-induced liver injuries. J Clin Epidemiol. 1993;46:1323–30.View ArticlePubMedGoogle Scholar
- Benichou C, Danan G, Flahault A. Causality assessment of adverse reactions to drugs—II. An original model for validation of drug causality assessment methods: case reports with positive rechallenge. J Clin Epidemiol. 1993;46:1331–6.View ArticlePubMedGoogle Scholar
- Maria VA, Victorino RM. Development and validation of a clinical scale for the diagnosis of drug-induced hepatitis. Hepatology. 1997;26:664–9.View ArticlePubMedGoogle Scholar
- Agarwal VK, McHutchison JG, Hoofnagle JH. Important elements for the diagnosis of drug-induced liver injury. Clin Gastroenterol Hepatol. 2010;8:463–70.View ArticlePubMedPubMed CentralGoogle Scholar
- National Cancer Institute Common Terminology Criteria for Adverse Events v4.0 NCI, NIH, DHHS. May 29, 2009 NIH publication # 09–7473
- Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 [updated March 2011].
- Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses; 2008. http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed 16 Jan 2015.
- Bawor M, Dennis BB, Anglin R, Steiner M, Thabane L, Samaan Z. Sex differences in outcomes of methadone maintenance treatment for opioid addiction: a systematic review protocol. Syst Rev. 2014;3(1):45.View ArticlePubMedPubMed CentralGoogle Scholar
- Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64:401–6.View ArticlePubMedGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.