Skip to main content

Table 1 Tools and checklists to aid in systematic review conduct and to assess the reporting, quality of conduct or the risk of bias in a review

From: Methodological review of NMA bias concepts provides groundwork for the development of a list of concepts for potential inclusion in a new risk of bias tool for network meta-analysis (RoB NMA Tool)

Tool purpose

Examples of tools or checklists

Description of an example tool

Targeted users

Available tool for reviews with NMA

Guidance for conducting systematic reviews

MECIR [9]

Detailed guidance for the conduct of systematic reviews of interventions, diagnostic test accuracy, individual patient data, public health and health promotion

• Review authors

• Journal editors

No

Assess the quality of conduct of reviews

AMSTAR-2 [17, 18], OQAQ [19]

AMSTAR-2 is a critical appraisal tool to assess the conduct of intervention reviews including RCTs

The 1991 Overview Quality Assessment Questionnaire (OQAQ) is a methodological quality of conduct checklist

• Review authors

• Decision makers

No

Assess the risk of bias in published reviews

ROBIS [10]

ROBIS is a tool for assessing the risk of bias in reviews. It is aimed at four broad categories of reviews mainly within health care settings: interventions, diagnosis, prognosis and etiology

• Decision makers

Not at present, but in the process RoB NMA tool

Assess the certainty in the evidence and the strength of recommendations in health care

GRADE [20]

The GRADE working group defined the certainty of a body of evidence as the extent to which one can be confident that a pooled effect estimate is close to the true effect of the intervention. Five domains were assessed: risk of bias, inconsistency, indirectness, imprecision and publication bias

• Review authors

GRADE-NMA [21, 22], CINeMA, [23], Threshold method [24]

Guidelines for the complete reporting of published reviews

PRISMA Update [25]

PRISMA focuses on the reporting of already published reviews evaluating RCTs of interventions. PRISMA can determine whether a review is well described and transparently reported

• Decision makers

• Journal editors

PRISMA-NMA [14], ISPOR [15]

  1. AMSTAR-2 A Measurement Tool to Assess Systematic Reviews 2, CINeMA Confidence in Network Meta-Analysis, GRADE Grading of Recommendations Assessment, Development and Evaluation, GRADE-NMA Grading of Recommendations Assessment, Development and Evaluation for Network Meta-Analysis, ISPOR International Society for Pharmacoeconomics and Outcomes Research, MECIR Methodological Expectations of Cochrane Intervention Reviews, OQAQ Overview Quality Assessment Questionnaire, PRISMA Preferred Reporting Items for Systematic Reviews and Meta-Analyses, RCT randomised controlled trial, ROBIS Risk Of Bias In Systematic Reviews