Protocol | Open | Open Peer Review | Published:
Safety, effectiveness, and cost of dipeptidyl peptidase-4 inhibitors versus intermediate acting insulin for type 2 diabetes: protocol for a systematic review and network meta-analysis
Systematic Reviewsvolume 2, Article number: 47 (2013)
Type 2 diabetes mellitus (T2DM) results from insulin resistance and relative insulin deficiency. T2DM treatment is a step-wise approach beginning with lifestyle modifications (for example, diet, exercise), followed by the addition of oral hypoglycemic agents (for example, metformin). Patients who do not respond to first-line therapy are offered second-line therapy (for example, sulfonylureas). Third-line therapy may include insulin and/or dipeptidyl peptidase-4 (DPP-4) inhibitors.
It is unclear whether DPP-4 inhibitors are safer and more effective than intermediate acting insulin for third-line management of T2DM. As such, our objective is to evaluate the comparative effectiveness, safety and cost-effectiveness of DPP-4 inhibitors versus intermediate acting insulin for T2DM patients who have failed both first- and second-line diabetes treatments.
Electronic searches of MEDLINE, Cochrane Central Register of Controlled Trials, EMBASE, and grey literature (for example, trial registries, public health websites) will be conducted to identify studies examining DPP-4 inhibitors compared with each other, intermediate acting insulin, no treatment, or placebo for adults with T2DM. The outcomes of interest include glycosylated hemoglobin (A1C) (primary outcome), as well as emergency department visits, physician visits, hospital admissions, weight gain, quality of life, microvascular complications, macrovascular complications, all-cause mortality, and cost (secondary outcomes). Randomized clinical trials (RCTs), quasi-RCTs, non-RCTs, controlled before-after, interrupted time series, cohort studies, and cost studies reporting data on these outcomes will be included. Eligibility will not be restricted by publication status, language of dissemination, duration of study follow-up, or time period of study conduct.
Two reviewers will screen the titles and abstracts resulting from the literature search, as well as potentially relevant full-text articles, in duplicate. Data will be abstracted and quality will be appraised by two team members independently. Conflicts at all levels of screening and abstraction will be resolved through team discussion.
Our results will be described narratively. Random effects meta-analysis and network meta-analysis will be conducted, if feasible and appropriate.
Our systematic review results can be used to determine the most effective, safe and cost-effective third-line strategies for managing T2DM. This information will be of great use to health policy-makers and clinicians, as well as patients living with T2DM and their families.
Systematic review registration
PROSPERO registry number: CRD42013003624
Type 2 diabetes mellitus (T2DM) is a chronic condition characterized by insulin deficiency and impaired beta-cell function . T2DM is the most common type of diabetes, accounting for 90% to 95% of all cases worldwide . Over the past few decades, there has been a steady increase in the incidence and prevalence of T2DM, and it is estimated that 300 million individuals will have T2DM globally by 2025 . These increased rates have been attributed to the aging population, obesity and a sedentary lifestyle .
First-line management of T2DM begins with lifestyle modifications, including diet and exercise, followed by the addition of pharmacological interventions in the form of oral hypoglycemic agents, namely metformin [5, 6]. If these interventions are not successful, other oral hypoglycemic agents are usually initiated, with sulfonylureas being the medication of choice due to efficacy, availability and cost [6, 7]. However, second-line management does not result in sustained diabetes control for all patients . For these patients, third-line therapy with dipeptidyl peptidase-4 inhibitors (DPP-4 inhibitors; for example, sitagliptin, saxagliptin, linagliptin, vildagliptin) might offer hope.
DPP-4 inhibitors act by influencing glucagon-like peptide (GLP-1). GLP-1 is an incretin hormone released into circulation in response to nutrients. GLP-1 stimulates insulin secretion and decreases glucagon secretion . It has a short half-life of one to two minutes and is rapidly broken down by DPP-4. DPP-4 inhibitors prevent the degradation of GLP-1 and thus, increase the action of incretin hormones . However, DPP-4 is also responsible for the breakdown of other hormones and its inhibition has the potential to cause adverse events. As such, a key question posed by Canadian decision-makers pertains to which agents should be used for third-line therapy in patients whose glycosylated hemoglobin (A1C) level remains elevated. In particular, what are the comparative safety, effectiveness and cost-effectiveness of DPP-4 inhibitors compared with intermediate acting insulin for adults with T2DM?
A systematic review protocol was compiled, circulated for feedback from Canadian policy-makers, clinicians and systematic review methodologists, and revised as necessary. Subsequently, our protocol was registered with the PROSPERO database (CRD42013003624). Our systematic review plan conforms to the Preferred Reporting Items for Systematic reviews and Meta-analyses Protocols (or PRISMA-P) initiative . Our methods are similar to a systematic review on type 1 diabetes mellitus that was submitted as a protocol publication to the Systematic Reviews journal (Tricco et al., personal communication), and will be described briefly here.
Adults (≥18 years old) with T2DM who have used or are currently using metformin and another second-line agent (for example, sulfonylureas, glitazones, GLP-1 analogues, glinides, alpha-glucosidase) and have A1C ≥6.5%.
DPP-4 inhibitors, including sitagliptin, vildagliptin, saxagliptin, and linagliptin.
DPP-4 inhibitors compared with each other, intermediate-acting insulin (for example, neutral protamine Hagedorn (NPH), lente), no treatment, or placebo.
The primary outcome is A1C, while secondary outcomes include emergency department visits (ED), physician visits, hospital admissions, weight gain/loss, fractures, infections (for example, nasopharyngitis, pancreatitis), quality of life, microvascular complications (retinopathy, neuropathy, nephropathy), macrovascular complications (cardiovascular disease, stroke/transient ischemic attack, peripheral vascular disease), all-cause mortality, cost and cost-effectiveness.
Experimental studies (randomized clinical trials (RCTs), quasi-RCTs, non-RCTs), quasi-experimentalstudies (controlled before after studies, interrupted time series), observational (cohort) studies and cost studies.
No other limitations will be imposed. As such, unpublished studies, studies written in all languages, studies of all durations and those conducted during all points in time are eligible for inclusion.
Information sources and literature search
We will search a variety of sources to identify literature relevant to our PICOS criteria described above. First, we will search electronic databases (MEDLINE, EMBASE, and the Cochrane Central Register of Controlled Trials). Second, we will search for unpublished material via clinical trial registries (for example, World Health Organization International Clinical Trials Search Portal), public health agency websites (for example, Public Health Agency of Canada, Health Canada), drug regulatory organization websites (for example, Food and Drug Administration (FDA)), and conduct general searches in Google Scholar. Third, we will use other methods to ensure literature saturation, including searching the authors’ personal files, contacting DPP-4 inhibitor manufacturers, scanning the reference lists of included studies and relevant reviews [9, 12], and contacting authors who publish frequently on T2DM and DPP-4 inhibitors.
All of the information sources will be searched by an experienced librarian affiliated with the Li Ka Shing Knowledge Institute of St. Michael’s Hospital. She has compiled a draft search for the MEDLINE database (OVID interface), which is presented in Additional file 1. This will be peer reviewed by another expert librarian affiliated with the Centre for Practice-Changing Research of the Ottawa Hospital Research Institute. She will use the Peer Review of Electronic Search Strategies (PRESS) checklist  for this process.
Study selection process
We will pilot-test our screening criteria developed a priori among the team. We will develop a ‘cheat sheet’ with detailed definitions and examples to ensure high inter-rater reliability (that is, a kappa statistic ≥0.60 ) among the team. The eligibility criteria and cheat sheet will be revised, as necessary. After this calibration exercise, two team members will screen all of the literature search results in duplicate. Conflicts will be resolved by discussion among the team. The same process will be followed for potentially relevant full-text articles, as the screening criteria are slightly different for this level of screening [see Additional file 1]. All screening will be conducted using the online SysRev Tool , proprietary software developed by the Li Ka Shing Knowledge Institute of St. Michael’s Hospital.
Data items and data collection process
To synthesize information on study characteristics, we will abstract data on the study design, country of conduct, year of conduct, DPP-4 inhibitor examined, and comparator(s) examined for each of the included studies. To summarize patient characteristics, we will abstract the type and number of patients, age (mean and standard deviation), baseline A1C, and co-morbidities for the included studies. Finally, we will abstract the results of the outcomes of interest, such as A1C, ED visits, physician visits, quality of life, adverse events, and cost at 6, 12 and 24 months, as well as the longest duration of follow-up.
To abstract the data, the team will use a rigorous process. A draft data abstraction form and ‘cheat sheet’ will be circulated among the team. Using a random sample of five to ten of the included studies, the data abstraction form will be pilot-tested by all team members. The form will be revised, as necessary, and data abstraction will begin when high inter-rater reliability (that is, a kappa statistic ≥0.60 ) has been achieved. Subsequently, two team members will abstract all of the included studies independently. Conflicts will be resolved by discussion.
We anticipate some challenges that might occur during the data abstraction process. For example, sometimes duplicate publications (or companion reports) that use data from the same group of patients are difficult to identify. To ensure the data is not double-counted in meta-analysis , the team will sort through the included studies to identify companion reports. We may also encounter poorly reported information and will have to contact authors for data clarifications when this occurs.
Methodological quality/risk of bias appraisal
We will appraise the methodological quality or risk of bias of the included studies using tools that have been developed to assess the internal validity of different study designs. For example, the Newcastle-Ottawa scale was developed to appraise the methodological quality of observational studies, such as cohort studies . The Cochrane Effective Practice and Organisation of Care Risk of Bias Tool was developed to assess the risk of bias of experimental and quasi-experimental studies . We will also appraise publication bias using funnel plots  and studies reporting harms will be assessed using the McHarm tool . All quality appraisal and risk of bias assessment will be conducted by two team members independently and conflicts will be resolved through team discussion.
Synthesis of included studies
To synthesize our results, we will summarize all of the abstracted data. For example, we will provide overall summaries for each of the following: study characteristics, patient characteristics, methodological quality appraisal, and risk of bias assessment. We will observe the number of studies available for each of the outcomes examined, study designs by outcome, as well as the total number of patients included in the studies that report each outcome.
We will subsequently determine whether a random-effects meta-analysis  is feasible and appropriate. In order to assess this, we will examine the level of clinical, methodological, and statistical heterogeneity. The first two types of heterogeneity will be examined using the clinical and methodological insight of the research team. The third type of heterogeneity will be examined by looking for outliers in the forest plots, as well as by calculating an I2 statistic . An I2 statistic ≥60% usually signifies moderate-to-high statistical heterogeneity .
If heterogeneity is identified and we have included at least 10 studies, we will conduct a meta-regression analysis to explain the observed heterogeneity . Our meta-regression analysis will explore the influence of the following factors on our results: baseline A1C values (source of statistical heterogeneity); age, duration of diabetes (sources of clinical heterogeneity); and study quality (source of methodological heterogeneity). The frequentist meta-analysis and meta-regression analysis will be conducted in SAS Version 9.2 .
We anticipate that some of the included studies will not report measures of variance, including standard deviations, standard errors and 95% confidence intervals for continuous effect sizes. To make use of all existing data, these will be imputed using established methods . The impact of these imputations will be calculated via a sensitivity analysis, which will allow the examination of missing data under both random and nonrandom assumptions .
After we have conducted the frequentist meta-analysis, we will attempt to conduct a network meta-analysis using WinBUGS . For this analysis, median rankings (or effect sizes) and 95% credible intervals (interpreted the same way as 95% confidence intervals through frequentist methods) will be calculated . A random effects network meta-analysis will be conducted, including all available direct and indirect data , as well as data from experimental, quasi-experimental, and observational (cohort) study designs. We will examine trace and history plots and calculate the Gelman Rubin statistic . Consistency of results will be examined by comparing the frequentist meta-analysis results to those obtained through network meta-analysis, as well as using established statistical methods [30, 31].
Finally, we will conduct numerous sensitivity analyses to test the robustness of our results. Examples include observing the influence of attrition, high risk of bias, and inclusion of different study designs (for example, cohort, quasi-experimental). We will also conduct a sensitivity analysis on the use of different priors for variance parameters included in the Bayesian network meta-analysis .
Our systematic review results have the potential to impact a large proportion of the population. The incidence of T2DM is increasing globally and it is estimated that 300 million individuals will have T2DM by 2025 . Most patients with T2DM require second-line therapy , and some of these patients also require third-line treatment with DPP-4 inhibitors. Previous reviews of DPP-4 inhibitors have not specifically compared these agents with intermediate acting insulin [9, 12]. This important topic was identified directly by health decision-makers in Canada.
Our systematic review results will be of great interest to key stakeholders, including the Canadian Drug Safety and Effectiveness Network, policy makers, researchers, clinicians (for example, College of Family Physicians) and patients. In addition to our integrated knowledge translation approach, a spectrum of end of grant knowledge translation strategies will be utilized. These will range from passive dissemination via publication in open-access journals and creation of knowledge tools, to more active activities, such as providing educational sessions. We will also hold an in-person dissemination meeting with key stakeholders, as well as create a one-page executive summary specifically targeting patients, policy-makers and clinicians.
Food and Drug Administration
Peer review of electronic search strategies
Preferred reporting items for systematic reviews and meta-analyses protocols
randomized clinical trial
type 2 diabetes mellitus.
Kahn SE, Porte D: The pathophysiology of type II (non-insulin dependent) diabetes mellitus: implications for treatment. Diabetes Mellitus. Edited by: Porte D, Sherwin RS. 1997, Stamford, CT: Appleton and Lange, 487-512. 5
American Diabetes Association: Diagnosis and classification of diabetes mellitus. Diabetes Care. 2012, 35 (Suppl 1): S64-S71.
Canadian Diabetes Association: The prevalence and costs of diabetes.http://www.diabetes.ca/Files/prevalence-and-costs.pdf,
Geiss LS, Cowie CC: Type 2 diabetes and persons at high risk of diabetes. Diabetes Public Health: From Data to Policy. Edited by: Narayan KM, Williams D, Gregg EW, Cowie CC. 2011, New York, NY: Oxford University Press, 15-32.
Canadian Diabetes Association Clinical Practice Guidelines Expert Committee: Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Canadian Diabetes Association. 2008, 32: S1-S201.
Nathan DM, Buse JB, Davidson MB, Ferrannini E, Holman RR, Sherwin R, Zinman B, American Diabetes Association; European Association for Study of Diabetes: Medical management of hyperglycemia in type 2 diabetes: a consensus algorithm for the initiation and adjustment of therapy. Diabetes Care. 2009, 32: 193-203. 10.2337/dc08-9025.
UK Prospective Diabetes Study (UKPDS) Group: Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet. 1998, 352: 837-853.
Cook MN, Girman CJ, Stein PP, Alexander CM, Holman RR: Glycemic control continues to deteriorate after sulfonylureas are added to metformin among patients with type 2 diabetes. Diabetes Care. 2005, 28: 995-1000. 10.2337/diacare.28.5.995.
Richter B, Bandeira-Echtler E, Bergerhoff K, Lerch CL: Dipeptidyl peptidase-4 (DPP-4) inhibitors for type 2 diabetes mellitus. Cochrane Database Syst Rev. 2008, 2: CD006739
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shakelle P, Stewart L: Reporting Guidelines for Systematic Review Protocols. 19th Cochrane Colloquium; October 19–22. 2011, Madrid, Spain:
Stone PW: Popping the (PICO) question in research and evidence-based practice. Appl Nurs Res. 2002, 15: 197-198. 10.1053/apnr.2002.34181.
Gross JL, Kramer CK, Leitao CB, Hawkins N, Viana LV, Schaan BD, Pinto LC, Rodrigues TC, Azevedo MJ, Diabetes and Endocrinology Meta-analysis Group: Effect of antihyperglycemic agents added to metformin and a sulfonylurea on glycemic control and weight gain in type 2 diabetes: a network meta-analysis. Ann Intern Med. 2011, 154: 672-679. 10.7326/0003-4819-154-10-201105170-00007.
Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62: 944-952. 10.1016/j.jclinepi.2008.10.012.
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.
Tool SR: SysRev Tool. 2011, Toronto: Canada
Senn SJ: Overstating the evidence: double counting in meta-analysis and related problems. BMC Med Res Method. 2009, 9: 10-10.1186/1471-2288-9-10.
Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, Tugwell P: The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses.http://www.ohri.ca/programs/clinical_epidemiology/nos_manual.pdf,
Cochrane Effective Practice and Organisation of Care Group Draft Risk of Bias Tool.http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/Suggested%20risk%20of%20bias%20criteria%20for%20EPOC%20reviews.pdf,
Egger M, Davey Smith G, Schneider M, Minder C: Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997, 315: 629-634. 10.1136/bmj.315.7109.629.
Santaguida P, Raina P, Ismaila A: The development of the McHarm quality assessment scale for adverse events. Unpublished report. 2008
DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.
Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.
Agency for Healthcare Research and Quality (AHRQ): Meta-regression Approaches. 2004, Rockville, MD: Agency for Healthcare Research and Quality
SAS: Version 9.2. 2009, Cary, NC: SAS Institute Inc
Littell JH, Corcoran J, Pillai V: Systematic Reviews and Meta-analysis. 2008, New York: Oxford University Press
Carpenter J, Rucker G, Schwarzer G: Assessing the sensitivity of meta-analysis to selection bias: a multiple imputation approach. Biometrics. 2011, 67: 1066-1072. 10.1111/j.1541-0420.2010.01498.x.
The bugs project, Winbugs.http://www.mrc-bsu.cam.ac.uk/bugs/winbugs/contents.shtml,
Lu G, Ades AE: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23: 3105-3124. 10.1002/sim.1875.
Gelman A, Rubin DB: Inference from iterative simulation using multiple sequences. Stat Sci. 1992, 7: 457-472. 10.1214/ss/1177011136.
Dias S, Welton NJ, Caldwell DM, Ades AE: Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010, 29: 932-944. 10.1002/sim.3767.
Salanti G, Marinho V, Higgins JP: A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. J Clin Epidemiol. 2009, 62: 857-864. 10.1016/j.jclinepi.2008.10.001.
Cook MN, Girman CJ, Stein PP, Alexander CM: Initial monotherapy with either metformin or sulphonylureas often fails to achieve or maintain current glycaemic goals in patients with Type 2 diabetes in UK primary care. Diabet Med. 2007, 24: 350-358.
This systematic review was funded by the Canadian Institutes for Health Research/Drug Safety and Effectiveness Network (CIHR/DSEN). ACT is funded by a CIHR/DSEN New Investigator Award in Knowledge Synthesis. DM is funded by a University of Ottawa Research Chair. SRM is the Endowed Chair in Patient Health Management (supported by the Faculties of Medicine and Dentistry and Pharmacy and Pharmaceutical Sciences) and holds a Health Scholar salary award (supported by Alberta Heritage Foundation for Medical Research and Alberta Innovates – Health Solutions). SES is funded by a Tier 1 Canada Research Chair in Knowledge Translation. We thank Laure Perrier for conducting the literature searches and Becky Skidmore for peer reviewing the MEDLINE search strategy. We also thank Dr. Maggie Chen and Dr. Joseph Beyene for providing feedback on our original proposal, and Jennifer D’Souza for formatting the references.
The authors declare that they have no competing interests.
ACT conceived the study, designed the study, helped obtain funding for the study and helped write the draft protocol. JA registered the protocol with the PROSPERO database and edited the draft protocol. CS edited the draft protocol. BH, DM, BH, CHY and SRM provided input into the design and draft of the protocol. SES conceived the study, designed the study, obtained the funding and helped write the draft protocol. All authors read and approved the final protocol.