Safety, effectiveness, and cost of long-acting versus intermediate-acting insulin for type 1 diabetes: Protocol for a systematic review and network meta-analysis
© Tricco et al.; licensee BioMed Central Ltd. 2013
Received: 22 February 2013
Accepted: 6 March 2013
Published: 10 September 2013
Type 1 diabetes mellitus (T1DM) causes progressive destruction of pancreatic beta cells leading to absolute insulin deficiency. Treatment of T1DM requires insulin, and some evidence suggests that longer acting insulin analogues might have a higher effectiveness and greater safety profile compared to intermediate-acting insulin. Our objective is to evaluate the comparative effectiveness, safety, and cost of long-acting insulin versus intermediate-acting insulin through a systematic review and network meta-analysis.
Studies examining long-acting versus intermediate-acting insulin or placebo preparations for adult T1DM patients will be included. The primary outcome is glycosylated hemoglobin (A1C), and secondary outcomes include emergency department and physician visits, hospital admissions, weight gain, quality of life, microvascular complications (e.g., retinopathy), macrovascular complications (e.g., cardiovascular disease), all-cause mortality, incident cancers, and cost. We will include experimental [randomized clinical trials (RCTs), quasi-RCTs, non-RCTs], quasi-experimental (controlled before-after, interrupted time series), observational (cohort), and cost studies, of any duration of follow-up, conducted during all time periods, and disseminated in any language.
We will conduct comprehensive searches of electronic databases from inception onwards, including MEDLINE, Cochrane Central Register of Controlled Trials, and EMBASE. We will also search for difficult to locate and unpublished literature by searching dissertation databases, public health organization websites, and trial registries. After a calibration exercise using our eligibility criteria and data abstraction forms, two reviewers will screen all citations, full-text articles, and abstract data in duplicate. Conflicts will be resolved by team discussion. Using a similar process, the Cochrane Effective Practice and Organization of Care Risk of Bias tool will be used to appraise the risk of bias of experimental and quasi-experimental studies, while the Newcastle Ottawa Scale will be used to assess the methodological quality of cohort studies. If feasible and appropriate, we will conduct a random effects meta-analysis, as well as a network meta-analysis.
Our systematic review will be of utility to healthcare providers, policy-makers, T1DM patients and family members regarding treatment options of long-acting versus intermediate-acting insulin preparations.
Systematic review registration
PROSPERO registry number: CRD42013003610
Type 1 diabetes mellitus (T1DM) is a chronic condition usually characterized by an autoimmune destruction of pancreatic beta cells, leading to absolute insulin deficiency . T1DM is due to a combination of genetic and environmental factors . The long-term consequences of T1DM can be severe and include microvascular complications, such as retinopathy, neuropathy, and nephropathy, as well as macrovascular complications, including cardiovascular disease, stroke/transient ischemic attack, and peripheral vascular disease .
The incidence of T1DM varies geographically, with high rates reported across Europe (4 to 41 per 100,000 people per year) and North America (11 to 25 per 100,000 people per year) . Although T1DM accounts for a small proportion of all diabetes worldwide (range: 5-10%) , the incidence of T1DM is increasing . Some estimates suggest a 2.8% increase in the incidence of T1DM per year .
Since insulin deficiency occurs in T1DM, the treatment of this condition requires the use of insulin. Basal insulin replacement can be achieved with human or purified porcine intermediate-acting insulin, including isophane insulin (Neutral Protamine Hagedorn; NPH) and zinc insulin (lente)  or with long-acting insulin analogues, such as glargine and detemir . Long-acting insulin analogues are more expensive than intermediate-acting insulin , yet have a slower absorption and less intra-individual variability of action, which is presumed to improve clinical outcomes . Previous reviews of these agents have found that long-acting insulin analogues significantly reduced glycosylated hemoglobin (A1C) compared to intermediate-acting insulin [4, 6, 7]. However, none of these reviews included “real-world” evidence from study designs beyond randomized clinical trials (RCTs). For example, evidence from observational studies (e.g., cohort studies) was not included in these reviews. As such, our objective is to evaluate the “real-world” comparative effectiveness, safety, and cost of long-acting insulin versus intermediate-acting insulin in managing T1DM through a systematic review and network meta-analysis.
We compiled a systematic review protocol and registered it with the PROSPERO database (CRD42013003610). We used the Preferred Reporting Items for Systematic Reviews and Meta-analyses Protocols (PRISMA-P) initiative to guide the reporting of our systematic review protocol .
Experimental studies (RCTs, quasi-RCTs, non-RCTs) and quasi-experimental studies (interrupted time series, con-trolled before and after studies) including adults (aged ≥18 years) with T1DM of any duration who are administered long-acting basal insulin analogue preparations (e.g., glargine, detemir) compared to each other, intermediate-acting insulin (e.g., NPH, lente), or placebo will be included. We will exclude pre-mixed insulin preparations. To examine rare adverse events, we will also include observational (cohort) studies. To examine cost, cost and cost effectiveness studies will be included.
The primary outcome of interest is A1C. Secondary outcomes include emergency department (ED) visits (for hypoglycemia and hyperglycemia), physician visits (for hypoglycemia and hyperglycemia), hospital admissions (for hypoglycemia and hyperglycemia), weight gain, quality of life, microvascular complications (retinopathy, neuropathy, nephropathy), macrovascular complications (cardiovascular disease, stroke/transient ischemic attack, peripheral vascular disease), all-cause mortality, and incident cancers. We will also assess the cost and cost-effectiveness of long-acting basal insulin preparations.
Both published and unpublished material will be included, as well as those disseminated in any language. Studies of all durations of follow-up conducted at any point in time will be included. Our draft eligibility form is presented in Additional file 1 for screening titles and abstracts (or citations) and potentially relevant full-text articles.
Information sources and literature search
The main information sources are electronic databases, such as MEDLINE, EMBASE, and the Cochrane Central Register of Controlled Trials. This will be supplemented by searching for gray literature, as recommended by the Canadian Agency for Technologies in Health (CADTH) . For example, we will search public health websites (e.g., Public Health Agency of Canada, Health Canada), drug regulatory websites (e.g., Food and Drug Administration; FDA), and clinical trial registries (e.g., World Health Organization International Clinical Trials Search Portal). We will also search authors’ personal files, contact insulin manufacturers, scan the reference lists of included studies and relevant reviews, and contact prolific authors of T1DM long-acting insulin papers.
An experienced librarian will conduct all of the aforementioned literature searches. A draft search strategy for the MEDLINE database (OVID interface) is presented in Additional file 2. Our MEDLINE search strategy will be peer reviewed by another expert librarian using the Peer Review of Electronic Search Strategies (PRESS) checklist .
Study selection process
The draft screening criteria presented in Additional file 1 will be calibrated by conducting a pilot-test using a random sample of 50 citations from the literature search. All team members will screen these citations using the eligibility criteria, and conflicts will be discussed. The eligibility criteria will be revised if deemed necessary by the team or if low agreement is observed (e.g., a kappa statistic ≤ 60%) . Two team members will then screen each citation in duplicate using our online SysRev Tool . Similarly, the draft eligibility criteria will be calibrated for screening potentially relevant full-text articles, which will then be screened by two team members independently. At both the citation level of screening and full-text level of screening, conflicts will be resolved through team discussion.
Data items and data collection process
Study-level: study design, year of study conduct, sample size, setting, country of study conduct, type of insulin, dosage of insulin;
Patient-level: type and number of patients, age mean and standard deviation, duration of T1DM, baseline A1C, co-morbidities; and
Outcome level: A1C, ED visits, physician visits, quality of life, cost.
We will abstract outcome results for each of the following points in time: 6, 12, 24 months, and the longest duration of follow-up.
The process for data collection will be similar to the method used for screening. Namely, we will calibrate our data collection form on a random sample of 5–10 included studies. Each team member will collect the data, and the team will meet to discuss conflicts. The data collection form will be revised, as necessary. Subsequently, two team members will conduct all data collection for each study in duplicate. The team has been trained to spot duplicate publications (or companion reports) that use the same group of patients to test a particular intervention. This is particularly an issue when meta-analysis is being considered . Furthermore, our team is trained to contact authors of studies with poorly reported data or for potentially relevant unpublished material identified, for example, through conference abstracts or dissertations.
Methodological quality/risk of bias appraisal
The methodological quality of cohort studies will be appraised using the Newcastle-Ottawa Scale . The risk of bias of experimental and quasi-experimental studies will be appraised using the Cochrane Effective Practice and Organisation of Care Risk of Bias Tool . Publication bias will be assessed using funnel plots . Finally, studies reporting harms will be appraised using the McHarm tool .
Synthesis of included studies
Firstly, our systematic review results will be reported by describing study characteristics, patient characteristics, and outcome results. We will also describe our literature search results, as well as the methodological quality and risk of bias results using tables, figures, and text.
Secondly, we will evaluate whether we have sufficient data to conduct random-effects meta-analysis . We will ensure that the 95% confidence intervals can be derived using a normal distribution. We will also ensure that the body of literature is sufficiently homogenous in terms of clinical (e.g., patient characteristics), methodological (e.g., study design), and statistical (e.g., forest plot consistency) characteristics. For example, clinicians on the team will use their clinical insight to assess for clinical heterogeneity, methodologists on the team will assess for methodological heterogeneity, and statistical heterogeneity will be calculated using the I2 statistical test . If extensive heterogeneity is observed (e.g., I2> 75% ), we will try to explain this via sub-group analysis and meta-regression analysis . The meta-regression analysis will examine the influence of factors such as baseline A1C values (e.g., < 8% versus ≥ 8%), study size (e.g., < median versus ≥ median), and risk of bias (e.g., high risk of bias versus low risk of bias on the random sequence generation item) on the meta-analysis results. Both meta-analysis and meta-regression analysis will be dependent upon the availability of data. These analyses will be conducted using SAS version 9.2 .
To make use of all existing data, we will impute missing measures of variance (e.g., standard deviations, standard errors, 95% confidence intervals). This will be conducted using established methods . To ensure that our imputations do not bias our results, we will conduct a sensitivity analysis, which will entail examining the missing data under both random and nonrandom assumptions .
Finally, we will attempt conducting a network (i.e., mixed treatment comparisons) meta-analysis. This analysis is particularly useful when there is a lack of head-to-head studies or when both relevant head-to-head and standard treatment controlled studies exist. The network meta-analysis approach allows the ranking of effectiveness and safety of different insulin preparations . This analysis will be conducted in WinBUGS , and median rankings (or point estimates) will be calculated using a random effects model that makes use of all available direct and indirect data . The degree of uncertainty for all point estimates will be reported as 95% credible intervals (CIs), calculated using the 2.5 and 97.5 percentiles obtained via Monte Carlo simulation of 100,000 iterations . We will assess model convergence using trace and history plots, as well as the Gelman Rubin statistic . We will first include RCTs in the network meta-analysis. Subsequently, we will include other experimental studies, quasi-experimental studies, and cohort studies in the network meta-analysis. The consistency of results will be examined by comparing the results obtained via frequentist meta-analysis versus network meta-analysis. This will also be examined statistically, using methods reported elsewhere [27, 28].
Our meta-analysis results will be tested for their robustness through sensitivity analyses. For example, we might look at the impact of including/excluding studies with high risk of bias or poor methodological quality, studies with high attrition rates, average adherence between groups, and inclusion of non-RCTs in the analyses. Since the network meta-analysis is dependent on different priors for variance parameters included in the Bayesian approach , we will conduct a sensitivity analysis on these characteristics as well.
The incidence of T1DM is increasing annually, and most patients with this chronic condition require the use of insulin. As such, our systematic review results have the potential to influence a large proportion of the population. Our results can be used to inform healthcare providers, policy-makers, T1DM patients, and family members about the comparative effectiveness, safety, and cost of long-acting versus intermediate-acting insulin preparations using real-world evidence.
We will ensure that our results reach our key stakeholders by conducting rigorous and evidence-based knowledge translation strategies. Our review was identified by Canadian policy-makers as a priority topic of the health of Canadians. We developed our protocol in response to their query—a form of integrated knowledge translation. We will ensure that our results are disseminated to these policy-makers through dissemination meetings and policy briefs. We will also translate our results to clinicians and patients by publishing in open access journals, presenting at a conference symposium, and utilizing social media.
Food and drug administration
Neutral protamine Hagedorn
Peer review of electronic search strategies
Preferred reporting items for systematic reviews and meta-analyses protocols
Randomized clinical trials
Type 1 diabetes mellitus.
This systematic review was funded by the Canadian Institutes for Health Research/Drug Safety and Effectiveness Network (CIHR/DSEN). ACT is funded by a CIHR/DSEN New Investigator Award in Knowledge Synthesis. DM is funded by a University of Ottawa Research Chair. SRM is the Endowed Chair in Patient Health Management (supported by the Faculties of Medicine and Dentistry and Pharmacy and Pharmaceutical Sciences) and holds a Health Scholar salary award (supported by Alberta Heritage Foundation for Medical Research and Alberta Innovates – Health Solutions). SES is funded by a Tier 1 Canada Research Chair in Knowledge Translation.
We thank Laure Perrier for conducting the literature searches and Becky Skidmore for peer reviewing the MEDLINE search strategy. We also thank Dr. Maggie Chen and Dr. Joseph Beyene for providing feedback on our original proposal and Jennifer D’Souza for formatting the references.
- American Diabetes Association: Diagnosis and classification of diabetes mellitus. Diabetes Care. 2012, 35 (Suppl 1): S64-S71.PubMed CentralView Article
- Diamond Project Group: Incidence and trends of childhood type 1 diabetes worldwide 1990–1999. Diabet Med. 2006, 23: 857-866.View Article
- Cameron CG, Bennett HA: Cost-effectiveness of insulin analogues for diabetes mellitus. CMAJ. 2009, 180: 400-407.PubMed CentralView ArticlePubMed
- Monami M, Marchionni N, Mannucci E: Long-acting insulin analogues vs. NPH human insulin in type 1 diabetes. A meta-analysis. Diabetes Obes Metab. 2009, 11: 372-378. 10.1111/j.1463-1326.2008.00976.x.View ArticlePubMed
- Valensi P, Cosson E: Is insulin detemir able to favor a lower variability in the action of injected insulin in diabetic subjects?. Diabetes Metab. 2005, 31: 4S34-4S39. 10.1016/S1262-3636(05)88265-5.PubMed
- Sanches AC, Correr CJ, Venson R, Pontarolo R: Revisiting the efficacy of long-acting insulin analogues on adults with type 1 diabetes using mixed-treatment comparisons. Diabetes Res Clin Pract. 2011, 94: 333-339. 10.1016/j.diabres.2011.09.001.View ArticlePubMed
- Vardi M, Jacobson E, Nini A, Bitterman H: Intermediate acting versus long acting insulin for type 1 diabetes mellitus. Cochrane Database Syst Rev. 2008, 16: CD006297-
- Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M: Reporting Guidelines for Systematic Review Protocols. 2011, Madrid, Spain: 9th Cochrane Colloquium
- Grey Matters: a practical search tool for evidence-based medicine.http://www.cadth.ca/en/resources/grey-matters,
- Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62: 944-952. 10.1016/j.jclinepi.2008.10.012.View ArticlePubMed
- Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.View ArticlePubMed
- Tool SR: SysRev Tool. 2011, Toronto: Canada
- Senn SJ: Overstating the evidence: double counting in meta-analysis and related problems. BMC Med Res Methodol. 2009, 9: 10-10.1186/1471-2288-9-10.PubMed CentralView ArticlePubMed
- The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses.http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp,
- Cochrane Effective Practice and Organisation of Care Group Draft Risk of Bias Tool.http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/Suggested%20risk%20of%20bias%20criteria%20for%20EPOC%20reviews.pdf,
- Egger M, Davey Smith G, Schneider M, Minder C: Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997, 315: 629-634. 10.1136/bmj.315.7109.629.PubMed CentralView ArticlePubMed
- Santaguida P, Raina P, Ismaila A: The development of the McHarm quality assessment scale for adverse events. 2008, Unpublished report
- DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.View ArticlePubMed
- Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.View ArticlePubMed
- Agency for Healthcare Research and Quality (AHRQ): Meta-regression approaches. 2004, Rockville, MD: Agency for Healthcare Research and Quality
- SAS Institute Inc: SAS. Version 9.2. 2009, Cary, NC: SAS Institute Inc
- Littell JH, Corcoran J, Pillai V: Systematic reviews and meta-analysis. 2008, New York: Oxford University PressView Article
- Carpenter J, Rucker G, Schwarzer G: Assessing the sensitivity of meta-analysis to selection bias: a multiple imputation approach. Biometrics. 2011, 67: 1066-1072. 10.1111/j.1541-0420.2010.01498.x.View ArticlePubMed
- Lu G, Ades AE: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23: 3105-3124. 10.1002/sim.1875.View ArticlePubMed
- The bugs project, Winbugs.http://www.mrc-bsucamacuk/bugs/winbugs/contents.shtml,
- Gelman A, Rubin DB: Inference from iterative simulation using multiple sequences. Stat Sci. 1992, 7: 457-472. 10.1214/ss/1177011136.View Article
- Dias S, Welton NJ, Caldwell DM, Ades AE: Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010, 29: 932-944. 10.1002/sim.3767.View ArticlePubMed
- Salanti G, Marinho V, Higgins JP: A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. J Clin Epidemiol. 2009, 62: 857-864. 10.1016/j.jclinepi.2008.10.001.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.