Appraisal of clinical practice guidelines for management of paediatric type 2 diabetes mellitus using the AGREE II instrument: a systematic review protocol
- Dena Zeraatkar†1, 2, 3,
- Ahmed Nahari†1, 2, 8,
- Pei-Wen Wang1, 2,
- Emily Kearsley1, 2,
- Nicole Falzone1, 2,
- Michael Xu1, 2, 3,
- Laura Banfield4,
- Lehana Thabane3, 5, 6, 7 and
- M. Constantine Samaan1, 2, 3Email authorView ORCID ID profile
© The Author(s). 2016
Received: 8 March 2016
Accepted: 23 June 2016
Published: 13 July 2016
The prevalence of type 2 diabetes mellitus (T2DM) in children and adolescents is increasing. This has spurred the development and publication of clinical practice guidelines (CPGs) for the management of paediatric T2DM. Given the long-term complications of T2DM, optimal management is important to prevent or delay these complications. However, the quality of published CPGs has not yet been empirically evaluated.
Our objective is to systematically appraise all published CPGs for the management of T2DM in children and adolescents.
We will identify all published CPGs that address T2DM in children and adolescents through MEDLINE, Embase, CINAHL, Trip, and the National Guideline Clearinghouse and will screen diabetes and paediatric societies and associations’ websites. Search records will be screened in duplicate for inclusion. Grey literature will be covered by systematically searching publications of all relevant diabetes societies and associations and other health organizations for CPGs that meet our inclusion criteria. CPGs deemed eligible for inclusion will be retrieved. Quality assessment will be conducted using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool by a team of four appraisers. Scaled scores of the AGREE II will be used to gauge the overall quality of CPGs.
The results of this review will be disseminated through presentations at local, national, and international conferences and publication in a peer-reviewed journal. The results of this review can help improve the reporting of future guidelines, inform decisions of policy-makers to endorse CPGs, and affect the choice of guideline use in clinical practice.
Systematic review registration
Type 2 diabetes mellitus (T2DM) is a relatively new disease in children, driven mainly by the obesity epidemic [1–3]. While the pathophysiology of paediatric T2DM is not completely understood, the main drivers of its etiopathogenesis are related to a combination of obesity-driven insulin resistance in the skeletal muscle, liver, and adipose tissue . This is coupled with β-cell failure to produce sufficient insulin to overcome insulin resistance due to inflammation, glucotoxicity, and lipotoxicity [5–10].
Paediatric T2DM patients are at risk of secondary comorbidities including dyslipidaemia, hypertension, non-alcoholic fatty liver disease, polycystic ovary syndrome, obstructive sleep apnoea, and psychological problems [11–13]. These comorbidities increase the risk for cardiovascular disease . In addition, T2DM patients can develop acute life-threatening complications including diabetic ketoacidosis and hyperosmolar hyperglycaemic state [15, 16].
Limited therapeutic options exist for children with T2DM. Currently, lifestyle intervention, metformin, and insulin are the only available therapeutic modalities, with other medications undergoing trials to validate their role in children and youth [13, 17, 18].
Due to its relative novelty, there are no natural history data to guide prognosis, and it is possible that children with T2DM will have a shorter lifespan than their non-diabetic counterparts, due to the association of diabetes with cardiovascular and renal causes .
In response to this crisis, clinical practice guidelines (CPGs), defined as ‘systematically developed statements to assist practitioner and patient decisions about appropriate healthcare for specific clinical circumstances,’ to guide the care of children and adolescents with T2DM have been developed .
The potential for CPGs to enhance the care of children and adolescents with T2DM is dependent on their quality, as well as uptake and adoption in practice. High-quality, evidence-driven CPGs have the potential to improve patient outcomes, due to their ability to standardize the delivery of evidence-based care by a large number of healthcare practitioners. CPGs also have the potential to improve the allocation and utilization of finite healthcare resources and reduce waste.
The purpose of this systematic review is to evaluate the quality of published CPGs for management of T2DM in children and adolescents and to evaluate the changes in their quality over time.
Do CPGs of paediatric type 2 diabetes mellitus conform to quality standards based on the AGREE II tool? If so, has the quality of these guidelines changed over time?
The primary objective of this systematic review is to evaluate the quality of published CPGs for the management of T2DM in children and adolescents using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool.
The secondary objective of this systematic review is to determine whether the quality of CPGs that have been revised or updated has improved over time.
PRISMA-P checklist for protocol items
Section and topic
Identify the report as a protocol of a systematic review
If the protocol is for an update of a previous systematic review, identify as such
If registered, provide the name of the registry (such as PROSPERO) and registration number
Provide name, institutional affiliation, e-mail address of all protocol authors; provide physical mailing address of corresponding author
Describe contributions of protocol authors and identify the guarantor of the review
If the protocol represents an amendment of a previously completed or published protocol, identify as such and list changes; otherwise, state plan for documenting important protocol amendments
Indicate sources of financial or other support for the review
Provide name for the review funder and/or sponsor
Role of sponsor or funder
Describe roles of funder(s), sponsor(s), and/or institution(s), if any, in developing the protocol
Describe the rationale for the review in the context of what is already known
Provide an explicit statement of the question(s) the review will address with reference to participants, interventions, comparators, and outcomes (PICO)
Specify the study characteristics (such as PICO, study design, setting, time frame) and report characteristics (such as years considered, language, publication status) to be used as criteria for eligibility for the review
Describe all intended information sources (such as electronic databases, contact with study authors, trial registers or other grey literature sources) with planned dates of coverage
Present draft of search strategy to be used for at least one electronic database, including planned limits, such that it could be repeated
Describe the mechanism(s) that will be used to manage records and data throughout the review
State the process that will be used for selecting studies (such as two independent reviewers) through each phase of the review (that is, screening, eligibility and inclusion in meta-analysis)
Data collection process
Describe planned method of extracting data from reports (such as piloting forms, done independently, in duplicate), any processes for obtaining and confirming data from investigators
List and define all variables for which data will be sought (such as PICO items, funding sources), any pre-planned data assumptions and simplifications
Outcomes and prioritization
List and define all outcomes for which data will be sought, including prioritization of main and additional outcomes, with rationale
Risk of bias in individual studies
Describe anticipated methods for assessing risk of bias of individual studies, including whether this will be done at the outcome or study level, or both; state how this information will be used in data synthesis
Describe criteria under which study data will be quantitatively synthesised
If data are appropriate for quantitative synthesis, describe planned summary measures, methods of handling data and methods of combining data from studies, including any planned exploration of consistency (such as I2, Kendall’s τ)
Describe any proposed additional analyses (such as sensitivity or subgroup analyses, meta-regression)
If quantitative synthesis is not appropriate, describe the type of summary planned
Specify any planned assessment of meta-bias(es) (such as publication bias across studies, selective reporting within studies)
Confidence in cumulative evidence
Describe how the strength of the body of evidence will be assessed (such as GRADE)
Published national or international CPGs from diabetes and paediatric associations that are reported as stand-alone guidelines for T2DM in children and adolescents (2–18 years of age) will be included. In addition, guidelines that address type 1 diabetes mellitus (T1DM) in children and adolescents and dedicate a section on recommendations for managing T2DM in this age group will be screened. CPGs that are targeted to the management of adult T2DM with a separate section with specific recommendations for management of T2DM in children and adolescents will also be included. We will compare the two most recent guidelines from a given agency if available and will not restrict language of publication of the included guidelines.
Unpublished CPGs, CPGs developed for exclusive use within one institution, and CPGs currently under development will be excluded. We will also exclude studies that make recommendations for management of paediatric T2DM but are not CPGs. These include randomized controlled trials (RCTs), including cluster RCTs, controlled (non-randomized) clinical trials, and case-control, prospective and retrospective cohort, and cross-sectional studies in T2DM. We will also exclude case reports, pilot and feasibility studies, and conference abstracts and posters.
We will also exclude guidelines that deal with drug-induced diabetes including steroids, antipsychotic medications, and immunomodulatory therapies or guidelines that deal with genetic forms of diabetes, e.g. maturity-onset diabetes of the young (MODY).
The primary outcome is the evaluation of the quality of the guidelines by calculating the AGREE II tool score for treatment of T2DM in children and adolescents.
The secondary outcome is to determine whether the quality of CPGs that have been revised or updated has improved over time.
Data sources and search strategy
The search strategy will be developed in consultation with a health sciences librarian with expertise in systematic reviews. We will search databases including MEDLINE and Embase through the Ovid interface, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Trip, and the National Guideline Clearinghouse (guideline.gov). The search will be conducted from the inception of each database up to and including January 31, 2016.
The search will be tailored to the capabilities of each database. Medical Subject Headings (MeSH) and keywords relating to (1) CPGs, (2) diabetes, and (3) children and/or adolescents will be combined using Boolean search operators. The search will not be limited to T2DM in order to capture guidelines that cover both T1DM and T2DM.
Sample search conducted on MEDLINE using the OVID interface
guideline/ or practice guideline/
Consensus Development Conference/
diabetes mellitus/or exp diabetes mellitus, type 1/or exp diabetes mellitus, type 2/
(T1DM or T2DM or T1D or T2D).ti,ab,kf.
((noninsulin or non insulin or insulin) adj2 depend*).ti,ab,kf.
adolescent/ or child/ or child, preschool/
6 and 13 and 21
To identify guidelines published outside of indexed journals, our search of key databases will be supplemented with a search of the grey literature. This will be covered by systematically searching publications of all relevant diabetes societies and associations and other health organizations for CPGs that meet our inclusion criteria.
The world will be divided into the Americas (North and South), Europe, Asia (including Australasia and Oceania), and Africa. Four reviewers will be tasked with systematically searching online for relevant CPGs published by diabetes societies and associations and other medical and health organizations in their assigned regions.
Search results will be uploaded to a private group on Mendeley (https://www.mendeley.com), a reference management tool. Exact duplicates will be removed.
Data selection process
Two independent reviewers will screen titles and abstracts of records on Mendeley, and those deemed eligible for inclusion will be retrieved and uploaded onto an external database. Retrieved eligible records will undergo duplicate full-text screening for inclusion. Reasons for exclusion will be documented and reported. Disagreements between reviewers will be resolved by discussion or by consulting an expert paediatric endocrinologist (MCS). The team has been educated on the subject area by an expert clinician and researcher (MCS) to ensure familiarity with the research field.
For data extraction protocol, we will include the title, authors, issuing society/association, country, year of publication or update, criteria and frequency of screening for T2DM, screening test(s) recommended, and diagnostic criteria. We will also include recommendation of healthcare delivery including personnel needed and recommendations on physical activity, diet, screen time, psychosocial issues, medical and surgical therapies, target HbA1c, and screening methods and frequency for comorbidities including nephropathy, retinopathy, hypertension, dyslipidemia, non-alcoholic fatty liver disease, neuropathy, and polycystic ovary syndrome.
Outcomes and prioritization
The primary outcome is the score of the AGREE II guideline. The secondary outcome is the demonstration of improvement in score over time for those agencies that have updated versions of their guidelines.
CPGs deemed eligible for inclusion will be appraised using the AGREE II . The AGREE II is a generic instrument developed for quality evaluation of health-related CPGs. It evaluates the process of guideline development and reporting across six domains (scope and purpose, stakeholder involvement, rigour of development, clarity of presentation, editorial independence, and applicability) using a seven-point Likert scale (whereby seven indicates the highest quality). The instrument also contains two additional global items. The first item is on the overall assessment of the quality of the guideline on a seven-point Likert scale, and the second item is on whether the guideline can be recommended for use, which is assessed on an ordinal scale of ‘yes’, ‘yes with modifications’, and ‘no’.
The AGREE II instrument was chosen due to its already widespread use and validation [26–28]. The instrument can be used by researchers, clinicians, and policy-makers with varying experiences in the development and use of CPGs . In user-testing, the instrument has shown acceptable reliability and construct validity, with statistically significant (p < 0.05) differences found in the scores of high- and low-quality guidelines of all but three of the 23 items [27, 28]. The number of appraisers required for an inter-rater reliability of 0.7 ranges from two to five across domains . Although only two of the domains achieved an alpha value that met conventionally accepted standards for internal consistency (Cronbach’s alpha ≥ 0.8), this could be attributed to the small number of items in each domain (range 2–8).
A team of four appraisers will perform quality assessment; this is the preferred number of appraisers necessary to reach acceptable inter-rater reliability (intra-class correlation coefficient (ICC) ≥ 0.7) on the AGREE II [26, 27]. Prior to appraisal, appraisers will complete the AGREE II Online Training Tool (http://www.agreetrust.org/resource-centre/agree-ii-training-tools/) and will participate in at least three rounds of calibration with a sample of relevant CPGs of varying qualities. Additional rounds of calibration will be completed until an inter-rater reliability of 0.7 is achieved. All appraisals will be conducted using the online My AGREE PLUS platform (http://www.agreetrust.org/resource-centre/agree-plus/).
Data synthesis and analysis
All statistical analyses will be conducted using SPSS Statistics Version 22.
Agreement regarding CPG eligibility between reviewers will be reported as Cohen’s kappa. The target level of agreement will be set as 0.8, indicating strong agreement between reviewers.
Descriptive statistics will be generated and tabulated to summarize the characteristics of CPGs deemed eligible for inclusion. For each CPG, a quality score will be calculated for each of the six domains of AGREE II, using the formula presented in the AGREE II User’s Manual . Briefly, domain scores will be calculated by summing up all the appraisers’ scores of the individual items in a domain and by scaling the total as a percentage of the maximum possible score for that domain. This calculation is automatically generated on the My AGREE PLUS platform. Inter-rater reliability between appraisers for each domain of the AGREE II will be presented as ICCs, with a target ICC of 0.7 for all domains. The overall quality of the included CPGs in each domain of the AGREE II will be presented in a table using summery statistics (mean ± SD) for normally distributed data and medians (minimum-maximum) for skewed distributions. As the six domains of the AGREE II are independent, domain quality scores will not be aggregated.
The results of this review will be presented at local, national, and international conferences and published in a peer-reviewed journal.
With the increasing prevalence of T2DM in children and adolescents and the burden of living with the disease, there is a critical need to ensure that the evidence used in management of these children is of high quality. In this systematic review, we will investigate the quality of existing CPGs designed to manage paediatric T2DM.
Our proposed review can aid clinicians who wish to enhance the care of children and/or adolescents with T2DM by adopting CPGs in their practice, guideline developers who wish to create better quality CPGs or improve existing ones, researchers who wish to identify knowledge gaps, and policy-makers looking to endorse CPGs. The collation of this evidence will also help to identify gaps in the available CPGs.
The extensive search strategy covering both indexed and grey literature, use of multiple appraisers who will complete training and calibration to assess the quality of CPGs, and application of the AGREE II instrument, which has established validity and reliability [27, 28], are all strengths of this review and may help the delivery of better care.
There are no funding sources for this work.
MCS conceived the study idea and is the guarantor. MCS, AN, NF, EK, MX, PWW, LT, and DZ devised the study methodology. LB, DZ, and MCS developed the search strategy. LB and LT provided the methodological support. DZ, AN, and MX wrote the first draft. MCS, AN, EK, MX, PWW, LB, LT, and NF read the drafts, provided the comments, and agreed on the final version of the manuscript.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Fazeli Farsani S, van der Aa MP, van der Vorst MM, Knibbe CA, de Boer A. Global trends in the incidence and prevalence of type 2 diabetes in children and adolescents: a systematic review and evaluation of methodological approaches. Diabetologia. 2013;56:1471–88.View ArticlePubMedGoogle Scholar
- Dabelea D, Pettitt DJ, Jones KL, Arslanian SA. Type 2 diabetes mellitus in minority children and adolescents. An emerging problem. Endocrinol Metab Clin North Am. 1999;28(4):709–29. viii.View ArticlePubMedGoogle Scholar
- Dabelea D, Mayer-Davis EJ, Saydah S, et al. Prevalence of type 1 and type 2 diabetes among children and adolescents from 2001 to 2009. JAMA. 2014;311(17):1778–86.View ArticlePubMedPubMed CentralGoogle Scholar
- Shoelson SE, Herrero L, Naaz A. Obesity, inflammation, and insulin resistance. Gastroenterology. 2007;132(6):2169–80.View ArticlePubMedGoogle Scholar
- Hotamisligil GS. Inflammation and metabolic disorders. Nature. 2006;444(7121):860–7.View ArticlePubMedGoogle Scholar
- Hotamisligil GS. Inflammatory pathways and insulin action. Int J Obes Relat Metab Disord. 2003;27 Suppl 3:S53–5.View ArticlePubMedGoogle Scholar
- Wellen KE, Hotamisligil GS. Inflammation, stress, and diabetes. J Clin Invest. 2005;115(5):1111–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Eguchi K, Manabe I. Toll-like receptor, lipotoxicity and chronic inflammation: the pathological link between obesity and cardiometabolic disease. J Atheroscler Thromb. 2014;21(7):629–39.
- Schrauwen P. High-fat diet, muscular lipotoxicity and insulin resistance. Proc Nutr Soc. 2007;66(01):33–41.View ArticlePubMedGoogle Scholar
- van Herpen NA, Schrauwen-Hinderling VB. Lipid accumulation in non-adipose tissue and lipotoxicity. Physiol Behav. 2008;94(2):231–41.View ArticlePubMedGoogle Scholar
- Pinhas-Hamiel O, Zeitler P. Acute and chronic complications of type 2 diabetes mellitus in children and adolescents. The Lancet. 2007;369(9575):1823–31.
- Pinhas-Hamiel O, Levy-Shraga Y. Eating disorders in adolescents with type 2 and type 1 diabetes. Curr Diab Rep. 2013;13(2):289–97.
- Samaan MC, Valencia M, Cheung C, Wilk B, Lau K, Thabane L. Design, implementation, and evaluation of a pediatric and adolescent type 2 diabetes management program at a tertiary pediatric center. J Multidiscip Healthc. 2014;2014(7):321–31.View ArticleGoogle Scholar
- Mayer-Davis EJ, Ma B, Lawson A, D’Agostino Jr RB, Liese AD, Bell RA, et al. Cardiovascular disease risk factors in youth with type 1 and type 2 diabetes: implications of a factor analysis of clustering. Metab Syndr Relat Disord. 2009;7(2):89–95.View ArticlePubMedPubMed CentralGoogle Scholar
- Pinhas-Hamiel O, Dolan LM, Zeitler PS. Diabetic ketoacidosis among obese African-American adolescents with NIDDM. Diabetes Care. 1997;20(4):484–6.View ArticlePubMedGoogle Scholar
- Sellers EA, Dean HJ. Diabetic ketoacidosis: a complication of type 2 diabetes in Canadian aboriginal youth. Diabetes Care. 2000;23(8):1202–4.View ArticlePubMedGoogle Scholar
- Zeitler P, Epstein L, Grey M, Hirst K, Kaufman F, Tamborlane W, et al. Treatment options for type 2 diabetes in adolescents and youth: a study of the comparative efficacy of metformin alone or in combination with rosiglitazone or lifestyle intervention in adolescents with type 2 diabetes. Pediatr Diabetes. 2007;8(2):74–87.View ArticlePubMedGoogle Scholar
- Zeitler P, Hirst K, Pyle L, Linder B, Copeland K, Arslanian S, et al. A clinical trial to maintain glycemic control in youth with type 2 diabetes. N Engl J Med. 2012;366(24):2247–56.View ArticlePubMedGoogle Scholar
- Tancredi M, Rosengren A, Svensson A-M, Kosiborod M, Pivodic A, Gudbjörnsdottir S, et al. Excess mortality among persons with type 2 diabetes. N Engl JMed. 2015;373(18):1720–32.View ArticleGoogle Scholar
- In: Field MJ, Lohr KN, editors. Clinical practice guidelines: directions for a new program. Washington (DC): National Academies Press; 1990.
- Burda BU, Norris SL, Holmer HK, Ogden LA, Smith ME. Quality varies across clinical practice guidelines for mammography screening in women aged 40-49 years as assessed by AGREE and AMSTAR instruments. J Clin Epidemiol. 2011;64(9):968–76.View ArticlePubMedGoogle Scholar
- de Haas ER, de Vijlder HC, van Reesema WS, van Everdingen JJ, Neumann HA. Quality of clinical practice guidelines in dermatological oncology. J Eur Acad Dermatol Venereol. 2007;21(9):1193–8.PubMedGoogle Scholar
- Burgers JS, Fervers B, Haugh M, Brouwers M, Browman G, Philip T, et al. International assessment of the quality of clinical practice guidelines in oncology using the Appraisal of Guidelines and Research and Evaluation Instrument. J Clin Oncol. 2004;22(10):2000–7.View ArticlePubMedGoogle Scholar
- Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.View ArticlePubMedPubMed CentralGoogle Scholar
- Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.View ArticlePubMedGoogle Scholar
- Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010;182(18):E839–42.View ArticlePubMedPubMed CentralGoogle Scholar
- Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. Development of the AGREE II, part 1: performance, usefulness and areas for improvement. CMAJ. 2010;182(10):1045–52.View ArticlePubMedPubMed CentralGoogle Scholar
- Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. Development of the AGREE II, part 2: assessment of validity of items and tools to support application. CMAJ. 2010;182(10):E472–8.View ArticlePubMedPubMed CentralGoogle Scholar