Research | Open | Open Peer Review | Published:
Improving quality of care for persons with diabetes: an overview of systematic reviews - what does the evidence tell us?
Systematic Reviewsvolume 2, Article number: 26 (2013)
Ensuring high quality care for persons with diabetes remains a challenge for healthcare systems globally with consistent evidence of suboptimal care and outcomes. There is increasing interest in quality improvement strategies to improve diabetes management as reflected by a growing number of systematic reviews. These reviews are of varying quality and dispersed across many sources. In this paper, we present an overview of systematic reviews evaluating the impact of interventions to improve the quality of diabetes care.
We searched for systematic reviews evaluating the effectiveness of any intervention intended to improve intermediate patient outcomes and process of care measures for patients with any type of diabetes. Two reviewers independently screened search results, appraised each systematic review using AMSTAR and extracted data from high quality reviews (AMSTAR score ≥ 5). Within reviews, we used vote counting by direction of effect to report the number of studies favouring an intervention for each outcome. We produced summaries of results for each intervention category.
We identified 125 reviews of varying methodological quality and summarised key findings from 50 high quality reviews. We categorised reviews by quality improvement intervention. Eight reviews were broad based (involving a variety of strategies). Other reviews considered: patient education and support (n = 21), telemedicine (n = 10), provider role changes (n = 7), and organisational changes (n = 4). Reviews reported intermediate patient outcomes (e.g. glycaemic control) (n = 49) and process of care outcomes (n = 9). There was evidence of considerable overlap of included studies between reviews.
There is consistent evidence from high quality systematic reviews that patient education and support, provider role changes, and telemedicine are associated with improvements in glycaemic and vascular risk factor control in patients. There is less evidence about the impact of quality improvement interventions on other key process measures such as screening patients for diabetic complications. This paper provides decision makers with a comprehensive overview of evidence from high quality systematic reviews about the effects of quality improvement interventions on improving diabetes care.
Diabetes is a complex health problem that results in significant morbidity and mortality and health care resource utilisation [1–3]. With projected increases in the incidence of diabetes worldwide, health systems continue to focus on improving and optimising diabetes care by influencing patient behaviour and improving efficiency of care [1–3]. Yet, providing high quality care for diabetics still remains a challenge for healthcare systems and providers.
Recognising that gaps exist between best and actual care, researchers, people with diabetes, clinicians and decision makers have shown an increasing interest in quality improvement (QI) strategies to improve diabetes management . Quality improvement strategies are ‘multidisciplinary, systems-focused, data-driven methods of understanding and improving the efficiency, effectiveness, and reliability of health process and outcomes of care’. QI strategies attempt to ‘reduce the difference between health care processes or outcomes observed in practice and those potentially obtainable based on current evidence-based knowledge’ .
There is substantial evidence and consensus on what constitutes high quality diabetes care . Despite this, suboptimal care and poor patient outcomes continue at the local, national and international level . For example, In Canada, evidence-based clinical practice guidelines for the management of diabetes have been available since 1998 . While these guidelines have contributed to improvements in care [8–10], Ontario diabetes patients are still not optimally managed . For example, between 2005 and 2008 the proportion of diabetes patients who had annual eye exams or foot exams remained fairly static at approximately 51% . Further, only 46% of elderly diabetic patients in Ontario filled prescriptions for both ACE inhibitors and statins despite recommendations that most diabetes patients should receive both [8, 11, 12].
The current interest in QI interventions to improve diabetes care has led to a profusion of primary studies on diabetes that is overwhelming. Whilst systematic reviews partly address this problem of information overload, decision makers often find it difficult to reliably retrieve and keep up to date with the growing volume of published systematic reviews . In addition, available systematic reviews are of variable quality, complexity and length, and are published in a variety of sources . Further synthesis of this evidence is needed to provide reliable and accessible information to clinicians and decision makers. Overviews of systematic reviews are an efficient way to gather the best available evidence in a single source to provide broad, cumulative statements that summarise the current evidence on the effectiveness of interventions. Such overviews are helpful as starting points for decision makers to unpack the evidence towards finding solutions to improving practice and identify areas where new research is needed. This paper reports an overview of systematic reviews of diabetes QI interventions.
We included systematic reviews that evaluated interventions to improve the quality of diabetes care and management in patients of any age, with any type of diabetes, in any setting compared to usual care or other intervention(s). We defined a systematic review as a synthesis of research evidence in which literature searches, inclusion criteria, and critical appraisal methods were explicitly described. We excluded primary studies, and systematic reviews that addressed multiple chronic diseases where it was not possible to isolate the effects of QI interventions on diabetes care.
To be included, systematic reviews had to report effects on at least one intermediate patient outcome, (glycaemic control as measured by glycated haemoglobin (HbA1c) level. vascular risk factor control as measured by high-density lipoprotein, total cholesterol, or blood pressure levels, or maintaining smoking cessation for at least one year) or process of care measure (monitoring HbA1c levels in patients, prescribing appropriate medications such as acetylsalicylic acid, statins, or anti-hypertensive drugs to control vascular risks, conducting retinopathy screening or referring patients for eye examinations, performing foot examinations to screen patients for potential problems such as ulcers or infections, monitoring renal function through testing of creatinine or microalbumin, or prescribing nicotine replacement therapies to promote smoking cessation). We excluded systematic reviews that only reported changes in knowledge or attitudes towards treatment of diabetes .
Search strategy to identify systematic reviews
We searched the following electronic databases without language restrictions: Medline, EMBASE, AARP Ageline, AMED (Allied and Complementary Medicine), and HealthSTAR via OVID, The Cochrane Database of Systematic Reviews and DARE (Database of Abstracts and Reviews) via Wiley, Health Systems Evidence (http://www.healthsystemsevidence.org/), Rx for Change (http://www.rxforchange.ca/), and Google.
We used two search strategies to identify potentially eligible systematic reviews. The strategies are based on those used by Shojania [16, 17] and the Cochrane Effective Practice and Organisation of Care (EPOC) Group. Full details of the searches and rationale are provided in Additional file 1. Search dates spanned 1976 to April 2011.
Two reviewers independently screened all titles and abstracts identified by the searches. We retrieved the full papers of citations that passed the initial screening, and two reviewers independently assessed each against the eligibility criteria. Reviewers compared results and resolved any discrepancies through discussion or third party adjudication.
Two reviewers independently assessed the methodological quality of all reviews that met the eligibility criteria using the ‘assessment of multiple systematic reviews’ (AMSTAR) checklist [18, 19], an 11-item validated measurement tool where reviewers score one point for each criterion met, with higher scores indicating a higher level of methodological quality. Items on the AMSTAR checklist assess criteria such as the comprehensiveness of the search and whether the quality of included studies was evaluated and accounted for . Reviewers compared scores for each item of the AMSTAR checklist and resolved disagreements through discussion or third party adjudication. To present the best available evidence, we extracted data from those systematic reviews that scored five or above .
Two reviewers independently extracted data from each included systematic review using standard forms developed for this overview. We used a consensus process to ensure the consistency and reliability of the data and enlisted the assistance of a third party in cases of disagreement. For each included systematic review, we extracted review level information on the objectives, publication year, number of included studies, search dates, country of origin, method(s) of analysis used, as well as relevant quantitative data such as pooled effect sizes. We did not retrieve primary study publications; rather we abstracted primary study data reported within each systematic review on study design, population, intervention(s), comparator, and direction of effect, whether reported descriptively or numerically. We classified the interventions used in each study using the McMaster Health Forum taxonomy .
At the review level, we categorized each systematic review by quality improvement category (Additional file 2). We analysed, summarised, and reported separately the results of all relevant comparisons within each systematic review using quantitative and qualitative methods as appropriate. We used vote counting as our method of analysis . We counted the number of studies showing a positive direction of effect. If the review reported conflicting results or we were not able to determine the direction of effect, we classified the outcome as unclear. We excluded studies from our analysis that were beyond the scope of this project and reported this for each review.
We considered the results of the intervention effects featured in reviews when five or more of the included studies reported on a given outcome. We determined an intervention to be generally effective when the results of 67% or more of the included studies favoured the intervention; to have mixed effects when the results of 34% to 66% of the included studies favoured the intervention; or to be generally ineffective when the results of fewer than 34% of the included studies favoured the intervention. If there were fewer than five studies reporting on a specific intervention outcome within a systematic review, we considered this to be insufficient evidence to contribute to our overall analysis of that intervention.
Results of the search
Figure 1 details the flow of information through the different stages of this overview using the ‘preferred reporting items for systematic reviews and meta-analyses’ (PRISMA) flow diagram . Our searches resulted in 5,792 article citations. After the initial screening of titles and abstracts, we retrieved 304 articles for full-text review. Of these, we excluded 179 articles that did not meet the eligibility criteria. The remaining 125 systematic reviews were published in 76 journals between 1990 and 2011. We assessed the methodological quality of these systematic reviews and found a median AMSTAR score of 4 (interquartile range, 2 to 6). Fifty systematic reviews were reported in 54 papers (published in 27 different journals), had an AMSTAR score of 5 or more and were included in the overview, and are described in Additional file 3[16, 17, 24–75]. Details of the 75 excluded reviews are provided in Additional file 4.
Description of systematic reviews included in analysis
Forty eight systematic reviews were published after 2000. All were published in English and originated from Australia , Belgium , Canada [16, 43, 54, 62, 64, 67], China , Denmark , France , Germany , the Netherlands [63, 69, 70], Norway , Saudi Arabia , Switzerland , the United Kingdom [25, 33, 34, 39, 40, 44–47, 50–53, 65],[66, 68, 72, 73], and the United States [27, 28, 30, 31, 35, 38, 42, 56–60],[74, 75]. The number of included studies in each review ranged from five to eighty-two. Thirty-one reviews restricted study design to include only randomised controlled trials (RCTs) with or without controlled clinical trials (CCTs) [24–28, 31, 33, 34, 36–38, 42, 44, 46],[47, 51–53, 55, 56, 58, 60, 61, 64–67],[69, 70, 72, 73]. In all but one review that included other study designs, the predominant study design adopted by the included primary studies was the RCT. All reviews except four [16, 34, 38, 50] used more than one method of analysis and thirty-four reviews used meta-analyses [16, 24–28, 30, 31, 33, 36–40, 42, 44–47],[49, 54–56, 59–62, 64, 67, 69–73]. Patient education and support was the most common focus of the included reviews (n = 21), followed by telemedicine (n = 10), broad based reviews (n = 8), provider role changes (n = 7), and organisational changes (n = 4) (Table 1).
Twenty-six systematic reviews focused on type 1 or type 2 diabetes or both [24, 27, 28, 30, 31, 33, 38, 39],[43–46, 49, 51, 52, 54, 56, 57, 59],[61–64, 68, 70, 74], five reviews considered patients with type 1 diabetes only [32, 35, 65, 67, 72], and 16 focused only on type 2 diabetes [16, 25, 26, 36, 37, 42, 47, 50],[53, 55, 58, 60, 66, 69, 71, 73]. Two systematic reviews did not specify the type of diabetes examined [40, 75] and one review addressed a range of chronic conditions that included diabetes as an identifiable subset . Interventions were directed to specific populations or a combination of patients (including family and carers), providers, and the healthcare system.
All but three reviews reported on glycaemic control in patients [33, 69, 75]. Twenty systematic reviews reported on changes in vascular risk factors (cholesterol, systolic and diastolic blood pressure) [16, 30, 33, 36, 37, 43, 45, 47],[52–54, 57–60, 63, 66, 70, 71, 74]. Ten systematic reviews reported on optimal process of care goals [16, 28, 43, 50, 57, 58, 63, 69],[71, 75], with six reporting on HbA1c monitoring [16, 28, 50, 57, 63, 71]. There was considerable heterogeneity among the included primary studies in terms of study designs, settings and interventions.
Quality of systematic reviews included in the analysis
The majority of reviews met AMSTAR criterion relating to the following: conducting a comprehensive search of the literature (49/50); providing a list of the characteristics of included studies (49/50); using appropriate methods to combine the findings of the included studies (48/50); assessing and documenting the scientific quality of included studies (47/50), and using the results of the scientific quality assessment in formulating conclusions (38/50). However fewer studies met AMSTAR criteria relating to the following: using independent reviewers for selecting studies and extracting data (29/50); using publication status as part of the inclusion criteria (25/50); assessing the likelihood of publication bias (22/50); providing an a priori design (21/50), and providing a list of the included and excluded studies (18/50). Only one review met the criteria for reporting conflict of interest of review and studies (Table 2).
Synthesis of broad based reviews
We identified eight systematic reviews evaluating the effectiveness of a range of QI interventions directed to one or more of patients, providers, and healthcare systems (Additional file 3) [16, 31, 43, 61, 63, 66, 71, 75]. Three reviews only included RCTs with or without CCTs. Patient-directed interventions involved education or information provision; [16, 31, 43, 61, 63, 71], provider-targeted interventions included the use of reminders or prompts, educational materials, meetings, and outreach [16, 43, 63, 66, 75]; system-targeted interventions included changes in the physical structure of healthcare facilities, introduction of health records systems or registries, and changes to the site of service delivery [16, 63, 75]. Three reviews examined the effectiveness of multiple approaches in specific patient populations: older adults , socially disadvantaged groups , and minority ethnic groups . Among these reviews, we noted that provider role changes such as role expansion and use of multidisciplinary teams [16, 31, 43, 61, 63, 66, 71, 75], and telemedicine [16, 43, 63, 75] interventions were frequently evaluated. These reviews observed a number of likely effective interventions. For example, Shojania and colleagues [16, 17] reviewed 66 studies (including 50 RCTs) and 11 different QI interventions and observed a mean reduction in HbA1c of 0.42%. Meta-regression identified two interventions that were associated with HbA1c reductions greater than 0.5%, team changes, and case management.
Synthesis of results by intervention category
Patient education and support
Twenty-one systematic reviews examined the impact of patient education and support interventions that help patients and their families or carers understand diabetes and its treatment by providing education and information, emotional and behavioural support, coping strategies, and self-management training [26, 27, 30, 34–38, 42, 45–47, 52, 53],[55, 58–60, 65, 69, 72] (Additional file 3). The majority of reviews only included RCTs with or without CCTs (n = 17). Reviews varied in terms of the content and variety of interventions, the target population, the provider of the intervention, and the setting. We identified reviews evaluating tailored education packages including culturally appropriate education , education for adolescent diabetes patients , support for children vs adults , individual vs group education [36, 37, 42], and education delivered in the community, home, recreational camps, and worksite . The deliverers of patient education interventions, when specified, were nurses (24.8%), dieticians (21.1%), physicians (16.6%), psychologists (12.5%), multidisciplinary teams (8.0%), diabetes educators (7.4%), specialist nurses (3.7%), or others (5.9%). Four reviews did not specify who delivered the intervention [26, 27, 34, 65]. Changes in HbA1c levels in patients were reported in all reviews, with one exception . Ten reviews reported on vascular risk factor control in patients [30, 36, 37, 45, 47, 52, 53, 58–60] and one review focused on diabetic foot outcomes .
Overall, patient education and support interventions were associated with improved glycaemic control for patients of all ages in 18 reviews [26, 27, 30, 35–38, 42, 45–47, 52, 53],[55, 58–60, 65, 72], and with mixed results in two reviews [60, 72] (Table 3). Improved blood pressure [36, 52, 53] and cholesterol [30, 47, 52, 53, 58] levels were also associated with this intervention, though we noted mixed results for blood pressure in one review  and cholesterol in another . A decrease in the occurrence of diabetic foot outcomes such as ulcerations, infections, and amputations was also associated with patient education and support .
We identified ten systematic reviews examining the effectiveness of telemedicine technology in the provision of diabetes care to local and remotely based patients (Additional file 3) [28, 39, 49, 56, 62, 64, 67, 68],[70, 73]. These interventions consisted of the transmission of blood glucose values by patients via phone (including mobile or fax) and computer (Internet or website) to healthcare providers for review, with feedback to patients by phone, videoconference, or other electronic means. Seven reviews only included RCTs with or without CCTs. Two reviews addressed interventions targeted only to children and young adults [67, 68]. Three reviews described a system interface where data were transmitted to a remote server for analysis, after which appropriate automated messages or reminders were sent to patients or their providers [28, 39, 70].
All reviews reported on the clinical effectiveness of the interventions on glycaemic control in patients. Telemedicine interventions improved HbA1c levels in eight reviews [28, 49, 56, 64, 67, 68, 70, 73], and three reviews had mixed results [39, 62, 70]. Where reviews examined different modes of data transmission, it was found that SMS (short message systems), when used alone or in conjunction with the Internet to deliver home glucose records and support, were generally associated with improved glycaemic control in patients [49, 68]. Internet as a primary means of transmission of blood glucose data and support also had a positive effect on glycaemic control .
Provider role changes
Seven systematic reviews examined the effectiveness of changing, expanding, or integrating the roles of healthcare professionals to improve diabetes care and outcomes (Additional file 3) [25, 33, 50, 51, 54, 57, 74]. Three reviews only considered RCTs with or without CCTs. Five systematic reviews examined the impact of role expansion by increasing the responsibilities of pharmacists to include medication management, patient education, and support [50, 54, 74] and expanding the role of the nurse to include educating and monitoring diabetes patients [33, 51]. Other provider role change interventions included role substitution and the use of multidisciplinary healthcare teams. In one of these reviews, local community health workers substituted for medical professionals or worked as part of a multidisciplinary team to provide socioeconomic or culturally appropriate care . In a second review, general practitioners substituted for psychological specialists .
All reviews reported on the clinical effectiveness of the interventions on glycaemic control or vascular risk factor control in patients. Interventions that involved changing, expanding, or integrating the roles of healthcare professionals were associated with improvements in patients’ glycaemic [25, 50, 51, 54, 57, 74], cholesterol [54, 74], and blood pressure levels [33, 54, 74].
Four systematic reviews examined the effectiveness of organisational changes to improve diabetes management and patient care (Additional file 3) [24, 32, 40, 44]. Two reviews only considered RCTs with or without CCTs. Reviews compared the effectiveness of hospital vs home-based  specialist or general practice care , point of care testing for HbA1c at the time of patient consultation , or shared decision making between primary care physicians and specialists in patients receiving ambulatory care . The interventions in these systematic reviews were heterogeneous and included the use of patient/provider reminder systems, protocols, multidisciplinary teams, and interactive communication between primary care physicians and specialists. One review focused solely on outpatient paediatric populations . Changes to patient HbA1c levels were the only outcome reported in these systematic reviews.
The systematic reviews in this intervention category had relatively few included studies and thus provided insufficient evidence to allow us to determine if the organisational changes were associated with improved glycaemic control in patients. Only one systematic review included sufficient studies showing that shared decision making between primary care physicians and specialists improved blood glucose levels .
Summary of the evidence
In this overview, we identified 125 systematic reviews that evaluated the effectiveness of quality improvement interventions to improve diabetes care. We excluded 75 of these from further assessment due to low methodological quality and undertook a detailed analysis of 50 high quality reviews. The majority of included reviews only considered RCTs with or without CCTs; in the remaining reviews that included other designs, RCTs and CCTs were the commonest designs included.
The eight broad based reviews examined a range of different interventions that led to improvements in patient self-management outcomes (glycaemic control and cholesterol levels) and process of care behaviours (HbA1c and retinopathy monitoring) with mixed results for blood pressure control. Based on our assessment of 42 high quality intervention specific reviews, patient education and support interventions were shown to improve HbA1c, blood pressure, cholesterol, and diabetic foot outcomes in patients; telemedicine interventions were associated with improved glycaemic control in patients, and provider role change interventions improved glycaemic and vascular risk factor control in patients. It was unclear what impact organisational interventions had on glycaemic control in patients. It was also unclear if there was a relationship between the above four interventions and improvements in monitoring of HbA1c, vascular risk factors, or retinopathy, or diabetic foot outcomes. The majority of reviews only included randomised trials alone (with or without controlled clinical trials). In general, the results and conclusions of the systematic reviews that only included RCTs with or without CCTs were similar to those including a broader range of designs. We were unable to identify any high quality reviews that focussed on other QI interventions relevant to our objectives, such as financial or regulatory interventions.
Strengths and weaknesses of the overview
Our objective was to synthesise a comprehensive body of published evidence in a single overview. This is a challenging undertaking considering that overview methods are still evolving and a variety of approaches are being used [20, 76, 77]. Strengths of our approach include the use of explicit methods to identify, appraise and summarise available systematic reviews of interventions to improve diabetes management and outcomes. We employed sensitive search strategies that were developed and run by an information specialist with expertise in searching for interventions to improve health care delivery and healthcare systems. Two authors independently undertook study selection, quality appraisal using the validated AMSTAR tool, and data abstraction with a consensus process to address disagreements. Further, we performed a reanalysis of the results of reviews using vote-counting to ensure consistency of analytical approach when considering results across the reviews. We focussed on high quality reviews (any review scoring ≥5 on AMSTAR) as our previous experience suggested that reviews with lower AMSTAR scores are difficult to interpret and likely do not provide reliable evidence. Our approach allowed us to explore whether different review teams addressing similar review questions independently observe similar results and draw broadly similar conclusions. The consistency of findings and conclusions across high quality reviews, for example that patient education and support improves many aspects of diabetes care, suggests that this is not likely a spurious finding due to the review team or methods chosen.
However, overviews inevitably suffer from potential weaknesses, some of which are common to all synthesis projects and others that are specific to overviews. Potential weaknesses that are common to all syntheses include the possibility that our searches missed relevant reviews, or that errors were made during study selection, quality appraisal and data collection. Overview-specific weaknesses relate to the fact that our unit of study is a completed systematic review. Thus, overview authors are dependent upon the methods of the included systematic reviews that potentially suffer from some of the common weaknesses mentioned above. Overviews that consider multiple reviews on the same topic potentially protect against weaknesses in individual reviews unless all included reviews share precisely the same methodological weakness. In our overview we also tried to minimise the likelihood that we would be misled by individual reviews by excluding low quality reviews that are more likely to suffer to from major methodological weaknesses.
Overviews are also dependent on the reporting of the included systematic reviews, which limits the granularity of detail available to the overview author. As a result, the overview author needs to trust the systematic review authors' quality appraisal and data abstraction and is limited by the level of detail in the original systematic reviews when describing characteristics of included studies such as setting, and intervention, etcetera. As well, overviews are limited by the coverage of the identified systematic reviews. For instance, there has been increasing interest in the use of financial interventions to improve diabetes care; the United Kingdom introduced a pay-for-performance incentive program in 2004, rewarding family practices for achieving performance targets in chronic disease management, including diabetes . However, despite this policy interest and the availability of primary studies, we were unable to find any high quality systematic reviews that addressed the effects of financial interventions on quality of diabetes care. Finally, overview authors should expect considerable overlap in the primary studies summarised in the included systematic reviews. As a result it is important not to treat systematic reviews as independent observations but rather see included systematic reviews as a different lens addressing the same question to determine whether different teams draw broadly similar conclusions.
The interventions examined in these reviews were frequently complex. Reporting of complex interventions is often poor in primary studies  and even poorer in systematic reviews that may reduce a short description in a primary study to a few words in a table. This creates a number of difficulties for overview authors; whilst overview authors might be confident that a review does address the overview question frequently, there will be insufficient detail within the review to be able to describe the evaluated reviews in detail, or to determine effective components of complex interventions, or explore potential effect modifiers.
Within our overview, we reanalysed the included reviews using vote counting based on direction of effect. The weaknesses of vote counting are well documented and include the failure to provide an estimate of the effect size of an intervention, failure to take into account the precision of the estimate from the primary comparisons, and giving equal weight to comparisons with 100 or 1,000 participants . Nevertheless, we would argue that vote counting provided a flexible approach to consider effectiveness across reviews with few assumptions given that the included reviews involved different study designs, presented individual study reviews using different metrics and used a variety of analytical approaches (including descriptive analysis, vote-counting, meta-analysis and meta-regression). To increase the confidence, we reported separately, the number of RCTs that contributed to the overall effect for each intervention comparison. Further, we also reported the results of any meta-analyses performed in the reviews that had bearing on the interventions and outcomes of interest.
Implications for policy
Overviews are high-level syntheses of research evidence that provide an evidence map for decision makers and high-level conclusions about an issue. However, it is likely that decision makers will also need to consult some of the included systematic reviews, and potentially the individual studies, to address their specific questions. Thus, this synthesis is best seen as an entry point to evidence to inform healthcare decision makers' policy options about interventions to improve diabetes outcomes. Current initiatives to improve diabetes management and care should be informed by this evidence base. There is consistent evidence that a number of interventions, for example, patient education and support, telemedicine, and provider role changes, appear to improve diabetes quality of care, and policy-makers need to consider whether their current services optimally provide these effective interventions to their population of persons with diabetes. Overall, there is some evidence to suggest that tailoring interventions to specific cultural or age groups may be beneficial to the effectiveness of the treatment strategy. Interventions at an organisational level had insufficient evidence from which to draw conclusions about their effectiveness, and therefore policy makers should be cautious about implementing these approaches until further evidence is available.
Implications for research
There is a considerable body of evidence evaluating interventions to improve diabetes care that should inform future research. Researchers conducting both primary studies and systematic reviews of diabetes quality improvement interventions should consider the breadth of outcomes relevant to excellent diabetes care. In areas with a substantial number of trials demonstrating benefit, for instance, patient education and support, future research should focus on direct comparisons of different delivery methods for the same intervention or of direct comparisons of the relative effectiveness of different interventions.
The results of available systematic reviews should inform the choice and design of evaluated interventions and evaluative methods. For example, new systematic reviews of diabetes QI interventions might focus on interventions where there are few or no current systematic reviews. Patient education provides an example of a group of interventions where the depth and quality of the evidence is abundant and where further reviews may add little to our knowledge unless they address secondary questions such as how to optimise or extend the reach of patient education and support interventions. While we identified some evidence of attempts by researchers to separate the effects of complex interventions, future studies should further focus on such separation in order to provide specific advice on how to optimise efforts to improve diabetes management. Given our observation that 60% of the reviews assessed for this project were rejected based on low AMSTAR scores, researchers are strongly encouraged to consider AMSTAR assessment criteria during the systematic reviewing process in order to improve the methodological quality and/or reporting of their work.
Overviews provide high-level summaries of empirical research. This overview identified and summarised the best current available evidence from 125 systematic reviews on the effectiveness of different QI interventions to improve diabetes care. The results suggest that patient education and support, provider role changes and telemedicine are associated with improved patient outcomes. They can be used by decision makers to identify policy options to improve diabetes care and as a source document to identify systematic reviews and individual studies that are relevant to their context and that address their specific questions. It also identified potential areas for future research; highlighting the problem of (likely) inappropriate duplication of effort between existing systematic reviews and the lack of high-quality systematic reviews addressing interventions of policy interest, such as regulatory or financial interventions.
JMG holds a Canada Research Chair in Health Knowledge Transfer and Uptake.
Allied and Complementary Medicine
Assessment of multiple systematic reviews
Controlled clinical trials
Database of Abstracts and Reviews
Effective Practice and Organisation of Care
Preferred reporting items for systematic reviews and meta-analyse
Randomised controlled trial
Short message system.
Unwin N, Whiting D, Guariguata L, Ghyoot G: Gan De: IDF Diabetes Atlas. 2009, Brussels: International Diabetes Federation
Saydah SH, Eberhardt MS, Loria CM, Brancati FL: Age and the burden of death attributable to diabetes in the United States. Am J Epidemiol. 2002, 156: 714-719. 10.1093/aje/kwf111.
Haffner SM: Coronary heart disease in patients with diabetes. N Engl J Med. 2000, 342: 1040-1042. 10.1056/NEJM200004063421408.
Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, Halperin I, Vachon B, Ramsay T, Manns B, Tonelli M, Shojania K: Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet. 2012, 379: 2252-2261. 10.1016/S0140-6736(12)60480-2.
Williams J, Jackson G, Powers B, Chatterjee R, Prvu Bettger J, Kemper A, Hasselblad V, Dolor R, Irvine R, Heidenfelder B, Gray R: Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Volume 1–Series Overview and Methodology. 2004, Rockville, MD: Agency for Healthcare Research and Quality
American Diabetes Association: Standards of medical care in diabetes 2010. Diabetes Care. 2010, 33: S11-S61.
Gulliford MC, Ashworth M, Robotham D, Mohiddin A: Achievement of metabolic targets for diabetes by English primary care practices under a new system of incentives. Diabet Med. 2007, 24: 505-511. 10.1111/j.1464-5491.2007.02090.x.
Canadian Diabetes Association Clinical Practice Guidelines Expert Committee: Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Can J Diabetes. 2008, 32: s1-s201.
Chan B, Daniel I, Anderson G, Misra A, Comrie R, Newman A, Rey M, Chen J, Brien S, Ceccato C, Wu L, Mullen J, Vincent K, Heydon A, Mitchell A, St-Louis C, Kassam N: Quality Monitor: 2010 Report on Ontario's Health System 2010. 2010, 1-125.
Canadian Diabetes Association: The History of Diabetes. 2011,http://www.diabetes.ca/diabetes-and-you/what/history,
Kearney P, Blackwell L, Collins R, Keech A, Simes J, Peto R, Armitage J, Baigent C: Efficacy of cholesterol-lowering therapy in 18,686 people with diabetes in 14 randomised trials of statins: a meta-analysis. Lancet. 2008, 371: 117-125. 10.1016/S0140-6736(08)60104-X.
Rosen A: Indications for and utilization of ACE inhibitors in older individuals with diabetes. Findings from the National Health and Nutrition Examination Survey 1999 to 2002. J Gen Intern Med. 2006, 21: 315-319. 10.1111/j.1525-1497.2006.00351.x.
Grimshaw J, McAuley LM, Bero LA, Oxman AD, Grilli R, Ramsay C, Vale L, Zwarenstein M: Systematic reviews of the effectiveness of quality improvement strategies and programmes. Qual Saf Health Care. 2003, 12: 298-303. 10.1136/qhc.12.4.298.
Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG, Shea B, Moher D, Graham I, Pham B, Tugwell P: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: 447-455.
Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.
Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 296: 427-440. 10.1001/jama.296.4.427.
Shojania K, Ranji S, Shaw L, Charo L, Lai J, Rushakoff R, Macdonald K, Owens D: Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Volume 2–Diabetes Mellitus Care. 2004, Rockville, MD: Agency for Healthcare Research and Quality
Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007, 7: 10-10.1186/1471-2288-7-10.
Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M: AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009, 61: 1013-1020.
Weir MC, Ryan R, Mayhew A, Worswick J, Santesso N, Lowe D, Leslie B, Stevens A, Hill S, Grimshaw JM: The Rx for Change database: a first-in-class tool for optimal prescribing and medicines use. Implement Sci. 2010, 5: 1-9. 10.1186/1748-5908-5-1.
Health systems evidence, McMaster Health Forum.http://www.healthsystemsevidence.org/,
Bushman B, Wang M: Vote counting procedures in meta-analysis. The Handbook of Research Synthesis and Meta-Analysis. Edited by: Cooper H, Hedges L, Valentine J, Cooper H. 1994, New York: Russell Sage Foundation, 207-220. 2
Moher D, Liberati A, Tetzlaff J, Altman D, The PRISMA Group 2: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement. PLoS Med. 2013, 6: 1000097-
Al-Ansary L, Farmer A, Hirst J, Roberts N, Glasziou P, Perera R, Price C: Point-of-care testing for HbA1c in the management of diabetes: a systematic review and metaanalysis. Clin Chem. 2011, 57: 568-576. 10.1373/clinchem.2010.157586.
Alam R, Sturt J, Lall R, Winkley K: An updated meta-analysis to assess the effectiveness of psychological interventions delivered by psychological specialists and generalist clinicians on glycaemic control and on psychological status. Patient Educ Cons. 2009, 75: 25-36. 10.1016/j.pec.2008.08.026.
Allemann S, Houriet C, Diem P, Stettler C: Self-monitoring of blood glucose in non-insulin treated patients with type 2 diabetes: a systematic review and meta-analysis. Curr Med Res Opin. 2009, 25: 2903-2913. 10.1185/03007990903364665.
Armour TA, Norris SL, Jack J, Zhang X, Fisher L: The effectiveness of family interventions in people with diabetes mellitus: a systematic review. Diabet Med. 2005, 22: 1295-1305. 10.1111/j.1464-5491.2005.01618.x.
Balas EA, Krishna S, Kretschmer RA, Cheek TR, Lobach DF, Boren SA: Computerized knowledge management in diabetes care. Med Care. 2004, 42: 610-621. 10.1097/01.mlr.0000128008.12117.f8.
Brown SA: Meta-analysis of diabetes patient education research: variations in intervention effects across studies. Res Nurs Health. 1992, 15: 409-419. 10.1002/nur.4770150603.
Brown SA: Studies of educational interventions and outcomes in diabetic adults: a meta-analysis revisited. Patient Educ Cons. 1990, 16: 189-215. 10.1016/0738-3991(90)90070-2.
Chodosh J, Morton SC, Mojica W, Maglione M, Suttorp MJ, Hilton L, Rhodes S, Shekelle P: Meta-analysis: chronic disease self-management programs for older adults. Ann Intern Med. 2005, 143: 427-438. 10.7326/0003-4819-143-6-200509200-00007.
Clar C, Waugh N, Thomas S: Routine hospital admission versus out-patient or home care in children at diagnosis of type 1 diabetes mellitus. Cochrane Database Syst Rev. 2007, 2: CD004099
Clark CE, Smith LF, Taylor RS, Campbell JL: Nurse-led interventions used to improve control of high blood pressure in people with diabetes: a systematic review and meta-analysis. Diabet Med. 2011, 28: 250-261.
Cooper H, Cooper J, Milton B: Technology-based approaches to patient education for young people living with diabetes: a systematic literature review. Pediatr Diabetes. 2009, 10: 474-483. 10.1111/j.1399-5448.2009.00509.x.
Couch R, Jetha M, Dryden DM, Hooten N, Liang Y, Durec T, Sumamo E, Spooner C, Milne A, O'Gorman K, Klassen TP: Diabetes education for children with type 1 diabetes mellitus and their families. Evid Rep Technol Assess. 2008, 166: 1-144.
Deakin C, McShane C, Cade J, Williams R: Group based training for self-management strategies in people with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2005, 2: CD003417
Duke SA, Colagiuri S, Colagiuri R: Individual patient education for people with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2009, 1: CD005268
Ellis SE, Speroff T, Dittus RS, Brown A, Pichert JW, Elasy TA: Diabetes patient education: a meta-analysis and meta-regression. Patient Educ Couns. 2004, 52: 97-105. 10.1016/S0738-3991(03)00016-8.
Farmer A, Gibson OJ, Tarassenko L, Neil A: A systematic review of telemedicine interventions to support blood glucose self-monitoring in diabetes. Diabet Med. 2005, 22: 1372-1378. 10.1111/j.1464-5491.2005.01627.x.
Foy R, Hempel S, Rubenstein L, Suttorp M, Seelig M, Shanman R, Shekelle PG: Meta-analysis: effect of interactive communication between collaborating primary care physicians and specialists. Ann Intern Med. 2010, 152: 247-258. 10.7326/0003-4819-152-4-201002160-00010.
Gage H, Hampson S, Skinner TC, Hart J, Storey L, Foxcroft D, Kimber A, Cradock S, McEvilly EA: Educational and psychosocial programmes for adolescents with diabetes: approaches, outcomes and cost-effectiveness. Patient Educ Couns. 2004, 53: 333-346. 10.1016/j.pec.2003.06.003.
Gary T, Genkinger J, Guallar E, Peyrot M, Brancati F: Meta-analysis of randomized educational and behavioral interventions in type 2 diabetes. Diabetes Educ. 2003, 29: 488-501. 10.1177/014572170302900313.
Glazier RH, Bajcar J, Kennie NR, Willson K: A systematic review of interventions to improve diabetes care in socially disadvantaged populations. Diabetes Care. 2006, 29: 1675-1688. 10.2337/dc05-1942.
Griffin S: Diabetes care in general practice: meta-analysis of randomised control trials. BMJ. 1998, 317: 390-396. 10.1136/bmj.317.7155.390.
Hampson SE, Skinner TC, Hart J, Storey L, Gage H, Foxcroft D, Kimber A, Shaw K, Walker J: Effects of educational and psychosocial interventions for adolescents with diabetes mellitus: a systematic review. Health Technol Assess. 2001, 5: 1-69.
Harkness E, Macdonald W, Valderas J, Coventry P, Gask L, Bower P: Identifying psychosocial interventions that improve both physical and mental health in patients with diabetes: a systematic review and meta-analysis. Diabetes Care. 2010, 33: 926-930. 10.2337/dc09-1519.
Hawthorne K, Robles Y, Cannings-John R, Edwards AGK: Culturally appropriate health education for type 2 diabetes mellitus in ethnic minority groups. Cochrane Database Syst Rev. 2008, 3: CD006424
Ismail K, Winkley K, Rabe-Hesketh S: Systematic review and meta-analysis of randomised controlled trials of psychological interventions to improve glycaemic control in patients with type 2 diabetes. Lancet. 2004, 363: 1589-1597. 10.1016/S0140-6736(04)16202-8.
Liang X, Wang Q, Yang X, Cao J, Chen J, Mo X, Huang J, Wang L, Gu D: Effect of mobile phone intervention for diabetes on glycaemic control: a meta-analysis. Diabet Med. 2011, 28: 455-463.
Lindenmeyer A, Hearnshaw H, Vermeire E, Van Royen P, Wens J, Biot Y: Interventions to improve adherence to medication in people with type 2 diabetes mellitus: a review of the literature on the role of pharmacists. J Clin Pharm Ther. 2006, 31: 409-419. 10.1111/j.1365-2710.2006.00759.x.
Loveman E, Royle P, Waugh N: Specialist nurses in diabetes mellitus. Cochrane Database Syst Rev. 2003, 2: CD003286
Loveman E, Cave C, Green C, Royle P, Dunn N, Waugh N: The clinical and cost-effectiveness of patient education models for diabetes: a systematic review and economic evaluation. Health Technol Assess. 2003, 7: 1-190.
Loveman E, Frampton GK, Clegg AJ: The clinical effectiveness of diabetes education models for type 2 diabetes: a systematic review. Health Technol Assess. 2008, 12 (i-iii): 1-52.
Machado M, Bajcar J, Guzzo GC, Einarson TR: Sensitivity of patient outcomes to pharmacist interventions. Part I: systematic review and meta-analysis in diabetes management. Ann Pharmacother. 2007, 41: 1569-1582. 10.1345/aph.1K151.
Minet L, Moller S, Vach W, Wagner L, Henriksen JE: Mediating the effect of self-care management intervention in type 2 diabetes: a meta-analysis of 47 randomised controlled trials. Patient Educ Couns. 2010, 80: 29-41. 10.1016/j.pec.2009.09.033.
Montori VM, Helgemoe PK, Guyatt GH, Dean DS, Leung TW, Smith SA, Kudva YC: Telecare for patients with type 1 diabetes and inadequate glycemic control: a randomized controlled trial and meta-analysis. Diabetes Care. 2004, 27: 1088-1094. 10.2337/diacare.27.5.1088.
Norris SL, Chowdhury FM, Van Le K, Horsley T, Brownstein JN, Zhang X, Jack J, Satterfield DW: Effectiveness of community health workers in the care of persons with diabetes. Diabet Med. 2006, 23: 544-556. 10.1111/j.1464-5491.2006.01845.x.
Norris SL, Engelgau MM, Narayan KM: Effectiveness of self-management training in type 2 diabetes: a systematic review of randomized controlled trials. Diabetes Care. 2001, 24: 561-587. 10.2337/diacare.24.3.561.
Norris SL, Nichols PJ, Caspersen CJ, Glasgow RE, Engelgau MM, Jack J, Snyder SR, Carande-Kulis VG, Isham G, Garfield S, Briss P, McCulloch D: Increasing diabetes self-management education in community settings: a systematic review. Am J Prev Med. 2002, 22: 39-66. 10.1016/S0749-3797(02)00424-5.
Norris SL, Zhang X, Avenell A, Gregg E, Brown TJ, Schmid CH, Lau J: Long-term non-pharmacologic weight loss interventions for adults with type 2 diabetes. Cochrane Database Syst Rev. 2005, 2: CD004095
Pimouguet C, Le Goff M, Thiebaut R, Dartigues JF, Helmer C: Effectiveness of disease-management programs for improving diabetes care: a meta-analysis. CMAJ. 2011, 183: E115-E127.
Polisena J, Tran K, Cimon K, Hutton B, McGill S, Palmer K: Home telehealth for diabetes management: a systematic review and meta-analysis. Diabetes Obes Metab. 2009, 11: 913-930. 10.1111/j.1463-1326.2009.01057.x.
Renders CM, Valk GD, Griffin SJ, Wagner EH, Eijk Van JT, Assendelft WJ: Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 2001, 24: 1821-1833. 10.2337/diacare.24.10.1821.
Russell-Minda E, Jutai J, Speechley M, Bradley K, Chudyk A, Petrella R: Health technologies for monitoring and managing diabetes: a systematic review. J Diabetes Sci Technol. 2009, 3: 1460-1471.
Savage E, Farrell D, McManus V, Grey M: The science of intervention development for type 1 diabetes in childhood: systematic review. J Adv Nurs. 2010, 66: 2604-2619. 10.1111/j.1365-2648.2010.05423.x.
Saxena S, Misra T, Car J, Netuveli G, Smith R, Majeed A: Systematic review of primary healthcare interventions to improve diabetes outcomes in minority ethnic groups. J Ambul Care Manage. 2007, 30: 218-230.
Shulman RM, O'Gorman CS, Palmert MR: The impact of telemedicine interventions involving routine transmission of blood glucose data with clinician feedback on metabolic control in youth with type 1 diabetes: a systematic review and meta-analysis. Int J Pediatr Endocrinol. 2010, 2010: pii536957-
Sutcliffe P, Martin S, Sturt J, Powell J, Griffiths F, Adams A, Dale J: Systematic review of communication technologies to promote access and engagement of young people with diabetes into healthcare. BMC Endocr Disord. 2011, 11: 1-10.1186/1472-6823-11-1.
Valk GD, Kriegsman DMW, Assendelft WJJ: Patient education for preventing diabetic foot ulceration: a systematic review. Endocrinol Metab Clin North Am. 2002, 31: 633-658. 10.1016/S0889-8529(02)00021-X.
Verhoeven F, van Gemert-Pijnen L, Dijkstra K, Nijland N, Seydel E, Steehouder M: The contribution of teleconsultation and videoconferencing to diabetes care: a systematic literature review. J Med Internet Res. 2007, 9: e37-10.2196/jmir.9.5.e37.
Vermeire E, Wens J, Van Royen P, Biot Y, Hearnshaw H, Lindenmeyer A: Interventions for improving adherence to treatment recommendations in people with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2005, 2: CD003638
Winkley K, Ismail K, Landau S, Eisler I: Psychological interventions to improve glycaemic control in patients with type 1 diabetes: systematic review and meta-analysis of randomised controlled trials. BMJ. 2006, 333: 65-10.1136/bmj.38874.652569.55.
Wu L, Forbes A, Griffiths P, Milligan P, While A: Telephone follow-up to improve glycaemic control in patients with type 2 diabetes: systematic review and meta-analysis of controlled trials. Diabet Med. 2010, 27: 1217-1225. 10.1111/j.1464-5491.2010.03113.x.
Wubben DP, Vivian EM: Effects of pharmacist outpatient interventions on adults with diabetes mellitus: a systematic review. Pharmacotherapy. 2008, 28: 421-436. 10.1592/phco.28.4.421.
Zhang X, Norris SL, Saadine J, Chowdhury FM, Horsley T, Kanjilal S, Mangione CM, Buhrmann R: Effectiveness of interventions to promote screening for diabetic retinopathy. Am J Prev Med. 2007, 33: 318-335. 10.1016/j.amepre.2007.05.002.
Becker L, Oxman A: Chapter 22: Overviews of reviews. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 (updated March 2011) edition. Edited by: Higgins J, Green S. 2011, London: The Cochrane Collaboration
Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR: An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011, 7: CD009255-
Doran T, Fullwood C, Gravelle H, Reeves D, Kontopantelis E, Hiroeh U, Roland M: Pay-for-peformance practices in the United Kingdom. N Engl J Med. 2006, 355: 375-384. 10.1056/NEJMsa055505.
Michie S, Fixsen D, Grimshaw J, Eccles M: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Imp Sci. 2009, 4: 40-10.1186/1748-5908-4-40.
We thank the following members of the Diabetes QI Overview Team: Lana Augustinicic, André Bussières, Andrew Cheung, Hélène Laberge, Jordi Pardo, Andrea Silver, Brigitte Vachon, and Amber White - who provided support or carried out specific project-related tasks. This research was funded by the Ontario Ministry of Health and Long Term Care. Study sponsors were not involved in study design, in the collection, analysis and interpretation of data, in the writing of the report, and in the decision to submit the article for publication. Researchers are independent of funders.
The authors declare that they have no competing interests. JMG is an author on one of the included reviews.
JMG, AM and MCW conceptualised the project. MF developed and executed the search strategy. JW, SCW, RB, AM, MCW and JMG screened articles for potential inclusion. JW, SCW, RB, AM and MCW appraised the quality of articles. JW, SCW, RB, AM, KJS and MCW extracted data from the included reviews. JMG, JW, SCW, KJS and MF drafted and revised the manuscript. RB, JW, KJS prepared the tables and figures. All authors had full access to all data, contributed to revision of the manuscript and approved the final version. JMG is the guarantor. All members of the Diabetes QI Overview Team provided additional support and/or carried out specific project-related tasks. All authors read and approved the final manuscript.
Julia Worswick, S Carolyn Wayne, Rachel Bennett, Michelle Fiander, Alain Mayhew, Michelle C Weir, Katrina J Sullivan and Jeremy M Grimshaw contributed equally to this work.
Electronic supplementary material
Authors’ original submitted files for images
About this article
- Diabetes mellitus
- Quality assurance
- Health care
- Quality improvement
- Evidence-based practice
- Evidence-based medicine
- Overview of systematic reviews
- Diabetes management
- Intervention strategies