Interventions for sustained healthcare professional behaviour change: a protocol for an overview of reviews
© The Author(s). 2016
Received: 1 April 2016
Accepted: 5 October 2016
Published: 13 October 2016
Failure to successfully implement and sustain change over the long term continues to be a major problem in health and social care. Translating evidence into routine clinical practice is notoriously complex, and it is recognised that to implement new evidence-based interventions and sustain them over time, professional behaviour needs to change accordingly. A number of theories and frameworks have been developed to support behaviour change among health and social care professionals, and models of sustainability are emerging, but few have translated into valid and reliable interventions. The long-term success of healthcare professional behavioural change interventions is variable, and the characteristics of successful interventions unclear. Previous reviews have synthesised the evidence for behaviour change, but none have focused on sustainability. In addition, multiple overlapping reviews have reported inconsistent results, which do not aid translation of evidence into practice. Overviews of reviews can provide accessible succinct summaries of evidence and address barriers to evidence-based practice. We aim to compile an overview of reviews, identifying, appraising and synthesising evidence relating to sustained social and healthcare professional behaviour change.
We will conduct a systematic review of Cochrane reviews (an Overview). We plan to systematically search the Cochrane Database of Systematic Reviews. We will include all systematic reviews of randomised controlled trials comparing a healthcare professional targeted behaviour change intervention to a standard care or no intervention control group. Two reviewers will independently assess the eligibility of the reviews and the methodological quality of included reviews using the ROBIS tool. The quality of evidence within each comparison in each review will be judged based on the GRADE criteria. Disagreements will be resolved through discussion. Effects of interventions will be systematically tabulated and the quality of evidence used to determine implications for clinical practice and make recommendations for future research.
This overview will bring together the best available evidence relating to the sustainability of health professional behaviour change, thus supporting policy makers with decision-making in this field.
KeywordsOverview Sustainability Professional behaviour change Interventions Healthcare
New clinical evidence, technologies and medicines continue to be developed, promising to improve the health and well-being of populations. Production of such evidence does not guarantee its implementation, let alone its sustained use. Healthcare professionals often need to adapt their clinical or caring behaviours to introduce new evidence-based practice. Supporting healthcare professionals to modify their behaviour and subsequently maintain this change requires effective, replicable implementation interventions that promote sustainable change to ensure consistent delivery of the best clinical practice.
Several reviews have uncovered evidence of intervention strategies that have positively influenced healthcare professional behaviour [4–9]. For example, Ivers et al.  found that audit and feedback significantly influenced the performance of healthcare professionals responsible for patient care. They found small, but potentially important, improvements in professional practice. Similarly, O’Brien et al.  examined the effectiveness of educational outreach visits tested in 69 studies (using qualitative and quantitative designs) involving more than 15,000 healthcare professionals. They found consistent and small effects on prescribing practices, with effects on other types of professional performance varying from small to modest improvements. Other systematic reviews investigated behaviour change interventions within a specific area of healthcare practice such as weight management , device-related infections  and antibiotic prescribing [7, 8].
More recently, Johnson and May 2015  carried out a systematic overview of behaviour change interventions, using a theory-led analysis. Within 67 reviews, they found that a number of interventions, such as modifying peer group norms and expectations and relational restructuring, may be effective in changing healthcare professional behaviour but they did not focus on interventions sustained over the long term.
Despite many systematic reviews indicating promising results of healthcare professional behaviour change interventions in several areas, long-term effects have generally not been studied or evaluated systematically. This is an important oversight since even relatively small changes in provider behaviour, if maintained, have the potential to beneficially impact behaviour and health at a population level. Therefore, there is a need to systematically explore the long-term effectiveness of healthcare professional focused behaviour change interventions (i.e. their sustainability) and to identify which components of these interventions are key factors in effecting any sustained changes.
“Sustainability” is a multidimensional concept that can refer to programmes, capacity, outcomes and practice, but it is poorly defined in the literature [13, 14]. A systematic review that examined sustainability of new programmes and innovation reported that few authors present a working definition or guidance for a model of sustainability .
Scheirer  describes three definitional measures of sustainability: (a) continuing to deliver beneficial services/outcomes to clients (an individual level of analysis); (b) maintaining the programme and/or its activities in an identifiable form, even if modified (an organizational level of analysis) and (c) maintaining the capacity of a community to deliver programme activities after an initial programme created a community coalition or similar structure (a community level of analysis). This overview aims to examine sustainability in the context of individual level outcomes (i.e. health professional behaviour or change or proxy measures of change).
Theories of sustainability
Healthcare professional behaviour change interventions have been developed to promote change in various professional groups, clinical practices and contexts. A variety of theoretical variables, based on psychological theories of behaviour change, have been identified as important in influencing healthcare professional behaviour . These include aspects such as knowledge, skills, beliefs about capabilities, and motivation. Moreover, theories specific to healthcare professional behaviour have been developed and tested systematically, such as the Normalisation Process Theory , but this novel work has not yet led to the widespread development and testing of interventions. Any intervention might draw on a variety of routes to changing behaviour, but much of the healthcare professional intervention literature has lacked a clearly reported theoretical basis . In the absence of explicit use of theory, a recent systematic review of healthcare professional interventions retrospectively examined the targets that interventions implicitly attempted to change . The review found that several likely determinants of healthcare professional behaviour such as “social/professional role and identity”; “optimism”; “reinforcement”; “intentions” and “behavioural regulation” do not appear to have been considered in implementation interventions.
We will conduct an overview of Cochrane reviews of health professional behavioural change interventions. We will synthesise all high-quality review evidence relating to healthcare professional behaviour change and conduct systematic exploration of the evidence relating to long-term sustained outcomes. Overviews of reviews aim to provide a summary of evidence from more than one systematic review at a variety of different levels, including the combination of different outcomes , and can be particularly useful when several related intervention reviews have been completed. Overviews provide a succinct summary of the reviews relevant to a specific question and are particularly useful for decision makers such as clinicians and policy makers .
The objective of this study is to carry out an overview of reviews, based on the methods for Cochrane overviews , in order to report and synthesise the evidence of sustained change in healthcare professional behaviour resulting from interventions aimed at changing health professional behaviour. Where evidence exists, we will describe the extent of the evidence, the degree of sustained change (where “sustained change” is defined as measured change in professional behaviour more than 1 year after the start of the intervention) and the quality of the evidence.
Criteria for considering reviews for inclusion
Cochrane systematic reviews are generally of a better quality than non-Cochrane reviews [21–27]. The primary aim of a Cochrane overview should thus be to summarize multiple Cochrane intervention reviews .
Aim to synthesise data relating to change in group professional behaviour at more than 12 months follow-up
Include randomised controlled trials (RCTs) or cluster randomised controlled trial (cRCTs). If a review includes quasi-randomised controlled trials (qRCTs) as well as RCTs, we will include data from the qRCTs if they have been pooled with data from the RCTs/cRCTs. However, if it is possible to extract data pertaining only to the RCTs/cRCTs, we will do this in preference to including data from qRCTs. In the event that we include evidence from qRCTs, we will highlight and discuss the implications of including this evidence
Investigate intervention(s) for which a key aim is to change behaviour of any professionals in the delivery of a healthcare intervention, e.g. physicians, dentists, nurses, counsellors, clinical psychologists and allied healthcare professions involved in providing direct patient care
Investigate the effect of behavioural change interventions on healthcare professional behaviour or patient outcomes which are proxy measures of healthcare professional behaviour change
Only include studies aimed at changing the behaviour of patients, or a population of patients, and do not include an intervention targeting the behaviour of healthcare professionals. Where reviews include data on both healthcare professionals and patients, we will only include it if the authors have reported the data that specifically relates to healthcare professional outcomes.
The primary and secondary outcomes of interest to this overview are as follows:
Sustained healthcare professional clinical behaviour (behaviour more than 1 year after the start of the intervention). This outcome can be measured by a range of measures, including (but not limited to):
Rate/s of performing prevention, diagnosis and treatment behaviours (e.g. immunisation, blood pressure measurement, prescription, referral, hand washing)
Assessment of adherence/fidelity to procedures or protocols
Healthcare professional non-clinical behaviour, for example, attendance at education or training, professional meetings (sustained and less than 1 year after intervention).
Patient level outcomes as proxy measures for healthcare professional behaviour, for example, number of infections as a measure of health professionals’ hand hygiene behaviour.
Search methods for identification of reviews
Relevant reviews will be identified by hand searching the Cochrane Database of Systematic Reviews (CDSR) (The Cochrane Library, latest issue) by review group, for any published Cochrane reviews. We will only include published reviews. We will not include Cochrane overviews, as the objectives of this overview will differ from those of other overviews. However, we will handsearch reference lists of identified Cochrane overviews for reviews that might meet inclusion for the current overview. We will also contact authors of relevant protocols to ascertain intended completion dates.
Data collection and analysis
Selection of reviews
One reviewer will download all of the reviews from the Cochrane (CDSR) library and will remove any obviously irrelevant titles. Two authors will independently review the abstracts of all remaining records, applying selection criteria to identify eligible reviews. Full papers will be obtained for all reviews considered potentially relevant by at least one reviewer and will be independently assessed for inclusion by two reviewers. Any disagreements between reviewers will be resolved through discussion, involving a third reviewer where necessary.
Data extraction and management
o Overview of evidence. We will synthesise key features of each review including details of the aims and rationale; date of last search; participants (healthcare professional population); interventions (brief description); comparisons; outcomes assessed >1 year from intervention; method of assessing quality of studies; and number of included studies and participants.
o Evidence of sustained change. We will systematically identify any reviews which have measured our primary outcome at >1-year post intervention start.
o Intervention components. For each of the reviews, we will describe the intervention components as coded by the review authors, including both intervention content and delivery components, and note any associations that authors report between intervention components and sustained effectiveness.
We will systematically synthesise the individual studies included within all identified reviews to explore whether any reviews covered the same studies. If overlap between reviews is identified, two overview authors will discuss the overlap with consideration of each review question, comparisons explored, date of the last search and key aspects of methodological quality (e.g. types of studies included, risk of bias assessment). We will use these details to reach agreement regarding which data from which review comparisons should be included within the overview. Any overlaps between included reviews or comparisons will be transparently reported.
For each relevant comparison reported in each included review, one overview author will systematically extract data on the risk of bias (as documented in the published review) ideally using the Cochrane risk of bias tool , of trials within the comparison and the results of any meta-analyses performed. These data will be checked by a second overview author with reference to the published review.
Assessment of methodological quality of included reviews
Quality of included reviews
Two overview authors will independently assess the methodological quality of the included reviews, using the risk of bias in systematic reviews (ROBIS) tool  and present within tabular format. Any disagreements between overview authors will be resolved through discussion, involving a third author where necessary.
Quality of evidence in included reviews
We will report the quality of evidence of RCTs within included reviews, which have measures of sustained change. We will report quality of individual studies according to the review authors’ assessment using the Cochrane risk of bias tool .
o high quality, when further research is very unlikely to change our confidence in the estimate of effect;
o moderate quality, when further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate;
o low quality, when further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate; or
o very low quality, when we are very uncertain about the estimate.
Judgement of GRADE quality will be agreed through discussion involving at least three reviewers and involving additional reviewers where there is disagreement.
We will use a narrative synthesis of included reviews to summarise our findings. Where appropriate, included reviews will be categorised by type of intervention and/or outcome. The narrative synthesis will focus on the overall evidence for sustained effectiveness of interventions, and the association between study components and reported effectiveness, grouped according to the GRADE of the evidence.
This manuscript is the public record of the current overview, and the protocol has therefore not been registered with PROSPERO.
The issue of sustained behaviour change is of paramount importance to decision makers, and currently, the long-term effects of interventions on health professional behaviour are disparate and difficult to access. This overview will therefore bring together into one accessible, comprehensive document, evidence from Cochrane reviews relating to the sustainability of health professional behaviour change, thus supporting policy makers with decision-making in this field.
Behaviour change techniques
Cluster randomised controlled trial
Grading of Recommendations, Assessment, Development and Evaluation
Quasi-randomised controlled trial
Randomised controlled trials
Risk of bias in systematic reviews
This work was undertaken by and on behalf of The Scottish Improvement Science Collaborating Centre (SISCC).
The Scottish Improvement Science Collaborating Centre (SISCC) is funded by the Scottish Funding Council, Chief Scientist’s Office, NHS Education for Scotland and The Health Foundation with substantial additional investment from partner organisations.
SD, PC, AP, HF, JP and BW conceived of the study, participated in its design and coordination and helped to draft the manuscript. Other authors MM, HC, R O’C, AG, SM and JM participated in defining the scope of the review and its design and coordination. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Effective Practice and Organisation of Care. EPOC taxonomy. 2015.Google Scholar
- Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. doi:10.1186/s13012-015-0209-1.View ArticlePubMedPubMed CentralGoogle Scholar
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. doi:10.1186/1748-5908-6-42.View ArticlePubMedPubMed CentralGoogle Scholar
- Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259. doi:10.1002/14651858.CD000259.pub3.Google Scholar
- Flodgren G, Deane K, Dickinson HO, Kirk S, Alberti H, Beyer FR, et al. Interventions to change the behaviour of health professionals and the organisation of care to promote weight reduction in overweight and obese people. Cochrane Database Syst Rev. 2010;3:CD000984. doi:10.1002/14651858.CD000984.pub2.Google Scholar
- Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011;7:CD009255. doi:10.1002/14651858.CD009255.Google Scholar
- Arnold SR, Straus SE. Interventions to improve antibiotic prescribing practices in ambulatory care. Cochrane Database Syst Rev. 2005;4:CD003539. doi:10.1002/14651858.CD003539.pub2.Google Scholar
- Davey P, Brown E, Charani E, Fenelon L, Gould IM, Holmes A, et al. Interventions to improve antibiotic prescribing practices for hospital inpatients. Cochrane Database Syst Rev. 2013;4:CD003543. doi:10.1002/14651858.CD003543.pub3.Google Scholar
- Zwarenstein M, Goldman J, Reeves S. Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2009;3:CD000072. doi:10.1002/14651858.CD000072.pub2.Google Scholar
- O’Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard-Jensen J, Kristoffersen DT, et al. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007;4:CD000409. doi:10.1002/14651858.CD000409.pub2.Google Scholar
- Flodgren G, Conterno LO, Mayhew A, Omar O, Pereira CR, Shepperd S. Interventions to improve professional adherence to guidelines for prevention of device-related infections. Cochrane Database Syst Rev. 2013;3:CD006559. doi:10.1002/14651858.CD006559.pub2.Google Scholar
- Johnson MJ, May CR. Promoting professional behaviour change in healthcare: what interventions work, and why? A theory-led overview of systematic reviews. BMJ Open. 2015;5(9):e008592. doi:10.1136/bmjopen-2015-008592.View ArticlePubMedPubMed CentralGoogle Scholar
- Whelan J, Love P, Pettman T, Doyle J, Booth S, Smith E, et al. Cochrane update: predicting sustainability of intervention effects in public health evidence: identifying key elements to provide guidance. J Public Health. 2014;36(2):347–51.View ArticleGoogle Scholar
- Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17. doi:10.1186/1748-5908-7-17.View ArticlePubMedPubMed CentralGoogle Scholar
- Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Am J Eval. 2005;26(3):320–47.View ArticleGoogle Scholar
- Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33. doi:10.1136/qshc.2004.011155.View ArticlePubMedPubMed CentralGoogle Scholar
- May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res. 2007;7:148. doi:10.1186/1472-6963-7-148.View ArticlePubMedPubMed CentralGoogle Scholar
- Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14. doi:10.1186/1748-5908-5-14.View ArticlePubMedPubMed CentralGoogle Scholar
- Little EA, Presseau J, Eccles MP. Understanding effects in reviews of implementation interventions using the Theoretical Domains Framework. Implement Sci. 2015;10:90. doi:10.1186/s13012-015-0280-7.View ArticlePubMedPubMed CentralGoogle Scholar
- Becker LA, Oxman AD. Chapter 22: overview of reviews. In: Higgins JPT, Green S, editor. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. http://handbook.cochrane.org. The Cochrane Collaboration; 2011.
- Delaney A, Bagshaw SM, Ferland A, Laupland K, Manns B, Doig C. The quality of reports of critical care meta-analyses in the Cochrane Database of Systematic Reviews: an independent appraisal. Crit Care Med. 2007;35(2):589–94. doi:10.1097/01.CCM.0000253394.15628.FD.View ArticlePubMedGoogle Scholar
- Farmer SE, Wood D, Swain ID, Pandyan AD. Assessment of the risk of bias in rehabilitation reviews. Int J Rehabil Res. 2012;35(4):317–22. doi:10.1097/MRR.0b013e3283559b6b.View ArticlePubMedGoogle Scholar
- Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M, et al. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA. 1998;280(3):278–80.View ArticlePubMedGoogle Scholar
- Jorgensen AW, Maric KL, Tendal B, Faurschou A, Gotzsche PC. Industry-supported meta-analyses compared with meta-analyses with non-profit or no support: differences in methodological quality and conclusions. BMC Med Res Methodol. 2008;8:60. doi:10.1186/1471-2288-8-60.View ArticlePubMedPubMed CentralGoogle Scholar
- Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007;4(3):e78. doi:10.1371/journal.pmed.0040078.View ArticlePubMedPubMed CentralGoogle Scholar
- Moja LP, Telaro E, D’Amico R, Moschetti I, Coe L, Liberati A. Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study. BMJ. 2005;330(7499):1053. doi:10.1136/bmj.38414.515938.8F.View ArticlePubMedPubMed CentralGoogle Scholar
- Olsen O, Middleton P, Ezzo J, Gotzsche PC, Hadhazy V, Herxheimer A, et al. Quality of Cochrane reviews: assessment of sample from 1998. BMJ. 2001;323(7317):829–32.View ArticlePubMedPubMed CentralGoogle Scholar
- Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from http://handbook.cochrane.org.
- Whiting P, Savovic J, Higgins JP, Caldwell DM, Reeves BC, Shea B, et al. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2015. doi:10.1016/j.jclinepi.2015.06.005.PubMedGoogle Scholar
- Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6. doi:10.1136/bmj.39489.470347.AD.View ArticlePubMedPubMed CentralGoogle Scholar