- Open Access
The influence of contextual factors on healthcare quality improvement initiatives: a realist review
Systematic Reviews volume 9, Article number: 94 (2020)
Recognising the influence of context and the context-sensitive nature of quality improvement (QI) interventions is crucial to implementing effective improvements and successfully replicating them in new settings, yet context is still poorly understood. To address this challenge, it is necessary to capture generalisable knowledge, first to understand which aspects of context are most important to QI and why, and secondly, to explore how these factors can be managed to support healthcare improvement, in terms of implementing successful improvement initiatives, achieving sustainability and scaling interventions. The research question was how and why does context influence quality improvement initiatives in healthcare?
A realist review explored the contextual conditions that influence healthcare improvement. Realist methodology integrates theoretical understanding and stakeholder input with empirical research findings. The review aimed to identify and understand the role of context during the improvement cycle, i.e. planning, implementation, sustainability and transferability; and distil new knowledge to inform the design and development of context-sensitive QI initiatives. We developed a preliminary theory of the influence of context to arrive at a conceptual and theoretical framework.
Thirty-five studies were included in the review, demonstrating the interaction of key contextual factors across healthcare system levels during the improvement cycle. An evidence-based explanatory theoretical model is proposed to illustrate the interaction between contextual factors, system levels (macro, meso, micro) and the stages of the improvement journey. Findings indicate that the consideration of these contextual factors would enhance the design and delivery of improvement initiatives, across a range of improvement settings.
This is the first realist review of context in QI and contributes to a deeper understanding of how context influences quality improvement initiatives. The distillation of key contextual factors offers the potential to inform the design and development of context-sensitive interventions to enhance improvement initiatives and address the challenge of spread and sustainability. Future research should explore the application of our conceptual model to enhance improvement-planning processes.
Systematic review registration
Contributions to the literature
Spreading and sustaining quality improvement (QI) initiatives in healthcare is a recognised challenge; this research highlights the influence of contextual factors on these efforts.
Although the evidence base around context in QI is increasing, there remains limited knowledge and guidance about which contextual factors are most influential. This review explores how, when and for whom context impacts during the improvement journey across healthcare system levels.
This is the first realist review of context in QI. The realist approach incorporates theory, research evidence and practical knowledge to facilitate the exploration of the multi-level, multi-faceted nature of context, within complex healthcare settings.
Improving health and wellbeing outcomes is a key focus of public sector organisations. Over the last decade, there has been significant effort to utilise quality improvement (QI) within healthcare, as a means of delivering evidence-based care, improving mechanisms of care and clinical outcomes. Quality improvement is the purposive, systematic application of specific methods to improve service configuration or delivery, in order to achieve positive change. Key features are identified as ‘the combination of a ‘change’ (improvement) and a ‘method’ (an approach with appropriate tools), while paying attention to the context, in order to achieve better outcomes’ . Some definitions go further, i.e. ‘healthcare improvement’, which incorporates changes leading to ‘better patient outcomes (health), better system performance (care) and better professional development’ . Within the literature, there is also a distinction made between improvement interventions (for example, bundles or checklists) and the ‘doing of improvement’, the QI approaches and methods used to implement these interventions .
Despite such explicit definitions and approaches, QI results are often mixed, unpredictable or demonstrate limited impact , suggesting that translating evidence into practice and implementing improvement initiatives to achieve effective change is not straightforward. One of the key challenges in healthcare improvement is that what works in one setting does not always readily transfer to other settings [5, 6]. This suggests that many improvements are context-sensitive or even context-dependent , and failure to replicate the impact of previously successful improvement efforts in new settings is often attributed to the ‘problem’ of context . Context is a diverse range of conditions that influences the implementation, effectiveness and spread and sustainability of QI initiatives [9,10,11], hence the need to build context into the systematic approach of QI.
How is context understood?
The definition of context in relation to QI has evolved over time . At its most simplistic, context can be defined as ‘all factors that are not part of a quality improvement intervention itself’ , i.e. ‘the set of characteristics and circumstances or unique factors that surround a particular implementation effort’ ; or anything not directly part of the QI process or intervention . It has also been described as the underlying systems, culture and circumstances of the environment in which an intervention is implemented .
Within the literature, contextual factors are frequently conceptualised as either barriers or facilitators; however, this may be too simplistic . The SQUIRE 2.0 publication guidelines for quality improvement studies in healthcare  recognises context as one of the fundamental reporting items. These guidelines reflect the complex nature of context as the ‘key features of the environment in which the work is immersed and which are interpreted as meaningful to the success, failure, and unexpected consequences of the intervention(s), as well as the relationship of these to stakeholders (e.g. the improvement team, clinicians, patients…)’ .
Why is context important to quality improvement?
Healthcare systems are complex and dynamic, and as such, their contextual interactions are not static. Throughout the improvement journey, different aspects of context can assume more or less importance (exerting more or less influence), depending on the type of intervention being implemented, its infancy or maturity, stage of implementation, system level at which it is targeted, and, in the case of multi-component interventions, specific components . Contextual ‘confounders’ that act as barriers to improvement in one setting may be facilitators in other settings; such confounders often represent ‘typical’ healthcare conditions .
Until relatively recently, improvement and implementation science research paid little attention to context, instead focusing on outcomes, effectiveness and impact. Frequently within research studies, contextual attributes were either not acknowledged, under-reported [16,17,18] or viewed as confounding variables to be controlled for or eliminated, despite being a key determinant of implementation success or failure and spread/sustainability .
Given that improvement is an inherently context-dependent social process, taking place in real-world clinical settings , the influence of context is highly significant, and so stripping out contextual factors from improvement research limits the usefulness and generalisability of findings . Research studies that factor out context are not always able to articulate the crucial ‘how’ and ‘why’ around the success or failure of QI projects within complex healthcare systems, and as such, are not able to predict whether improvement efforts will easily transfer to other settings.
In recent years however, there has been a growing recognition of the influence of context on healthcare improvement efforts [22, 23], with acknowledgement that QI interventions cannot be understood outwith their implementation settings . The variability within the body of literature in this area [9, 16, 17, 25] suggests that further work is required to unpack the role of context, and explore which characteristics of context matter, and how, why, when and for whom they matter.
This realist review was designed to further theoretical understanding of which aspects of context are important and why, and how these factors can be addressed and managed to support healthcare improvement efforts. The research question was how and why does context influence quality improvement initiatives in healthcare? More specifically, the review aimed to (i) identify contextual factors that influence the implementation, effectiveness, sustainability and transferability of QI initiatives in healthcare; (ii) provide a theoretical explanation of how, why, when and for whom these factors are important; and (iii) provide stakeholders (improvement practitioners, clinicians and policymakers) with a practical, up-to-date evidence base relating to the influence of context.
The realist approach
Incorporating theory, research evidence and practical knowledge, realist inquiry is ideal for understanding the issues surrounding implementation in complex healthcare settings. This theory-driven interpretive approach seeks to explain the causes of intervention outcomes and patterns of outcomes and effects, by evaluating knowledge and data from a range of sources . Based on the realist assumption that all interventions and programmes have underlying hypotheses outlining how they are assumed to work, and the factors that might cause change, realist ‘programme theories’ are expressed in terms of context, mechanism and outcome (CMO) configurations [26, 27].
The starting point for the notion of context in realist review is the four contextual ‘layers’ defined by Pawson et al : individuals, interpersonal relations, institution and infrastructure. These realist conceptualisations of context refer to any characteristic of the individual capacities of key actors; the interpersonal relationships between stakeholders; the institutional setting; and the wider societal, economic and cultural infrastructure. This appreciation of context and complexity is significant: the realist approach acknowledges that because interventions are governed and conditioned by the contexts that they are embedded in, there is an inherent challenge with regard to transferability to other settings . This is because factors within particular contexts enable certain mechanisms to trigger outcomes and therefore interventions cannot simply be transferred from one context to another and be expected to achieve the same results [28, 29]. However, realist understandings of ‘what works, for whom and in what settings’ are portable and can generate transferable, generalisable lessons .
We followed a template adapted from Pawson : (1) define scope of review and develop theoretical framework (exploratory background literature searching, stakeholder consultation, theory development); (2) theory-driven purposive search for evidence; (3) appraise evidence and extract data; (4) synthesize data and draw conclusions; (5) disseminate findings. The realist review process is iterative and non-linear, with considerable overlap between stages and work on different steps undertaken simultaneously (Fig. 1). The review was conducted and reported in accordance with the Realist And Meta-narrative Evidence Syntheses: Evolving Standards (RAMESES) guidance and publication standards [31, 32]. No changes were made to the published review protocol .
Exploratory stage: defining the scope of the review and theory development
The objective of the first stage was to understand the scope of the review and develop the programme theory. This involved a number of interconnected iterative processes: scoping (exploratory background literature searching); mapping (defining key themes and concepts, conceptualising context); and consultation with stakeholders and experts. All aspects of this preliminary work informed the programme theory development. A multi-disciplinary advisory group of academics and improvement practitioners was set up to oversee the review, monitor progress, develop consensus and contribute to theory development and interpretation of findings.
In the initial exploratory stage, the review team conducted background searches and consulted with key stakeholders from policy, practice and academia, to map the terrain, refine the research question, and clarify the focus and breadth of the review. This scoping exercise included the identification and scrutiny of key publications examining the role of context in healthcare quality improvement [10, 11, 14, 16, 23, 34, 35]. This approach enabled the review team to ‘get a feel’ for the topic whilst simultaneously gaining a deeper understanding of the research problem.
Involving stakeholders in realist research provides a range of additional perspectives and an ‘expert framing’ of the issues that could contribute to the developing programme theory . Initial stakeholder consultation took the form of telephone interviews with 15 informants in the field of healthcare improvement, lasting between 30–45 min. All except one participant was located in Scotland; the other contributor was based in England. Participants held a range of roles within improvement, and several held dual posts spanning both the NHS and academia. The participants provided representation from the three system levels: macro (policy), meso (national organisation implementation and support roles) and micro (local implementation remit). Accordingly, their viewpoints reflected the various ways in which the different system levels exerted influence on their improvement-related activities. Participants were asked for their views on the role and influence of context in the implementation of QI initiatives. Fifteen interviews were carried out until saturation was reached. The inclusion of stakeholder views and thinking around the impact of context in improvement during the exploratory stage provided rich contextual information, and key themes emerged to support the development of the initial programme theory.
Findings from the exploratory search and insights from stakeholders and experts generated a number of potentially relevant contexts. As part of the realist theory development, the key contexts were mapped to the landscape of healthcare QI within Scotland (using NHS Scotland’s whole-systems approach to quality improvement as the starting point for theory creation) to produce a provisional ‘context map’ (Fig. 2).
The provisional context map formed the basis of further stakeholder engagement. Mapping out the quality improvement landscape within Scotland to represent the emergent theory enabled stakeholders to engage in the exploration of potential contexts, mechanisms and outcomes across macro, meso and micro system levels. This process advanced the initial theory into a generalisable programme theory, applicable to a range of improvement settings.
Developing a generalisable theory of context in QI
Hypothesizing how improvement activity within and between the different contexts was likely to play out in terms of the associated mechanisms and outcomes; we developed a realist programme theory, expanding the provisional context map. The programme theory was our conceptualisation of the healthcare improvement landscape, and the role and influence of contextual factors, representing the interactions between multiple components and multiple levels within a complex system, and illustrating context, mechanism and outcome relationships and the patterns of outcomes and effects. The programme theory, which formed the theoretical framework for the subsequent stages of the review, is summarised in Fig. 3 and Table 1.
Purposive, theory-driven evidence searching
Realist searching processes
The realist approach aims to retrieve sufficient evidence to answer the research question and achieve theoretical saturation, as opposed to a fully comprehensive search . Review evidence from a range of sources was drawn from iterative, broad-brush exploratory searches; these preliminary searches identified a large number of potentially relevant articles that were appraised for inclusion. Further evidence was located via a broad range of methods: electronic database searches, using index terms and free text; reference scanning; citation tracking; searching websites of relevant peer-reviewed journals for QI reporting; electronic alerts, i.e. from Google Scholar, databases, relevant journals; and grey literature searches, including Google searching. Stakeholders with knowledge and experience in delivering QI initiatives and education, from a wide range of organisations, including the National Health Service (NHS), were approached to support and contribute to the search strategy.
Search strategy and eligibility criteria
The search strategy was purposefully broad and driven by the programme theory as it developed and was refined through the course of the review. At the review outset, a number of broad-brush exploratory scoping searches were carried out, yielding a large number of full-text documents, including reviews. During programme theory development, further, mostly informal, searches were conducted iteratively (reflecting the current thinking about the programme theory at each point as it evolved) and additional full-text documents were retrieved and stored, in anticipation of the ensuing stages of the review.
These preliminary searches produced a large number of potentially relevant articles. Assessment of these existing documents was carried out prior to further searching; six of these were included in the final synthesis. Once these documents were screened, selected and appraised, further searches were carried out, building on the evidence generated by the preliminary searches, in order to find additional pertinent evidence to further test and refine the programme theory. Although this included electronic database searching, the majority of studies were located by other means, including searches of relevant journals, electronic alerts, and via informal methods including from personal contacts (project team members or stakeholders) or by ‘serendipitous discovery’. Hence, this second search phase identified some additional articles (e.g. process evaluations and qualitative research studies), to test and refine the evolving programme theory; however, the aim was not to be fully comprehensive, but to identify relevant literature sufficient to enable the role of context to be explored.
The eligibility criteria was set to include empirical research studies of QI initiatives, in primary or secondary healthcare settings, published in English during the previous 10 years, based in developed, industrialised countries. Quality improvement in healthcare is a relatively new area, [1, 8] furthered by the work of the Institute for Healthcare Improvement in the USA . Hence, it was decided to focus on higher-income countries, due to the emphasis placed on improving the quality of healthcare systems in these countries where the use of QI approaches is established and more ‘mature’. Limiting inclusion criteria to the previous 10 years was a similarly pragmatic decision, to restrict the review to relatively recent publications whilst at the same time capturing sufficient evidence within a manageable data set. Further, findings from the background search suggested that the evidence base prior to this point would be unreliable, given that during the first decade of the twenty-first century, QI was considered a relatively new and developing field for health services research , and as a result, contextual issues would be less likely to be explicitly acknowledged or reported in older studies.
Selection and appraisal of documents
The realist selection and appraisal process differs from a traditional systematic review. Assessing whether research is fit for purpose according to relevance and rigour is the realist alternative to quality appraisal in a systematic review. Decisions about rigour and relevance were made on the basis of potential contribution(s) of the study either as a whole or a section could make to the review.
In a realist review, the unit(s) of assessment is not each included study itself or the intervention it describes, but any sections of the study that are relevant to underlying theory and context-mechanism-outcome evidence. Within a document, different kinds of evidence may be relevant to different aspects of the review or the programme theory . Selection of documents for inclusion was based on whether the document as a whole contained any type of evidence, from any part of the study (not just the results or findings), that could contribute to the development, testing, corroboration and/or refinement of any aspect of the programme theory. Decisions were based on, for example whether papers provided any contextual data, data relating to potential mechanisms, identifiable outcomes or CMO examples (either implicit or explicitly author-identified). The various types of evidence (e.g. participant quotes) were recorded and aligned with appropriate aspect(s) of the programme theory (e.g. context, mechanisms or outcomes).
Documents were then assessed for methodological rigour (whether the methods used to generate the relevant data were credible, plausible and trustworthy), whilst bearing in mind that even methodologically weak studies that would be otherwise excluded by a traditional systematic review may contain potentially valuable ‘nuggets’ of understanding . Assessment of rigour therefore focused the extent to which studies provided a detailed description of methods and the level of generalisability of findings. The methodological limitations of any studies included in the review or any particular issues around data quality were noted and considered during the analysis and synthesis.
Data extraction, analysis and synthesis processes
Data extraction, analysis and synthesis was an iterative process beginning with familiarisation and understanding of each study. Each included study was read and re-read, initially for familiarisation and then to assess its relevance to the evidence relating to underlying theory and relevance to the research questions. Within each document, relevant passages containing key evidence were highlighted, annotated and coded to identify contexts, mechanisms, outcomes and CMO configurations. Documents were also examined to capture explanatory accounts, themes, concepts and any other relevant data that might contribute to theory refinement.
‘Bespoke’ data extraction forms were created to capture information from each article on contextual factors, mechanisms and outcomes, along with additional data on QI methodology and implementation. A data extraction template and sample extraction table is available on request from the corresponding author. EC conducted the full data extraction; JA independently reviewed each study; and NG and GM checked a 10% sample for credibility of theory development and refinement and reliability of extraction. Using processes of abstraction and conceptualisation, the reviewers compared and contrasted the evidence, looking for patterns of CMOs across the data that were able to support, contradict or inform the programme theory. Recurring themes were also identified and used to guide the rest of the review process as data extraction and analysis progressed.
Thirty-five studies published between 2010 and 2018 were identified for inclusion (Table 2). The majority (n = 33) were peer-reviewed articles; two were reports. Most studies were from the UK (n = 16) and USA (n = 8), with the remaining studies from Europe (Norway, Holland, Republic of Ireland), Canada and Australia. Although a variety of study designs were represented, studies were predominantly qualitative, including two realist evaluations. Five were mixed-methods, and two were embedded in wider studies. One study used a longitudinal design, and two involved secondary analysis. Thirteen studies specifically aimed to explore the influence of context or contextual factors. Others addressed contextual issues indirectly in the form of organisational culture, barriers and facilitators to implementation, or improvement capacity and capability. Nineteen studies used a guiding theoretical model or framework, most commonly PARIHS (n = 5) and MUSIQ (n = 4).
Secondary care was the most predominant setting (n = 22) and the majority of the studies reported macro-level results from across more than one hospital or organisation. The studies involved participants with a wide range of experience, including clinicians, organisation leaders, managers, support staff and internal/external QI facilitators, from a variety of settings. Most of the studies reported on improvement initiatives targeting specific systems or processes, such as the implementation of preventive care practices, care bundles, patient safety practices, evidence-based guidelines, checklists or the redesign of clinical pathways/processes. Other types of QI activities included continuous quality improvement (CQI). A variety of standard QI methods and tools were described across the studies. Eleven studies reported on QI collaborative models. Reporting on QI methodology in a small number of the studies was of poor quality, with a lack of detail on the specific improvement methods used.
In this section, the various representations of context across the included studies are first explored. Then, we describe the four key domains that emerged from the data—leadership, organisational characteristics, change agents and multi-disciplinary collaboration—reflecting contextual influences at levels of the system. Findings from the evidence synthesis further distilled the four domains into eight key contextual factors: leadership, organisational culture, individual skills and capabilities, organisational capacity and capability, data and technical infrastructure, readiness for change, championship and relationships. The contextual factors were shown to interact across healthcare system levels (macro, meso and micro), during the stages of improvement. A generalisable theoretical model was then developed to illustrate the interactions between contextual factors, system levels and the various stages of the improvement journey along a trajectory where improvements are planned, implemented, sustained and spread.
Representations of context within improvement settings
Within the studies reviewed, context was represented in a variety of ways within the literature, highlighting its dynamic, multi-dimensional and highly variable nature. It was characterised both within and across studies as political, economic, social, inner/outer setting, institutional, organisational and individual. However, context was also strongly intertwined with ‘culture’, both at local and organisational levels [40,41,42,43,44, 46, 52, 53, 55,56,57, 62, 65, 66]. It was also used as a means to demonstrate system complexity, through the interactions at the micro, meso and macro system levels [38, 44, 46, 47, 49, 54, 57, 64, 67, 68, 71], supporting the programme theory. Multiple interactions between different aspects of context were reported across the evidence, for example the influence of macro-level contexts on the micro system or the tensions and trade-offs between the two [38, 43, 49, 52, 53, 57, 60, 63].
Some studies attempted to define context within a hierarchy of factors [47, 54, 58, 71]. Others made a clear distinction between local contexts (as the implementation setting) and the broader contextual landscape ; for example, one study identified three distinct types of context—the setting of care context, the project-specific context and the wider general QI and implementation (QI&I) context . Many studies considered and compared pre- and post-implementation contexts [38, 41, 46, 48, 67].
Awareness of the potential impact of implementation contexts and local conditions featured widely in the literature in a range of forms. Context was described both in negative and positive terms: frequently contextual factors were portrayed as barriers and/or facilitators [46,47,48, 50, 69], and in one instance, context was viewed as a continuum of conditions from positive/favourable/strong influences to negative/unfavourable/weak influences . Interrelationships among contextual elements acted as barriers to uptake at some sites and as facilitators at other sites, and as such were a predictor of intervention uptake . Some studies explored implementation in multiple settings, highlighting that conditions for readiness, underlying mechanisms and outcomes of the same intervention could be very different depending on the organisational context [43, 52, 53, 56, 60, 66].
A ‘context assessment’ process [51, 71] was reported in a number of studies, often synonymous with pre-implementation quality planning, and preparation for implementation, spread and sustainability prior to the start of a project. These assessments aimed to build an in-depth understanding of the setting (internal context), tasks, outcomes and environment into which the initiative would be introduced. Assessments included the examination of organisational structures and processes, i.e. pre-existing patterns of working and communication mechanisms. In practical terms, this involved actively engaging frontline staff and other stakeholders and encouraging participation or co-design [39, 43, 45, 46, 54], assessing and/or developing capacity and capability in clinical microsystems [42, 46, 52, 57] and addressing organisational readiness prior to implementation [54, 66].
In some studies, teams utilised QI methods as tools to help them understand and analyse the complexity of their systems , whereas others used specific frameworks to systematically evaluate their local context and identify relevant contextual factors to address, e.g. the context curriculum developed using MUSIQ, which facilitated teams’ use of QI methodology to address contextual factors to reduce barriers and support implementation .
In contrast to the design of ‘bespoke’ programmes developed for individual contexts (i.e. ‘contextualised’ to specific settings), a process of tailoring to context or ‘adapting’ to achieve fit was described . This acknowledges activities often undertaken to modify improvement initiatives and implementation approaches to suit local conditions, in order to achieve ‘fit’ or integration with existing practices. Interactions between context and intervention were reported [54, 68] and the inter-relationship between intervention and context to achieve fit worked both ways: other studies reported on attempts to modify or ‘improve’ the local context prior to QI implementation in order to make it more supportive/receptive or to ameliorate the effects of contextual factors that impeded improvement efforts [48, 51]. An example commonly mentioned was the alignment of national priorities to local work/improvement contexts or vice-versa [49, 53, 63]. However, misalignment of QI programme goals to local conditions/priorities, or an inability to achieve fit, was also highlighted [37, 38, 43, 61, 70] as a challenge when a mismatch between features of programme design/delivery and implementation contexts occurred.
Using the programme theory (Fig. 3) as a framework, the 35 review studies were examined to identify which contextual factors influenced the implementation, effectiveness, sustainability and transferability of QI initiatives within healthcare. Analysing the data against the programme theory, four key domains emerged—leadership, organisational characteristics, change agents and multi-disciplinary collaboration.
Leadership was a key element in the review programme theory—both within the ‘organisation’ context and as a mechanism to deliver outcomes.
Supporting ‘organisation’ as a key context in the programme theory, this domain emerged very strongly from the evidence, broadly reflecting system-level (micro/meso) and individual-level contextual factors. It included organisational structures, processes and human resource functions. Awareness of the potential impact of organisational contexts and local conditions are featured widely in the review and included examples of context assessment. The evidence showed that organisational infrastructure should ideally be supportive of improvement, and a key element identified was organisational ‘culture’, i.e. the history, policies, strategy and governance of an organisation, underpinned by shared vision, beliefs and patterns of behaviour. These core values, attitudes, norms and underlying ideologies shaped the implementation context in multiple ways, alongside the level of organisational ‘QI maturity’. An organisation’s QI maturity was highlighted in a number of studies as being one of the key factors influencing the successful implementation of an improvement initiative.
Consistent with the programme theory descriptions of the various roles of individuals as ‘drivers of QI’, leading change within the key ‘stakeholder’ context, the role of change agents was frequently reported in the evidence in a variety of forms, from local champions to external QI experts.
Multi-disciplinary collaboration featured very strongly across the included studies, despite playing a lesser role in the programme theory, where it was conceptualised as both mechanism and outcome. Interconnected elements within this domain included professional diversity, relationship building, teamwork and communication; these reinforced other aspects of the programme theory.
These four domains reflected contextual influences at all levels of the system. Examples from the realist exploration of how, why, when and for whom these contextual domains are important to improvement initiatives are provided in Table 3.
A number of key mechanisms that influenced the delivery of quality improvement initiatives (outcomes) were identified from the literature, supporting the programme theory. The mechanisms were applied to different system levels (Table 4).
The map of the theoretical and conceptual landscape of healthcare QI was redrawn with the integration of tacit knowledge from stakeholders, to produce a broader, more descriptive model (Fig. 4), refining the refined interpretations of context that had emerged from review findings. Given the interpretive and subjective nature of the realist approach [72, 73], this sense-checking exercise was invaluable. Revising the context map enabled progression beyond the data domains, towards an enhanced understanding and the identification of contextual factors and their influence and impact.
Findings from the evidence synthesis further distilled the four domains into eight key contextual factors (Table 5): leadership, organisational culture, individual skills and capabilities, organisational capacity and capability, data and technical infrastructure, readiness for change, championship and relationships.
Explanatory theoretical model
A generalisable theoretical model (Fig. 5) was developed to illustrate the interactions between contextual factors, system levels and the various stages of the improvement journey along a trajectory where improvements are planned, implemented, sustained and spread.
Recognising that context runs all the way through the improvement continuum, we anticipate that the model could support the examination of contextual factors’ influence at each system level during the stages of an improvement initiative. From pre-planning onwards, this model could enhance the understanding of the QI context, and the dynamic, complex systems within it, whilst acknowledging the variation of contextual factors between settings.
We identified four contextual domains that influence the implementation, effectiveness, sustainability and transferability of QI initiatives in healthcare. Further unpacking of these domains led to the distillation of eight key contextual factors, which apply to multiple system levels in varied healthcare settings. This review demonstrates the impact of context across all stages of the improvement journey, from the pre-planning and implementation stages, towards achieving spread and sustainability. Our findings follow Øvretveit et al.’s  view of contextual conditions as ‘influences which interact with each other, and interact with the implementation process’; however, we also acknowledge the dynamic relationship between contextual factors and system levels that occurs during the entire cycle of improvement, pre- and post-implementation. The mutually emergent domains and contextual factors identified in this review are all interconnected—and to a lesser degree, overlapping—so they cannot be viewed in isolation, underlining the complex systems approach to QI [3, 24]. What also became apparent during the course of the review is that the key mechanisms underlying successful quality improvement initiatives are relational and social processes that are fluid, flexible and interrelated (Table 4), played out within equally fluctuating contexts and constantly changing systems. These processes do not easily fit into a structured model.
Within realist reviews, it is common practice to refine the programme theory and CMO configurations (context + mechanism = outcome). The outcomes for this review are reflected as the eight contextual factors within the evidence-informed theoretical explanatory model (Fig. 5), rather than specific standalone outcomes within CMO configurations. The contexts, mechanisms and outcomes interrelate and overlap between the system levels and their influence at those levels change, along with the role they play within the CMO configurations. For example:
|National: government policies||Consistent support for QI through policies and strategies||Leadership within organisations|
|Organisation: leadership||Organisational response||Organisational capacity and capability|
|Clinical microsystem: individuals||Developing capacity for improvement||Individual skills and capabilities|
The original review programme theory was formed around four main contexts: the national policy context (macro); the organisational context (including leadership, culture and systems—macro/meso); the clinical microsystem (where most improvements take place—meso/micro); and the stakeholder context (conceptualised as the context of ‘individual change’—micro).
Review findings strongly identified with the latter three contexts and explored the context in and around interventions at these levels, emphasising the dimensions within the organisational context, with a focus on system levels, reinforcing the notion that most improvement and change is taking place at the micro and meso levels. However, whilst that was the primary focus for the majority of studies, the national or macro context was commonly seen as an overarching contextual influence on QI initiatives. Studies frequently reported that regional or national government policies or national agency directives were behind the initiatives. This illustrates the external contextual influences on organisations and the importance of the organisational characteristics, as key mechanisms working to align and accept the ‘change’ and support the initiative.
‘Organisational characteristics’ was identified as one of the four contextual domains, and context assessments were highlighted in the review as a mechanism to gain a greater understanding of internal organisational contextual influences and readiness for change. The key elements within this domain are related to culture and the multiple subcultures that can act both to drive change and to undermine improvement efforts . Lukas et al.  suggest that in some instances the clinical microsystem culture may assume more significance to improvement than the wider organisational culture, which ties in with the importance of clinical microsystems within the review programme theory. The challenges of organisational contexts, ranging from individual/team capacity and capability to deliver QI, to the infrastructures that support an organisation’s learning and technical capacity to plan, manage and monitor improvements, have also been noted elsewhere [75, 77,78,79,80].
Across the review evidence, there was a strong focus on the role of leadership in various forms. Within the programme theory, leadership was originally characterised as ‘strong leadership’; this was later revised in light of discussions with stakeholders. They viewed successful leaders as ‘active’ and ‘supportive’ within a high-trust environment where all staff are encouraged to lead improvement, reinforcing the notion of a blended leadership model at different levels of the system—demonstrated in a number of the review studies. Also highlighted was the close interaction between leadership and organisational culture, which in turn influenced improvement leadership and management.
This review emphasises the importance of stakeholders (individuals/teams and their capacities and skills) within the improvement process, particularly around the key roles of change agents and champions [19, 81] in supporting the success of QI interventions at the microsystem and senior organisational support for initiatives. The ‘change agents’ domain and contextual factor ‘championship’ align with McCormack et al.’s  conceptualisation of change agency as ‘roles that are aimed at effecting successful change in individuals and organizations’.
Review strengths and limitations
The use of a realist approach in this review was a key strength. Input from stakeholders with practical knowledge and experience of quality improvement within healthcare settings facilitated the generation of conceptually rich findings with theoretical depth. Stakeholder input and feedback were incorporated at various stages of the review process, playing an important role in generating the initial CMO configurations and to ‘sense check’ and refine the theoretical framework and the final outputs. This contribution helped to temper the interpretive and potentially subjective nature of realist synthesis and provided validation, adding credibility and grounding the findings in real-world knowledge and experience.
A limitation of this review is that a small number of studies were weak in terms of their descriptions of QI methodology and lacked detail on the specific improvement methods or tools used within the study. In a number of studies, the assessment of context was conducted retrospectively rather than prospectively, which is less likely to produce meaningful, transferable findings and avoid recall bias . However, despite this limitation, most studies included (either explicit or implicit) rich contextual information, which contributed to the review.
Further, it must be noted that the included literature was predominantly from the acute care sector (two-thirds of the studies were in hospital settings), based in the USA and UK. Other reviews have demonstrated similarities [10, 23, 34, 78], which is unsurprising, given that the origins of QI in healthcare can be traced to the USA  and most QI training curricula are founded in the USA . For the purposes of this review, the focus was higher-income countries, where QI approaches tend to be more embedded and ‘mature’ due to the established emphasis on improving the quality of healthcare systems through the use of QI methodologies.
Implications for future research and practice
The explanatory theoretical model provides a practical reflection of the current evidence base in relation to the influence of context on improvement activities. As an ‘aide memoir’, it can encourage the contemplation of contextual factors by practitioners, senior staff and policy makers to enhance the delivery of improvement initiatives. The next stage of this work will be to maximise the learning from the study, and to consider the application of the explanatory theoretical model in real-world settings: working with researchers and improvement practitioners, to facilitate the translation of the review findings and theoretical model into practical application. This will involve the consideration and co-development of who will use it (e.g. clinical teams, QI practitioners, organisations), when it should be used (e.g. at the pre-planning stage of local initiatives, planning the adoption of national initiatives, or to spread existing improvements to other contexts) and what form it should take. This co-development process will enable practitioners to have a greater understanding of the influence of context on quality improvement initiatives and will give researchers an opportunity to evaluate the impact of a more context-sensitive approach to the design and implementation of improvement initiatives, across health and social care, to advance practice and accelerate change.
To our knowledge, this is the first realist review investigating the influence of context in healthcare quality improvement. The use of a realist approach enabled identification of the key contextual factors that influence QI initiatives in healthcare and provides a theoretical explanation of how, why, when and for whom these contextual factors are important to QI initiatives, at different system levels and during the stages of improvement. This review enhances the evidence base around context in QI and addresses the limited knowledge and guidance about which contextual factors to consider.
Our explanatory theoretical model reflects that the interplay between improvement interventions and their context is a fluid interaction and as such, each can influence the other directly and indirectly in multiple ways. Working within complex adaptive systems, the model reflects the current evidence base around context and provides practitioners with an informed approach to consider how the influence of these contextual factors will impact within their own setting. The factors are not weighted by importance, as their influence will vary from setting to setting. The model provides a practical ‘aide memoir’ that supports pre-planning conversations at the micro system level, either at the start of an initiative or more importantly when spreading changes from one setting to another that can be applied to multiple settings that are constant state of change.
This research has produced the foundations to enhance improvement practices, through the co-development with improvement practitioners and policy makers to advance knowledge and the practical assessment of the role and influence of context in healthcare practice settings.
Availability of data and materials
The datasets generated and analysed during this study are available from the corresponding author on reasonable request.
Model for understanding success in quality
Promoting Action on Research Implementation in Health Services
Realist And Meta-narrative Evidence Syntheses: Evolving Standards
Standards for QUality Improvement Reporting Excellence
Health Foundation. Quality improvement made simple. London: Health Foundation; 2013.
Batalden PB, Davidoff F. What is ‘quality improvement’ and how can it transform healthcare? Qual Saf Health Care. 2007;16(1):2–3 https://doi.org/10.1136/qshc.2006.022046.
Dixon-Woods M. Improving quality and safety in healthcare. Clin Med. 2019;19(1):47–56 https://doi.org/10.7861/clinmedicine.19-1-47.
Health Foundation. Overcoming challenges to improving quality. Lessons from the Health Foundation’s improvement programme evaluations and relevant literature. London: Health Foundation; 2012.
Shekelle PG, Pronovost PJ, Wachter RM, Taylor SL, Dy S, Foy R, et al. Assessing the evidence for context-sensitive effectiveness and safety of patient safety practices: developing criteria. AHRQ Publication No. 11-0006-EF. Rockville, MD: Agency for Healthcare Research and Quality; 2010.
Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ, et al. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205 https://doi.org/10.1111/j.1468-0009.2011.00625.x.
Horton T, Illingworth J, Warburton W. The spread challenge. London: Health Foundation; 2018.
Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6):S57–60 https://doi.org/10.5694/j.1326-5377.2004.tb05948.x.
Damschroder LJ, Aron DC, Keith RE, Kirsch SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50 https://doi.org/10.1186/1748-5908-4-50.
Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010;88(4):500–59 https://doi.org/10.1111/j.1468-0009.2010.00611.x.
Øvretveit J. Understanding the conditions for improvement: research to discover which context influences affect improvement success. BMJ Qual Saf. 2011;20(Suppl_1):i18-i23. https://doi.org/10.1136/bmjqs.2010.045955.
Szymczak JE. Beyond barriers and facilitators: the central role of practical knowledge and 18 informal networks in implementing infection prevention interventions. BMJ Qual Saf. 2018;27(10):763–5 https://doi.org/10.1136/bmjqs-2018-008512.
Ogrinc G, Davies L, Goodman D, Batalden PB, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2016;25(12):986–92 https://doi.org/10.1136/bmjqs-2015-004480.
Taylor SL, Dy S, Foy R, Hempel S, McDonald KM, Øvretveit J, et al. What context features might be important determinants of the effectiveness of patient safety practice interventions? BMJ Qual Saf. 2011;20(7):611–7 https://doi.org/10.1136/bmjqs.2010.049379.
May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016;11(1):141 https://doi.org/10.1186/s13012-016-0506-3.
McDonald KM. Considering context in quality improvement interventions and implementation: concepts, frameworks, and application. Acad Pediatr. 2013;13(6 Suppl):S45–53 https://doi.org/10.1016/j.acap.2013.04.013.
Pfadenhauer L, Rohwer A, Burns J, Booth A, Lysdahl KB, Hofmann B, et al. Guidance for the assessment of context and implementation in health technology assessments (HTA) and systematic reviews of complex interventions: the Context and Implementation of Complex Interventions (CICI) framework. Integrated Health Technology Assessment for Evaluating Complex Technologies (INTEGRATE-HTA). 2016. https://www.integrate-hta.eu/wp-content/uploads/2016/02/Guidance-for-the-Assessment-of-Context-and-Implementation-in-HTA-and-Systematic-Reviews-of-Complex-Interventions-The-Co.pdf Accessed 7 Oct 2019.
Wells S, Tamir O, Gray J, Naidoo D, Bekhit M, Goldmann D. (2018) Are quality improvement collaboratives effective? A systematic review. BMJ Qual Saf 2018;27:226-240. https://doi.org/10.1136/bmjqs-2017-006926.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629 https://doi.org/10.1111/j.0887-378X.2004.00325.x.
Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S. Publication guidelines for improvement studies in health care: evolution of the SQUIRE project. Qual Saf Health Care. 2008;17(Suppl I):i3–i9. https://doi.org/10.1136/qshc.2008.029066.
Mormer E, Stevans J. Clinical quality improvement and quality improvement research. Perspect ASHA Spec Interest Groups. 2019;4(1):27–37 https://doi.org/10.1044/2018_PERS-ST-2018-0003.
Øvretveit J. How does context affect quality improvement? In: Perspectives on context. London: The Health Foundation; 2014.
Fulop N, Robert G. Context for successful quality improvement: evidence review. London: The Health Foundation; 2015.
Ramaswamy R, Reed J, Livesley N, Boguslavsky V, Garcia-Elorrio E, Sax S,et al. Unpacking the black box of improvement. Int J Qual Health Care. 2018;30(suppl_1):15–19. https://doi.org/10.1093/intqhc/mzy009.
Kaplan HC, Provost LP, Froehle CM, Margolis PA. (2012) The model for understanding success in quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf 2012;21(1):13–20. https://doi.org/10.1136/bmjqs-2011-000010.
Pawson R. Evidence-based policy: a realist perspective. London: Sage; 2006.
Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review - a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(1):21–4 https://doi.org/10.1258/1355819054308530.
Greenhalgh T, Wong G, Jagosh J, Greenhalgh J, Manzano A, Westhorp G, et al. Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation. BMJ Open. 2015;5(8):e008567 https://doi.org/10.1136/bmjopen-2015-008567.
Nielsen K, Miraglia M. What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research. Hum Relat. 2017;70(1):40–62 https://doi.org/10.1177/0018726716670226.
Goodridge D, Westhorp G, Rotter T, Dobson R, Bath B. Lean and leadership practices: development of an initial realist program theory. BMC Health Serv Res. 2015;15:362. https://doi.org/10.1186/s12913-015-1030-x.
Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: realist syntheses. BMC Med. 2013;11:21 https://doi.org/10.1186/1741-7015-11-21.
Wong G, Westhorp G, Pawson R, Greenhalgh T. Realist synthesis: RAMESES training materials. The RAMESES Project. 2013. http://www.ramesesproject.org/media/Realist_reviews_training_materials.pdf Accessed 7 Oct 2019.
Coles E, Wells M, Maxwell M, Harris FM, Anderson J, Gray NG, et al. The influence of contextual factors on healthcare quality improvement initiatives: what works, for whom and in what setting? Protocol for a realist review Syst Rev. 2017;6:168 https://doi.org/10.1186/s13643-017-0566-8.
Kringos DS, Sunol R, Wagner C, Mannion R, Michel P, Klazinga NS, et al. The influence of context on the effectiveness of hospital quality improvement strategies: a review of systematic reviews. BMC Health Serv Res. 2015;15:277 https://doi.org/10.1186/s12913-015-0906-0.
Pfadenhauer L, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework. Implement Sci. 2017;12(1):21 https://doi.org/10.1186/s13012-017-0552-5.
Pawson R. Digging for nuggets: how ‘bad’ research can yield ‘good’ evidence. Int J Soc Res Methodol. 2006;9(2):127–42 https://doi.org/10.1080/13645570600595314.
Armstrong N, Herbert G, Brewster L. Contextual barriers to implementation in primary care: an ethnographic study of a programme to improve chronic kidney disease care. Fam Pract. 2016;33(4):426–31 https://doi.org/10.1093/fampra/cmw049.
Benning A, Ghaleb M, Suokas A, Dixon-Woods M, Dawson J, Barber N, et al. Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation. BMJ. 2011;342:d195 https://doi.org/10.1136/bmj.d195.
Boaz A, Robert G, Locock L, Sturmey G, Gager M, Vougioukalou S, et al. What patients do and their impact on implementation: an ethnographic study of participatory quality improvement projects in English acute hospitals. J Health Organ Manag. 2016;30(2):258–78 https://doi.org/10.1108/JHOM-02-2015-0027.
Carney M. Influence of organizational culture on quality healthcare delivery. Int J Health Care Qual Assur. 2016;24(7):523–39 https://doi.org/10.1108/09526861111160562.
Curry LA, Brault MA, Linnander EL, McNatt Z, Brewster AL, Cherlin E, et al. Influencing organisational culture to improve hospital performance in care of patients with acute myocardial infarction: a mixed-methods intervention study. BMJ Qual Saf. 2018;27(3):207–17 https://doi.org/10.1136/bmjqs-2017-006989.
Darley S, Walshe K, Boaden R, Proudlove N, Goff M. Improvement capability and performance: a qualitative study of maternity services providers in the UK. Int J Qual Health Care. 2018;30(9):692–700 https://doi.org/10.1093/intqhc/mzy081.
Dixon-Woods M, Leslie M, Tarrant C, Bion J. Explaining Matching Michigan: an ethnographic study of a patient safety program. Implement Sci. 2013;8:70 https://doi.org/10.1186/1748-5908-8-70.
Dückers MLA, Wagner C, Vos L, Groenewegen PP. Understanding organisational development, sustainability, and diffusion of innovations within hospitals participating in a multilevel quality collaborative. Implement Sci. 2011;6:18 https://doi.org/10.1186/1748-5908-6-18.
Edward KL, Walker K, Duff J. A multi-state, multi-site, multi-sector healthcare improvement model: implementing evidence for practice. Int J Qual Health Care. 2017;29(5):740–4 https://doi.org/10.1093/intqhc/mzx099.
Flynn R, Hartfield D. An evaluation of a frontline led quality improvement initiative: barriers and facilitators to its success as part of a new quality management framework. Leadersh Health Serv. 2016;29(4):402–44 https://doi.org/10.1108/LHS-11-2015-0039.
Gagliardi AR, Webster F, Brouwers MC, Baxter NN, Finelli A, Gallinger S. How does context influence collaborative decision-making for health services planning, delivery and evaluation? BMC Health Serv Res. 2014;14:545 https://doi.org/10.1186/s12913-014-0545-x.
Gingold J, Briccetti C, Zook K, Gillespie CW, Gubernick R, Moon R, et al. Context matters: practitioner perspectives on immunization delivery quality improvement efforts. Clin Pediatr. 2016;55(9):825–37 https://doi.org/10.1177/0009922815625874.
Gjestsen MT, Wiig S, Testad I. What are the key contextual factors when preparing for successful implementation of assistive living technology in primary elderly care? A case study from Norway. BMJ Open. 2017;7(9):e015455 https://doi.org/10.1136/bmjopen-2016-015455.
Green SA, Bell D, Mays N. Identification of factors that support successful implementation of care bundles in the acute medical setting: a qualitative study. BMC Health Serv Res. 2017;17(1):120 https://doi.org/10.1186/s12913-017-2070-1.
Grooms HR, Froehle CM, Provost LP, Handyside J, Kaplan HC. Improving the context supporting quality improvement in a neonatal intensive care unit quality collaborative: an exploratory field study. Am J Med Qual. 2017;32(3):313–21 https://doi.org/10.1177/1062860616644323.
Hamilton J, Verrall T, Maben J, Griffiths P, Avis K, Baker GR, et al. One size does not fit all: a qualitative content analysis of the importance of existing quality improvement capacity in the implementation of Releasing Time to Care: the Productive Ward in Saskatchewan, Canada. BMC Health Serv Res. 2014;14:642 https://doi.org/10.1186/s12913-014-0642-x.
Harvey G, Llewellyn S, Maniatopoulos G, Boyd A, Procter R. Facilitating the implementation of clinical technology in healthcare: what role does a national agency play? BMC Health Serv Res. 2018;18(1):347 https://doi.org/10.1186/s12913-018-3176-9.
Hovlid E, Bukve O. A qualitative study of contextual factors’ impact on measures to reduce surgery cancellations. BMC Health Serv Res. 2014;14:215 https://doi.org/10.1186/1472-6963-14-215.
Kaplan HC, Sherman SN, Cleveland C, Goldenhar LM, Lannon CM, Bailit JL. Reliable implementation of evidence: a qualitative study of antenatal corticosteroid administration in Ohio hospitals. BMJ Qual Saf. 2016;25(3):173–81 https://doi.org/10.1136/bmjqs-2015-003984.
Krein SL, Damschroder LJ, Kowalski CP, Forman J, Hofer TP, Saint S. The influence of organizational context on quality improvement and patient safety efforts in infection prevention: a multi-center qualitative study. Soc Sci Med. 2010;71(9):1692–701 https://doi.org/10.1016/j.socscimed.2010.07.041.
Manley K, Jackson C, McKenzie C, Martin A, Wright T. Safety culture, quality improvement, realist evaluation (SCQUIRE). Evaluating the impact of the Patient Safety Collaborative initiative developed by Kent, Surrey and Sussex Academic Health Science Network (KSSAHSN) on safety culture, leadership, and quality improvement capability. Canterbury, UK: England Centre for Practice Development; 2017.
McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Park AM, et al. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15:62 https://doi.org/10.1186/s12913-015-0713-7.
Meehan TP, Qazi DJ, Van Hoof TJ, Ho SY, Eckenrode S, Spenard A. t al. Process evaluation of a quality improvement project to decrease hospital readmissions from skilled nursing facilities. J Am Med Dir Assoc. 2015;6(8):648–53 https://doi.org/10.1016/j.jamda.2015.02.015.
National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care (NIHR CLAHRC) Greater Manchester. Improvement in context: an ethnographic study of quality improvement programmes for acute kidney injury. Manchester, UK: NIHR CLAHRC Greater Manchester; 2018.
Papoutsi C, Poots A, Clements J, Wyrko Z, Offord N, Reed JE. Improving patient safety for older people in acute admissions: implementation of the Frailsafe checklist in 12 hospitals across the UK. Age Ageing. 2018;47(2):311–37 https://doi.org/10.1093/ageing/afx194.
Phung VH, Essam N, Asghar Z, Spaight A, Siriwardena AN. Exploration of contextual factors in a successful quality improvement collaborative in English ambulance services: cross-sectional survey. J Eval Clin Pract. 2016;22(1):77–85 https://doi.org/10.1111/jep.12438.
Power M, Brewster L, Parry G, Brotherton A, Minion J, Ozieranski P, et al. Multimethod study of a large-scale programme to improve patient safety using a harm- free care approach. BMJ Open. 2016;e011886. https://doi.org/10.1136/bmjopen-2016-011886.
Reed JE, Kaplan HC, Ismail SA. A new typology for understanding context: qualitative exploration of the model for understanding success in quality (MUSIQ). BMC Health Serv Res. 2018;18:584 https://doi.org/10.1186/s12913-018-3348-7.
Rostami P, Ashcroft DM, Tully MP. A formative evaluation of the implementation of a medication safety data collection tool in English healthcare settings: a qualitative interview study using normalisation process theory. PLoS One. 2018;13(2):e0192224 https://doi.org/10.1371/journal.pone.0192224.
Rotteau L, Webster F, Salkeld E, Hellings C, Guttmann A, Vermeulen MJ, et al. Ontario’s emergency department process improvement program: the experience of implementation. Acad Emerg Med. 2015;22(6):720–9 https://doi.org/10.1111/acem.12688.
Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013;8:28 https://doi.org/10.1186/1748-5908-8-28.
Schierhout G, Hains J, Si D, Kennedy C, Cox R, Kwedza R, et al. Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change. Implement Sci. 2013;8:119 https://doi.org/10.1186/1748-5908-8-119.
Sommerbakk R, Haugen DF, Tjora A, Kaasa S, Hjermstad MJ. Barriers to and facilitators for implementing quality improvements in palliative care – results from a qualitative interview study in Norway. BMC Palliat Care. 2016;15:61 https://doi.org/10.1186/s12904-016-0132-5.
Sutton E, Dixon-Woods MM, Tarrant C. An ethnographic process evaluation of a quality improvement project to improve transitions of care for older people. BMJ Open. 2016;6:e010988 https://doi.org/10.1136/bmjopen-2015-010988.
Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11(suppl 1):S115–23 https://doi.org/10.1370/afm.1549.
Otte-Trojel T, Wong G. Going beyond systematic reviews: realist and meta-narrative reviews. Stud Health Technol Inform. 2016;222:275–87 https://doi.org/10.3233/978-1-61499-635-4-275.
Jagosh J. Realist synthesis for public health: building an ontologically deep understanding of how programs work, for whom, and in which contexts. Annu Rev Public Health. 2019;40:361–72 https://doi.org/10.1146/annurev-publhealth-031816-044451.
Øvretveit JC, Shekelle PG, Dy SM, McDonald KM, Hempel S, Pronovost P, et al. How does context affect interventions to improve patient safety? An assessment of evidence from studies of five patient safety practices and proposals for research. BMJ Qual Saf. 2011;14(7):604–10 https://doi.org/10.1136/bmjqs.2010.047035.
Mannion R, Davies H. Understanding organisational culture for healthcare quality improvement. BMJ. 2018;363:k4907 https://doi.org/10.1136/bmj.k4907.
Lukas CV, Mohr DC, Meterko M. Team effectiveness and organizational context in the implementation of a clinical innovation. Qual Manage Health Care. 2009;18(1):25–39 https://doi.org/10.1097/01.QMH.0000344591.56133.90.
Yamada J, Squires JE, Estabrooks CA, Victor C, Stevens B, the CIHR Team in Children’s Pain. The role of organizational context in moderating the effect of research use on pain outcomes in hospitalized children: a cross sectional study. BMC Health Serv Res. 2017;17:68 https://doi.org/10.1186/s12913-017-2029-2.
Rowland P, Lising D, Sinclair L, Baker GR. Team dynamics within quality improvement teams: a scoping review. Int J Qual Health Care. 2018;30(6):416–22 https://doi.org/10.1093/intqhc/mzy045.
Shea CM, Turner K, Albritton J, Reiter KL. Contextual factors that influence quality improvement implementation in primary care: the role of organizations, teams and individuals. Health Care Manag Rev. 2018;43(3):261–9 https://doi.org/10.1097/HMR.0000000000000194.
Li SA, Jeffs L, Barwick M, Stevens S. Organizational contextual features that influence the implementation of evidence-based practices across healthcare settings: a systematic integrative review. Syst Rev. 2018;7:72 https://doi.org/10.1186/s13643-018-0734-5.
McCormack B, Rycroft-Malone J, Decorby K, Hutchinson AM, Bucknall T, Kent B, Schultz A, et al. A realist review of interventions and strategies to promote evidence-informed healthcare: a focus on change agency. Implement Sci. 2013;8:107 https://doi.org/10.1186/1748-5908-8-107.
Balasubramanian BA, Heurtin-Roberts S, Krasny S, Rohweder CL, Fair K, Olmos-Ochoa TT, et al. Contextual factors related to implementation and reach of a pragmatic multisite trial: the My Own Health Report (MOHR) study. J Am Board Fam Med. 2017;30(3):337–49 https://doi.org/10.3122/jabfm.2017.03.160151.
Pallari E, Khadjesari Z, Green JSA, Sevdalis N. Development and implementation of a national quality improvement skills curriculum for urology residents in the United Kingdom: a prospective multi-method, multi-center study. Am J Surg. 2019;217(2):233–43 https://doi.org/10.1016/j.amjsurg.2018.11.008.
The authors would like to thank the collaborators and stakeholders who contributed to this review.
This research is affiliated to the Scottish Improvement Science Collaborating Centre (SISCC), which is funded by the Scottish Funding Council, the Chief Scientist’s Office, NHS Education for Scotland and the Health Foundation.
Ethics approval and consent to participate
Formal ethical approval was not required for this review.
Consent for publication
The authors declare they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Coles, E., Anderson, J., Maxwell, M. et al. The influence of contextual factors on healthcare quality improvement initiatives: a realist review. Syst Rev 9, 94 (2020). https://doi.org/10.1186/s13643-020-01344-3
- Realist review
- Realist synthesis
- Quality improvement
- Health improvement
- Evidence-based practice
- Knowledge translation