- Open Access
Factors influencing the implementation of mental health recovery into services: a systematic mixed studies review
Systematic Reviews volume 10, Article number: 134 (2021)
Countries around the world have committed in policy to transforming their mental health services towards a recovery orientation. How has mental health recovery been implemented into services for adults, and what factors influence the implementation of recovery-oriented services?
This systematic mixed studies review followed a convergent qualitative synthesis design and used the best-fit framework synthesis method. Librarians ran searches in Ovid- MEDLINE, Ovid-EMBASE, Ovid-PsycInfo, EBSCO-CINAHL Plus with Full Text, ProQuest Dissertations and Theses, Cochrane Library, and Scopus. Two reviewers independently screened studies for inclusion or exclusion using DistillerSR. Qualitative, quantitative, and mixed methods peer-reviewed studies published since 1998 were included if they reported a new effort to transform adult mental health services towards a recovery orientation, and reported findings related to implementation experience, process, or factors. Data was extracted in NVivo12 to the 38 constructs of the Consolidated Framework for Implementation Research (CFIR). The synthesis included a within-case and a cross-case thematic analysis of data coded to each CFIR construct. Cases were types of recovery-oriented innovations.
Seventy studies met our inclusion criteria. These were grouped into seven types of recovery-oriented innovations (cases) for within-case and cross-case synthesis. Themes illustrating common implementation factors across innovations are presented by CFIR domain: Intervention Characteristics (flexibility, relationship building, lived experience); Inner Setting (traditional biomedical vs. recovery-oriented approach, the importance of organizational and policy commitment to recovery-transformation, staff turnover, lack of resources to support personal recovery goals, information gaps about new roles and procedures, interpersonal relationships), Characteristics of Individuals (variability in knowledge about recovery, characteristics of recovery-oriented service providers); Process (the importance of planning, early and continuous engagement with stakeholders). Very little data from included studies was extracted to the outer setting domain, and therefore, we present only some initial observations and note that further research on outer setting implementation factors is needed.
The CFIR required some adaptation for use as an implementation framework in this review. The common implementation factors presented are an important starting point for stakeholders to consider when implementing recovery-oriented services.
Mental health recovery is increasingly the focus of mental health policy, guidelines, and action plans worldwide. Recovery arose from the consumer survivor movement in the late 1980s as mental health service users began publishing on their own recovery experiences . Personal recovery is not to be confounded with clinical recovery, the latter concept referring to measurable disease-focused outcomes such as a reduction in symptoms or hospital days. Personal recovery in contrast is defined as “a way of living a satisfying, hopeful, and contributing life even with limitations caused by illness” (p.527) . Despite widespread adoption of the personal recovery concept, the challenge has been to operationalize the principles of personal recovery into services [3, 4], so that responsibility for recovery becomes a shared responsibility. While traditional mental health services focus on professional control, patient dependency, self-stigma, and hopelessness, the focus of recovery-oriented services is on client empowerment, choice, collaborative professional/client relationships, and community integration. In promoting a life beyond services, recovery also meets a key ethical obligation to honour the personhood and citizenship of people with mental illness.
Research on recovery has proliferated over the past two decades with studies on personal recovery [5,6,7,8,9,10,11], recovery-oriented services [12,13,14,15,16,17,18,19], and provider competencies [20,21,22,23,24]. Conceptual frameworks have been produced [25,26,27,28,29,30] and standardized measures have been developed [31,32,33]. Research has linked recovery to existing theories, e.g. empowerment theory [34, 35], the strengths model , capabilities theory [37,38,39], positive psychology [40,41,42], person-centered practice [43, 44], and co-production [45, 46]. Guidelines for recovery-oriented service provision are available [47,48,49,50,51,52,53].
To date, systematic reviews in mental health recovery have focused on conceptualizing personal recovery [25, 29, 54,55,56,57,58,59,60], measurement instruments [28, 61, 62], conceptualizing recovery-oriented practice , and intervention effectiveness [64,65,66]. One review described what influences the implementation of peer support work specifically . However, no known systematic review, to date, has been published on how recovery has been implemented into services from an implementation science perspective. To address this knowledge gap, it was deemed appropriate to employ a systematic mixed studies review to ensure that we captured the breadth of evidence across research designs. This review seeks to address the question: How has mental health recovery been implemented into services for adults, and what factors influence the implementation of recovery-oriented services?
This systematic mixed studies review follows a convergent qualitative synthesis design . Based on Hong et al.’s classification of convergent synthesis design sub-types, ours can be described as “data-based”, meaning that findings from qualitative, quantitative, and mixed methods studies were extracted concurrently, analysed using the same method, and the review findings are presented together (p.7) . We applied the best-fit framework synthesis method . We chose the Consolidated Framework for Implementation Research (CFIR)  as the best-fit framework for this synthesis based on it being a germinal compilation of factors known to influence implementation and our aim being to systematically synthesize the factors known to influence the implementation of recovery-oriented services. The CFIR framework includes 38 constructs grouped into five domains: intervention characteristics, outer setting (outside or beyond the organization), inner setting (within the organization), characteristics of individuals, and process . We used a hybrid deductive-inductive approach  that is consistent with the best-fit framework synthesis method . The CFIR framework was used for data extraction by deductively coding findings from primary studies to the 38 constructs. Data within each CFIR construct was inductively coded thematically. Thematic synthesis methods are a common approach to mixed studies convergent qualitative synthesis design . Currently, no published reporting guideline exists for systematic mixed studies reviews. We were guided by relevant elements of both the PRISMA  and ENTREQ  reporting guidelines (see Additional file 1). A comparison of the published protocol  and this review can be found in Additional file 2. A core team of three reviewers (MP, MW, ES) worked closely together on the review and kept a process log to document over 90 review meetings between December 2017 and the date of submission.
A health sciences librarian conducted comprehensive searches in the following databases: Ovid- MEDLINE, Ovid-EMBASE, Ovid-PsycInfo, EBSCO-CINAHL Plus with Full Text, ProQuest Dissertations and Theses, Cochrane Library, and Scopus from January 1, 1998, to December 20, 2016, using a combination of keywords and MeSH terms. 1998 was chosen as the start date because it was in 1998 that recovery was first defined in an international policy document . The search strategy was peer reviewed by another health sciences librarian using the Peer Review of Electronic Search Strategies checklist . A third librarian (FF) updated the searches on July 25, 2018. No functional limits other than the start date were applied.
The search strategy was developed for MEDLINE (see Additional file 3), and a modification of this strategy was used to search the other databases. Two librarians executed all final searches (initial and updated (FF)), exported the results into EndNote and removed duplicates from the search results. A PRISMA flow chart was used to track the number of studies at each stage of the review. The table of contents of Implementation Science, Psychiatric Services, Psychiatric Rehabilitation, Journal of Mental Health, Administration and Policy in Mental Health and Mental Health Services were searched from January 2012 to March 2017. These journals were selected for having published several studies of interest to our review question. Eight researchers/experts in recovery and system transformation, from different countries, were contacted in July 2017 and asked to share any known empirical studies on the implementation of recovery into services published in the past 2 years or in press. No additional studies were identified through these means.
Study inclusion and exclusion criteria
We included peer-reviewed studies that reported on the implementation process, factors, and experience when implementing new efforts to transform services for adults with serious mental illness towards a recovery-orientation. All study inclusion and exclusion criteria can be found in Table 1. All studies were independently screened over two stages for inclusion by two of three reviewers (MP, MW, ES) using DistillerSR software  (stage one: title and abstract. stage 2: full-text screening). Disagreements were resolved in meetings including a third reviewer.
Study quality assessment
The Mixed Methods Appraisal Tool (MMAT)  was used to critically appraise all included studies. MMAT is a validated tool for appraisal of all study designs including mixed methods studies . Studies were not excluded based on critical appraisal. Two reviewers independently appraised each study, using the MMAT template  and compared appraisals to arrive at a consensus (BV, TD, CP).Footnote 1 Sensitivity analyses answer the question “are the findings robust to the decisions made in the process of obtaining them?” . In this case, we conducted a sensitivity analysis to determine whether our decision not to exclude studies based on quality shaped the findings (e.g. are some findings based solely on lower quality evidence?). One reviewer (MW) applied Houghton et al.’s approach  to sensitivity analysis using matrix coding queries in NVivo 12 to visualize the number of studies by MMAT score categories supporting each theme presented in the findings section. The data coded to each theme were plotted against the MMAT score categories in the query. We scored the MMAT by counting “yes” responses and using five as the common denominator since both qualitative and quantitative studies are appraised based on five questions. Mixed methods studies are appraised on 15 questions so scores out of 15 were converted to scores out of five. This led to some scores with decimal points (e.g. 3.33). To simplify we assigned each study to one of four score categories: 0, 1–2, 3–4, and 5. Dividing studies into categories based on the number of critical appraisal criteria met is consistent with other studies that have applied sensitivity analysis to qualitative synthesis findings [70, 82, 83].
Data extraction strategy
Descriptive data such as country, setting, objective, recruitment, data collection methods, theoretical framework, analysis, sample, and characteristics of participants were extracted to a form created in DistillerSR. Given that we used a qualitative approach to convergent synthesis  we approached the extraction of study findings in the following way: in qualitative studies, or the qualitative branch of mixed-methods studies, we extracted findings (quotes and authors’ descriptions) from results and discussion sections. In quantitative studies, or the quantitative branch of a mixed-methods study, we extracted the study authors’ own narrative descriptions and summaries of their quantitative results. Extraction of study findings to the CFIR was done in NVivo12 . The data extraction template consisting of the five domains and 38 constructs of the CFIR , and their definitions, was pilot tested on five articles. Modifications were made including adding “authors and/or research participants descriptions of…” before each definition, adding an additional construct under a process called engaging with stakeholders, and adding an “additional information” code to each domain so that data that did not fit any of the constructs could be coded there and included in the thematic analysis (see Additional file 4 for data extraction framework used, including definitions).
In NVivo12, we created codes and sub-codes for each domain and construct and sub-construct and included the definitions in the “description” field of each code for easy access during extraction. PDFs of included articles were imported, a case node was created for each article, and all were coded to the case node “included studies”. A case classification sheet was created with descriptive information about the studies (country, perspectives). This process enabled the use of data exploration features in NVivo12, such as framework matrices and matrix coding queries. Data was extracted by coding sections (e.g. a sentence, quote or paragraph) of the PDF to corresponding CFIR constructs. If a section of data illustrated more than one construct, it was coded to each. Factual information provided by the authors that related to CFIR constructs (this usually appeared in background and methods sections) were extracted to a second coding tree but not used in this review.
One reviewer (MW) carried out data extraction. Five studies were co-extracted by a second review (MP, ES) for quality control. Three reviewers (MP, MW, ES) met weekly over this stage to discuss extraction and interpretations of CFIR constructs. Questions about interpreting distinctions between domains and constructs were clarified in a meeting with authors of the CFIR.
Data synthesis and presentation
Due to the wide variety of innovations implemented with the aim of transforming services, three reviewers (MP, MW, ES) worked to conceptually group the 70 included studies into similar types of innovations, as a precursor to analysis. Each innovation group became a “case” and we created case nodes for each innovation group in NVivo12. This facilitated analysis and synthesis conceptually by enabling the reviewers to embed themselves in the extracted data case by case. Table 2 shows each innovation group (case) and the number of studies in each (it also highlights studies that were coded to more than one innovation group (case)—e.g. a study of peer workers doing personal recovery planning. An additional case node was created called “perspectives on implementation of recovery-oriented services in general” for those studies with a broader focus and without enough description of the intervention to enable grouping. These, alongside innovation categories with only one supporting study, were not included in the within-case and cross-case synthesis. In total, 55 studies representing seven innovation groups (cases) were included in a within-case and cross-case analysis (thematic coding within CFIR constructs) and synthesis (writing summarized review findings). Analysis and synthesis in NVivo12 was undertaken by one reviewer (MW) who met weekly with two reviewers to discuss emergent findings and co-interpret data (MP, ES). The following details the steps and procedures of the within-case and cross-case analysis and synthesis.
The data extracted to each CFIR construct for each separate innovation group (case) were thematically coded. In Nvivo12, we generated a framework matrix table for each innovation group into which we wrote-up summarized review findings under each theme while easily viewing the extracted data coded to the theme. Summarized review findings were saved to seven documents, one per innovation group (case). The principal investigator (MP) read and commented on all within-case review findings and read all the data underlying each finding to verify that the findings were adequate representations of the extracted data.
The seven documents containing the within-case review findings for each innovation group were imported to NVivo12 as the data set for the cross-case analysis and synthesis. Each document was coded to its corresponding innovation case node and each finding coded to its corresponding CFIR domain and supporting studies. This ensured traceability within NVivo12 between the summarized findings and the underlining data extracted. For cross-case analysis within-case findings from all innovation groups were thematically coded by CFIR domain, starting with intervention characteristics and ending with process. First, summarized findings were coded to the categories “common” (findings that emerged across innovations) and “specific” (findings that related specifically to one innovation). This review focuses on factors common across innovations (cases) that influenced implementation.Footnote 2 The within-case findings categorized as “common” were grouped into cross-case themes. The list of emergent themes was divided into primary and secondary themes. Primary themes were those that occurred across the most innovations (cases) and were best supported by the data. An NVivo12 framework matrix was created for each domain to assist with merging innovation-specific findings into a single narrative illustrating a cross-case theme. Theme names were refined in the process. These represent the final results of this synthesis (Table 3). To reduce the length of the manuscript, we do not report on two primary themes within inner setting (financial issues and staff time) since we believe these factors are widely known and reported on in the implementation science literature. The sustainability of funding and staff perceptions of the time they have for implementation are also fundamental factors to consider when implementing new innovations. We briefly summarize outer setting rather than present findings because this was the least well-supported domain and requires further research.
Figure 1 is the PRISMA flow chart representing the stages of study selection for this review. In total 70 studies (publications) met our inclusion criteria and were included in this review (see reference list in Additional file 5). Eleven studies originated from four research projects [18, 85, 88, 97, 103, 124, 145,146,147,148, 151] but each publication was treated as an individual study. We reflected on whether this decision impacted our findings by using the Query function in NVivo12 to see how many publications contributing to a theme were from the same study. Only four of the 13 themes presented in the synthesis section below were contributed to by two publications from the same study. We therefore conclude that none of the themes are overrepresented by data emanating from a single project.
Results of study quality assessment and sensitivity analysis
Of the 70 included studies, 55 were categorized as qualitative, six mixed methods, six quantitative descriptive, one quantitative non-RCT, one quantitative RCT, and one as both quantitative descriptive and qualitative for the purposes of the MMAT assessment. When only part of the findings were relevant to this review, the study was categorized according to the methods used to produce these findings only (hence the categorizations may not match the design of the whole study). For example, if a study collected qualitative and quantitative data but only the qualitative component related to our review question, we categorized the study as qualitative for MMAT. We categorized as mixed methods studies that self-described as such or that collected, analysed, and integrated both quantitative and qualitative data. Studies that did not demonstrate any integration and did not self-label as mixed methods were categorized as “quantitative and qualitative” and both sets of questions in MMAT were used. Overall, the majority of included studies were good quality studies, with 35 studies scoring 5, and 27 scoring as 3–4. There were just as many or more “Can’t Tell” responses compared to “No” suggesting that in some studies lower appraisals may reflect issues in reporting rather than actual quality. Resources were not available to contact authors to clarify “Can’t Tell” appraisals. Appraisals can be found in Additional file 6.
Figure 2 shows the results of a sensitivity analysis of the themes presented under each CFIR domain. We conclude that none of the themes are based solely on lower quality studies and that all themes are well supported by higher quality studies.
Although we extracted data from and appraised all 70 studies, we chose not to include 15 studies in the within and cross-case synthesis either because they were in innovation groups containing only one study, or they were studies exploring perspective on implementing recovery-oriented services in general (see Table 2). For the 55 studies categorized into one of the seven innovation groups, Table 3 lists by CFIR domain the themes representing common implementation factors synthesized from across these studies. The table also shows the corresponding CFIR constructs to which the data underlying the theme were coded to at the data extraction phase. Illustrative quotes from contributing studies for each theme can be found in Additional file 8. In the following, we describe the general pattern observed across multiple innovations and provide innovation-specific examples in tables (one per CFIR domain).
Across innovations, flexibility was highlighted as an important intervention characteristic that enhanced adaptability and was sometimes seen to provide a relative advantage over traditional services [85, 88, 89, 93, 101, 104, 109, 110, 114, 115, 117, 125,126,127, 129,130,131, 133, 134]. For example, having flexible program content that service providers and service users could pick and choose from and tailor to their own, and their clients’ needs were valued [85, 88, 89, 93, 115, 117, 125, 127, 129]. Flexible role definition for service providers (including peer workers) delivering recovery-oriented services was also valued as it enabled tailoring services to service user and community needs [101, 104, 109, 110, 131]. Service providers could more easily adapt to the needs of service users if the elements surrounding the innovation’s delivery, such as location, mode, timing, frequency, structure, or length were flexible [93, 101, 109, 110, 125, 126, 134]. Flexible funding was another characteristic of some interventions that service providers found helpful in adapting their support to service users’ needs [114, 130, 133]. Table 4 provides examples of flexibility for each innovation group.
Relationship building is a key element of innovations aimed at transforming services towards a recovery orientation. A common characteristic of recovery-oriented innovations is the appointment of a service provider who takes on a role predicated upon building trusting relationships with service users (e.g. facilitator) [85, 87, 89, 90, 93, 109, 116, 118, 120, 122]. However, relationship building is also an element of these innovations’ complexity from the point of view of service providers, both in terms of managing relationships with co-workers and service users, and ending relationships with service users [99, 102, 104, 105, 107, 114, 118, 126, 133]. Table 4 provides examples for each innovation group.
Across innovations, the inclusion of people with lived experience of mental health challenges was a valued aspect of designing and packaging recovery-oriented innovations [89, 90, 98, 103, 104, 106, 109, 114,115,116, 125, 128, 129, 135, 137]. When the source of the intervention was a person or group of people with lived experience, this was viewed positively [109, 115, 116]. Those with lived experience were perceived to have a relative advantage over other staff when it came to working in a recovery-oriented way [98, 103, 104, 106, 109, 114]. Table 4 provides examples for each innovation group.
Very little data was extracted to outer setting. The question of how well organizations knew the needs and resources of their clients (as it is framed in CFIR) was rarely directly studied or reported on in the findings. We extracted data to patient needs and resources that spoke generally about service users’ needs but because we judged that this data did not capture the meaning implied by the CFIR construct we do not present it here. External policies were a topic covered descriptively in the background sections of articles rather than directly studied and reported on in findings, and so relatively little data on the topic contributed to this review. One finding worth mention is that external policies of funders and governments regarding billing for services (in the USA especially) caused difficulties for peer worker and service navigation and coordination innovations when these new roles and services did not easily fit existing funding structures [96, 134].
Traditional biomedical vs. recovery-oriented approach
Data extracted and synthesized to three CFIR constructs (compatibility, culture, learning climate), spoke to the overall theme of the challenge with implementing recovery into services that espouse the medical model. Across innovations stakeholders perceived there to be compatibility issues between traditional organizational culture (described in terms of hierarchies, unequal power relations, paternalism, and punishment) and recovery-oriented innovations [94, 98, 99, 103, 104, 108, 111, 115, 119, 122, 124, 131, 134,135,136,137]. An important aspect of traditional organizational or service culture is the way in which staff understand their roles and the priorities of their job. Traditional roles and priorities, such as dealing with acute episodes of mental illness, a focus on medication prescription, and managing risk, were not easily compatible with implementing recovery into services [18, 86, 92, 100, 108, 135]. Many peer workers described a culture of stigma towards mental illness in the organizations in which they worked (and the field of mental health in general) that affected both them and the clients they served [96, 99, 102, 108]. The learning climate for service users—that is, how safe services users feel to try new recovery-oriented services—was sometimes poor because traditional organizational culture from the point of view of some service users is one of distrust and fear due to past negative experiences (e.g. unpleasant or forced treatments) [119, 124, 132]. Specific examples by innovation group are in Table 5.
The importance of organizational and policy commitment to recovery-transformation
The compatibility between the wider organizational commitment to recovery-oriented transformation and the recovery innovation being implemented was important for staff [85, 86, 115, 119, 124, 135], especially peer workers [94, 98, 99, 102, 107, 115]. Staff, including peer workers, expressed concern that if recovery-oriented innovations are implemented into a wider organizational setting that does not espouse the same recovery values, then the success of the innovation will be hampered [99, 115, 119, 124, 135]. Leadership and staff buy-in for an innovation is enhanced by a perception that the innovation is compatible with existing organizational and service goals [85, 86]. Specific examples by innovation group are in Table 5.
Structural characteristics of organizations such as staff turnover and difficulty recruiting and retaining staff were mentioned as implementation challenges across innovation groups [18, 119, 130, 132, 135, 139]. If staff or managers change frequently, the climate for implementation may be compromised by increased workloads, staff stress, and changes to teams’ skill mix , and can lead to inefficiencies in building capacity and a continued vision for recovery in the organization [18, 119, 130, 135, 139]. Specific examples by innovation group are in Table 5.
Lack of resources to support personal recovery goals
An aspect of many recovery-oriented innovations is to support service users in their own personal recovery journeys by facilitating access to the resources and services they wish to make use of. A challenge which sometimes arose across different innovation groups was a lack of available resources beyond the innovation both within the organization and in the community for supporting personal recovery goals, such as relevant programming, services, placements, and accommodation [18, 119, 130, 132,133,134,135]. Specific examples by innovation group are in Table 5.
Information gaps about new roles and procedures
The need for additional guidance and training to help clarify roles and specific procedures within innovations was mentioned across studies. This need was mentioned not only for service providers delivering an innovation but also for those who supervised them, other service providers working alongside them, and the service users with whom they worked [91, 92, 95, 96, 98, 100, 104, 108, 110, 119, 122, 128, 130, 131, 133, 134]. When recovery innovations involve the implementation of new roles, lack of access to information about the new role can cause a number of difficulties in the workplace including added stress, confusion, difficult relationships, and work [104, 108, 110, 130, 131, 133, 134]. Service users, new staff, and existing staff also noted needs for greater access to information about new procedures, roles, or services on offer [91, 92, 94, 97, 100, 102, 108, 119, 122, 128]. Specific examples by innovation group are in Table 5.
As reported under intervention characteristics, relationship building is both a key design feature and a source of complexity for recovery-oriented innovations. Interpersonal relationships play out in the inner setting and can be helped or hindered by existing relationships. Since the CFIR framework does not have a construct related to relationships in the inner setting we developed an additional construct called “interpersonal relationships” from the data extracted to additional information. Building good interpersonal relationships between existing staff and newly hired service providers taking-up new roles is an important factor for innovation success [98, 105, 106, 108, 114, 131]. So are positive interpersonal relationships (described as trusting, respectful, mutual esteem, supportive, and caring) between staff providing recovery-oriented services and service users [109, 117, 122, 130, 133]. Managing expectations within the service provider-service user relationship was also an important element of positive interpersonal relationships and fostering a positive implementation climate [85, 88, 119, 121, 122]. Pre-existing interpersonal relationships between staff or staff and service users can at times facilitate [85, 88, 93] or pose certain challenges [99, 102, 126] to implementation. Specific examples by innovation group are in Table 5.
Characteristics of Individuals
Variability in knowledge about recovery
The issue of variability in understandings of the concept of recovery was mentioned across studies [18, 86, 92, 94, 99, 102, 109, 113, 117, 119, 121, 122, 129, 135,136,137, 139]. While a good understanding of recovery principles was specifically noted in some studies [109, 117, 122, 135], in others, some non-peer service providers still confounded personal and clinical recovery [92, 94, 99, 102], and expressed a belief that not all service users could participate in recovery-oriented services because they lacked some necessary quality or level of wellness [86, 129, 136, 137, 139], thus demonstrating a lack of familiarity with the facts, truths, and principles of a recovery-orientation. Examples by innovation group are in Table 6.
Characteristics of recovery-oriented service providers
The experience of the innovations and their relative success were considered to be closely tied to the specific attributes of the service provider delivering the recovery-oriented service [99, 104, 109, 111, 117, 121, 122, 124, 130, 131, 133]. Positive experiences and implementation success were related to positive personal attributes including being respectful, encouraging, helpful, collaborative, warm, patient, understanding, dependable, trustworthy, professional, good at communicating and listening, hardworking, able to build rapport, empathetic, positive, and optimistic [99, 106, 109, 111, 117, 124, 130, 131, 133]. Negative attributes associated with negative experiences were service providers being patronizing in their approach, not genuine in their compassion or formulaic and generic in their approach, or having done an inadequate job discussing recovery [109, 121, 122]. Examples by innovation group are in Table 6.
The importance of planning
The importance of planning was exemplified in examples of good and poor planning of the implementation process. Good planning was about anticipating known or expected challenges and building in processes for mitigating them [91, 95, 102, 103, 108, 109] Where implementation challenges were encountered these were associated with inadequate planning, particularly around the availability of protocols, guidelines, and/or clear information on roles, information management, and training [95, 112, 130, 134]. Examples by innovation group are in Table 7.
Early and continuous engagement with stakeholders
The importance of engaging with a variety of stakeholders early and continuously in the implementation process was mentioned in a number of studies across innovations [91, 109, 117, 119, 121, 124, 127, 130, 134]. Some studies highlighted successful engagement [91, 109, 127] whereas others noted that early and continuous engagement with stakeholders was lacking and needed [94, 109, 117, 119, 121, 124, 130, 134]. Successful engagement was around involving key stakeholders in selecting the innovation , refining associated materials , and leveraging resources . Examples by innovation group are in Table 7.
Our review is, to the best of our knowledge, the first systematic review on the implementation of recovery-oriented services. Our synthesis has demonstrated how recovery has been operationalized into different innovations, and the common factors that influence its implementation. In terms of the characteristics of the recovery-oriented innovations, flexibility, relationship building, and lived experience are important factors to consider when designing innovations. At the level of organizations, traditional biomedical culture, staff turnover, available resources to support personal recovery goals, gaps in access to knowledge and information about new roles and procedures, and interpersonal relationships are essential factors to anticipate and plan for. The evidence to date also notes the issue of individual variation in recovery knowledge and the characteristics that make up recovery-oriented service providers. Finally, planning is key, as is engaging early with stakeholders and continuing to do so over the course of implementation. In this section. we will discuss some of these, and the CFIR constructs they relate to, in more detail, including how these findings compare to reviews of other interventions that used CFIR.
It is important to note that this was not a review of all the programs and services that exist in recovery, or the effectiveness of innovations, but rather was a review of research that has studied the process, experience, or factors that shape implementation. Some of the innovations identified are well established in some countries (peer workers) and some are new (e-innovations, recovery colleges). All help to operationalize recovery guidelines. Unlike innovations such as new treatments, the aim of recovery innovations is to transform mental health services towards a recovery orientation. By virtue of this, they are complex innovations primarily targeting deep culture change, not simply at the individual behavioural level but at the organization and system level. Many countries have committed in policy to implementing a recovery-orientation into their services  but knowing how to do this is the more challenging question. The literature synthesized here demonstrates how recovery as a policy, strategy, or approach has been operationalized into new recovery-specific innovations such as new training programs, new services, and new roles in the service system. Most aim to change wider organizational culture through these specific actions and many studies identified the importance of embedding implementation of these types of innovations within a wider commitment to recovery transformation [18, 94, 98, 99, 102, 107, 115, 119, 124, 135]. For transformation to happen, widespread change across organizations, from paperwork, to language, to hiring structures, need to change . However, taking this on all at once is a daunting task, and decision-makers may prefer to make a start by introducing more tangible innovations like those included in this synthesis.
Like other systematic reviews, on different topics however, we used the CFIR as both a framework for extraction and synthesis [156,157,158,159,160,161,162,163]. Comparing our results to those of these reviews highlights important differences in what some constructs mean in the context of implementing recovery-oriented services compared to other interventions. For example, complexity in other reviews related to things like the length of consultations , difficult changes to workload, routines, and priorities , technical aspects like screening, resources, and number of professionals involved , and challenges with software and hardware . In the case of recovery, complexity also related to managing relationships since a core characteristic of the innovations was making a change to the way service providers and service users interact. Similarly, culture was not reported on in depth in other reviews, whereas in our review it is highly significant across studies. This is likely because recovery is about system transformation and organizational culture change, and is quite a radical departure from traditional mental health services [48, 155]. Similar to other reviews using CFIR, included studies contributed the least data to outer setting [159, 161], and process .
Overall the CFIR, as a compilation of factors known to influence implementation, worked well as a data-extraction and synthesis framework, suggesting that implementation factors in the context of recovery-oriented services are similar to innovations in health and social care. However, in order to synthesize the evidence on implementing recovery into services we did have to adapt the CFIR framework- which itself is a contribution consistent with the best-fit framework synthesis method . We replaced more medicalized terminology in the CFIR like “patients” and “intervention” with “service user” and “innovation”. Services should not intervene on someone’s recovery; they should support it through providing recovery-oriented services . We also observed that service users (in CFIR terms “patients”) are inherently framed as outside the inner setting in CFIR—located explicitly in the outer setting in the 2009 version of CFIR we used . The language of the CFIR definitions for the inner setting imply that organizational staff are the focus of the inner setting. However, from a recovery perspective, service users are actors within the inner setting and we took this view when extracting data. The result was that issues like service users perspectives’ on the learning climate were extracted to the inner setting and not to the outer setting or domain of individuals.
In terms of specific constructs, we added two. One was the sub-construct “engaging stakeholders” within the engaging construct in the process domain. While the “engaging” construct focuses on how stakeholders are attracted to participate in the innovation, the idea of engagement in the studies in this review related more closely to the recovery-oriented principle of co-production, that is engaging with stakeholders such as staff and service users to design and develop innovations [164, 165]. It is important to note that we used the 2009 version of CFIR , whereas more recent iterations have included the constructs “key stakeholders” and “patients and consumers” . However, from a recovery perspective, we see no reason why consumers/service users should not inherently be considered key stakeholders. We also developed an additional construct within inner setting called “interpersonal relationships” out of data that did not fit elsewhere. Interpersonal relationships can refer to staff relationships (including with managers) or staff and service user relationships, goes beyond issues of communication and networks, and is an important part of the implementation climate. In the case of recovery, which aims to transform the way service users and service providers relate to one another [167, 168], the state of these relationships before and during implementation is an important implementation factor to consider.
Because of the conceptual ambiguity surrounding recovery, and frequent misuse of the term , we had to keep our search criteria broad and found it conceptually challenging to determine when described programs were truly recovery-oriented and new, and when the word recovery was tokenistic or in fact referring to clinical recovery. Primary articles were inconsistent in providing a referenced definition of recovery-oriented services. We may have excluded studies that other reviewers would have included. Since we chose not to include systematic reviews or dissertations in this review, in retrospect we should not have searched the Cochrane Library or the ProQuest Dissertations and Theses databases.
Another conceptual challenge in this review was deciding on what constituted an implementation study in a field (mental health recovery) that has only recently begun intersecting with implementation science. Only 16 of the included studies used the word implementation in their title or keywords. This justifies why we did not rely on this label in our search to locate studies, but also signifies we are in an early stage of implementation research in this area. Another indication of this is the fact that we could only identify six studies that used an implementation-related framework in their research [103, 109, 112, 119, 134, 139]. By extension, the use of standard implementation terminology like that provided in the CFIR was infrequent. It was up to the reviewer extracting data to become intimately familiar with the CFIR construct definitions and see reference to them in the primary studies when the primary studies themselves were, for the most part, not using this terminology. If resources had been available, ideally two reviewers could have independently extracted data.
Another limitation may have been our decision to exclude pre-implementation studies, program descriptions, and grey literature. These may have included additional information on implementation factors, described other types of innovations, and have widened the geographical spread of studies. Finally, it is important to acknowledge that critical appraisal is a contested topic  but also a fundamental step in a systematic review . Since critical appraisal is the result of two individuals’ judgements, our sensitivity analyses should be interpreted with due acknowledgement that scores could have been different had two other reviewers applied the MMAT.
Recommendations for future research
The evidence base on the implementation of recovery into services to date has allowed us to identify important factors but not to study their exact mechanisms or effects, for example how exactly poor flexibility might lead to poor outcomes, or how greater flexibility may lead to better implementation outcomes. Research relating implementation factors to implementation outcomes is needed, as is research relating implementation barriers to implementation strategies. Stakeholders involved in implementation efforts can use tools like the CFIR-ERIC Matching Tool v.1  to help prioritize strategies to consider including in their implementation plans. In this review, we screened program descriptions from regions like South America, and predict that within the coming years we will see additional research publications from non-English language countries evaluating the implementation of recovery. Future reviews and updates should pay particular attention to this emerging literature. Future research should also empirically study research participants’ perspectives on outer setting and process CFIR constructs. This synthesis found that we have the least evidence on these two domains. So far, primary study authors have tended to report outer setting and process issues factually as part of background or program description rather than explicitly targeting them in data collection. Lastly, mental health recovery researchers considering using the CFIR in their research may want to adopt some of the adaptations we describe in the discussion. These adaptations made the CFIR more compatible with mental health recovery in this review and may prove useful for future primary implementation research on recovery.
This systematic mixed studies review has highlighted the factors known to influence the implementation of recovery-oriented services based on the evidence available to date. There are many types of innovations that operationalize recovery-transformation of services. This review identifies the factors that decision makers should consider in the domains of intervention characteristics, outer setting, inner setting, individuals, and process, regardless of the specific recovery-oriented innovation selected for implementation.
Availability of data and materials
The datasets supporting the conclusions of this article are included within the article (and its additional files).
MW and ES appraised three of the 70 studies
Factors specific to individual types of innovations will be analysed and reported separately in future publications
Consolidated Framework for Implementation Research
Deegan PE. Recovery: the lived experience of rehabilitation. Psychosoc Rehabil J. 1988;11(4):11–9. https://doi.org/10.1037/h0099565.
Anthony WA. Recovery from mental illness: the guiding vision of the mental health service system in the 1990s. Psychosoc Rehabil J. 1993;16(4):11–23. https://doi.org/10.1037/h0095655.
Pilgrim D. Recovery and current mental health policy. Chronic Illness. 2008;4(4):295–304. https://doi.org/10.1177/1742395308097863.
Slade M. The contribution of mental health services to recovery. Taylor & Francis; 2009.
Andresen R, Caputi P, Oades L. Stages of recovery instrument: development of a measure of recovery from serious mental illness. Aust New Zealand J Psychiatry. 2006;40(11-12):972–80. https://doi.org/10.1080/j.1440-1614.2006.01921.x.
Giffort D, Schmook A, Woody C, Vollendorf C, Gervain M. Recovery assessment scale. Chicago: Illinois Department of Mental Health; 1995.
Khanam D, McDonald K, Williams NC. Measuring recovery: a toolkit for mental health providers in New York City. New York: The Bureau of Mental Health, NYC Department of Health and Mental Hygiene; 2013.
Mueser KT, Gingerich S, Salyers MP, McGuire AB, Reyes RU, Cunningham H. The Illness Management and Recovery (IMR) Scales (client and clinician versions). Concord: New Hampshire-Dartmouth Psychiatric Research Center; 2004.
Neil ST, Kilbride M, Pitt L, Nothard S, Welford M, Sellwood W, et al. The questionnaire about the process of recovery (QPR): a measurement tool developed in collaboration with service users. Psychosis. 2009;1(2):145–55. https://doi.org/10.1080/17522430902913450.
MacKeith J, Burns S. Mental health recovery star. London: Mental Health Providers Forum and Triangle Consulting; 2008.
Gordon SE, Ellis PM, Siegert RJ, Walkey FH. Core dimensions of recovery: a psychometric analysis. Adm Policy Ment Health Ment Health Serv Res. 2014;41(4):535–42. https://doi.org/10.1007/s10488-013-0489-1.
Armstrong NP, Steffen JJ. The recovery promotion fidelity scale: assessing the organizational promotion of recovery. Community Ment Health J. 2009;45(3):163–70. https://doi.org/10.1007/s10597-008-9176-1.
Bedregal LE, O’Connell M, Davidson L. The recovery knowledge inventory: assessment of mental health staff knowledge and attitudes about recovery. Psychiatric Rehabil J. 2006;30(2):96–103. https://doi.org/10.2975/30.2006.96.103.
Burgess P, Pirkis J, Coombs T, Rosen A. Assessing the value of existing recovery measures for routine use in Australian mental health services. Aust New Zealand J Psychiatry. 2011;45(4):267–80. https://doi.org/10.3109/00048674.2010.549996.
O’Connell M, Tondora J, Croog G, Evans A, Davidson L. From rhetoric to routine: assessing perceptions of recovery-oriented practices in a state mental health and addiction system. Psychiatr Rehabil J. 2005;28(4):378–86.
Onken SJ, Dumont JM, Ridgway P, Dornan DH, Ralph RO. Mental health recovery: what helps and what hinders? A national research project for the development of recovery facilitating system performance indicators. Piloting the Recovery Oriented System Indicators (ROSI) 2006 [Available from: http://www.familymentalhealthrecovery.org/conference/handouts/Workshop%208/Onken-ROSIPilotMeasuresV6.pdf.
Ridgway P, Press A. Assessing the recovery-orientation of your mental health program. A userʼs guide for the recovery-enhancing environment scale (REE). Kansas: University of Kansas; 2004.
Leamy M, Clarke E, Le Boutillier C, Bird V, Janosik M, Sabas K, et al. Implementing a complex intervention to support personal recovery: a qualitative study nested within a cluster randomised controlled trial. PLoS One. 2014;9(5):e97091. https://doi.org/10.1371/journal.pone.0097091.
Lloyd-Evans B, Mayo-Wilson E, Harrison B, Istead H, Brown E, Pilling S, et al. A systematic review and meta-analysis of randomised controlled trials of peer support for people with severe mental illness. BMC Psychiatry. 2014;14:1.
Russinova Z, Rogers ES, Ellison ML, Lyass A. Recovery-promoting professional competencies: perspectives of mental health consumers, consumer-providers and providers. Psychiatric Rehabilitation Journal. 2011;34(3):177–85. https://doi.org/10.2975/34.3.2011.177.185.
National Institute for Mental Health in England. Support, time and recovery (STR) workers. A competence framework. London: Department of Health; 2008.
National Social Inclusion Programme. Capabilities for inclusive practice. London: Department of Health; 2007.
National Institute for Mental Health in England. The ten essential shared capabilities. A framework for the whole of the mental health workforce. London: Department of Health; 2004. Report No.: 40339
New Zealand Ministry of Health. Letʼs get real: real skills for people working in mental health and addiction. Wellington: New Zealand Ministry of Health; 2008.
Leamy M, Bird V, Le Boutillier C, Williams J, Slade M. Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry. 2011;199(6):445–52. https://doi.org/10.1192/bjp.bp.110.083733.
Slade M, Bird V, Le Boutillier C, Williams J, McCrone P, Leamy M. REFOCUS trial: protocol for a cluster randomised controlled trial of a pro-recovery intervention within community based mental health teams. BMC Psychiatry. 2011;11(1):185. https://doi.org/10.1186/1471-244X-11-185.
Slade M, Craig T, Glover G, Leese M, McCrone P, Pinfold V, et al. REFOCUS: Developing a recovery focus in mental health services in England. National Institute of Mental Health in England; 2008.
Williams J, Leamy M, Bird V, Harding C, Larsen J, Le Boutillier C, et al. Measures of the recovery orientation of mental health services: systematic review. Soc Psychiatry Psychiatr Epidemiol. 2012;47(11):1827–35. https://doi.org/10.1007/s00127-012-0484-y.
Slade M, Leamy M, Bacon F, Janosik M, Le Boutillier C, Williams J, et al. International differences in understanding recovery: systematic review. Epidemiol Psychiatr Sci. 2012;21(4):353–64. https://doi.org/10.1017/S2045796012000133.
Bird V, Leamy M, Tew J, Le Boutillier C, Williams J, Slade M. Fit for purpose? Validation of a conceptual framework for personal recovery with current mental health consumers. Aust New Zealand J Psychiatry. 2014;48(7):644–53. https://doi.org/10.1177/0004867413520046.
Barbic SP, Kidd SA, Davidson L, McKenzie K, OʼConnell MJ. Validation of the brief version of the Recovery Self-Assessment (RSA-B) using Rasch measurement theory. Psychiatr Rehabil J. 2015;38(4):349–58. https://doi.org/10.1037/prj0000139.
Dickens GL, Rudd B, Hallett N, Ion RM, Hardie SM. Factor validation and Rasch analysis of the individual recovery outcomes counter. Disabil Rehabil. 2019;41(1):74–85. https://doi.org/10.1080/09638288.2017.1375030.
Konkolÿ Thege B, Ham E, Ball LC. A factor analytic investigation of the person-in-recovery and provider versions of the revised Recovery Self-Assessment (RSA-R). Eval Health Prof. 2017;40(4):505–16. https://doi.org/10.1177/0163278716674247.
Rappaport J. Terms of empowerment/exemplars of prevention: toward a theory for community psychology. Am J Community Psychol. 1987;15(2):121–48. https://doi.org/10.1007/BF00919275.
Zimmerman MA. Empowerment theory: psychological, organizational and community levels of analysis. In: Rappaport J, Seidman E, editors. Handbook of Community Psychology. New York: Kluwer Academic/Plenum Publishers; 2000. p. 43–63. https://doi.org/10.1007/978-1-4615-4193-6_2.
Rapp CA, Goscha RJ. The strengths model: case management with people with psychiatric disabilities. Oxford: Oxford University Press; 2006.
Burchardt T. Capabilities and disability: the capabilities framework and the social model of disability. Disabil Soc. 2004;19(7):735–51. https://doi.org/10.1080/0968759042000284213.
Davidson L, Ridgway P, Wieland M, OʼConnell M. A capabilities approach to mental health transformation: a conceptual framework for the recovery era. Can J Commun Mental Health. 2009;28(2):35–46. https://doi.org/10.7870/cjcmh-2009-0021.
Hopper K. Rethinking social recovery in schizophrenia: what a capabilities approach might offer. Soc Sci Med. 2007;65(5):868–79. https://doi.org/10.1016/j.socscimed.2007.04.012.
Moran GS, Nemec PB. Walking on the sunny side: what positive psychology can contribute to psychiatric rehabilitation concepts and practice. Psychiatr Rehabil J. 2013;36(3):202–8. https://doi.org/10.1037/prj0000012.
Resnick SG, Rosenheck RA. Recovery and positive psychology: parallel themes and potential synergies. Psychiatr Serv. 2006;57(1):120–2. https://doi.org/10.1176/appi.ps.57.1.120.
Slade M. Mental illness and well-being: the central importance of positive psychology and recovery approaches. BMC Health Serv Res. 2010;10:1. https://doi.org/10.1186/1472-6963-10-26.
Borg M, Karlsson B, Tondora J, Davidson L. Implementing person-centered care in psychiatric rehabilitation: what does this involve? Israel J Psychiatry Relat Sci. 2009;46(2):84–93.
Rudnick A, Roe D. Serious mental illness: person-centered approaches. London: Radcliffe Publishing Ltd; 2014. p. 406.
Boyle D, Harris M. The challenge of co-production. How equal partnerships between professionals and the public are crucial to improving public services. London: NESTA; 2009.
Denham-Vaughan S, Clark M. Care clusters in mental health and co-production of care-Towards a more lay friendly set of cluster descriptions. Ment Health Soc Incl. 2012;16(2):79–83. https://doi.org/10.1108/20428301211232487.
Le Boutillier C, Leamy M, Bird VJ, Davidson L, Williams J, Slade M. What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv. 2011;62(12):1470–6. https://doi.org/10.1176/appi.ps.001312011.
Sowers W. Transforming systems of care: The American Association of Community Psychiatrists guidelines for recovery oriented services. Commun Mental Health J. 2005;41(6):757–74. https://doi.org/10.1007/s10597-005-6433-4.
Shepherd G, Boardman J, Slade M. Making recovery a reality. Sainsbury Centre for Mental Health; 2008.
Shepherd G, Boardman J, Slade M. Implementing recovery: a new framework for organisational change. Sainsbury Centre for Mental Health; 2009.
Australian Health Ministersʼ Advisory Council. A national framework for recovery-oriented mental health services. Guide for practitioners and providers. Canberra: Department of Health and Ageing; 2013.
Newnham EA, Page AC. Bridging the gap between best evidence and best practice in mental health. Clin Psychol Rev. 2010;30(1):127–42. https://doi.org/10.1016/j.cpr.2009.10.004.
Anthony WA, Mizock L. Evidence-Based processes in an era of recovery: implications for rehabilitation counseling and research. Rehabil Counseling Bull. 2014;57(4):219–27. https://doi.org/10.1177/0034355213507979.
Llewellyn-Beardsley J, Rennick-Egglestone S, Callard F, Crawford P, Farkas M, Hui A, et al. Characteristics of mental health recovery narratives: systematic review and narrative synthesis. PLoS One. 2019;14:3.
Clarke C, Lumbard D, Sambrook S, Kerr K. What does recovery mean to a forensic mental health patient? A systematic review and narrative synthesis of the qualitative literature. J Foren Psychiatry Psychol. 2016;27(1):38–54. https://doi.org/10.1080/14789949.2015.1102311.
Ellison ML, Belanger LK, Niles BL, Evans LC, Bauer MS. Explication and definition of mental health recovery: a systematic review. Adm Policy Ment Health Ment Health Serv Res. 2018;45(1):91–102. https://doi.org/10.1007/s10488-016-0767-9.
Jose D, Lalitha K, Gandhi S, Desai G. Consumer perspectives on the concept of recovery in schizophrenia: a systematic review. Asian J Psychiatr. 2015;14:13–8. https://doi.org/10.1016/j.ajp.2015.01.006.
Shepherd A, Doyle M, Sanders C, Shaw J. Personal recovery within forensic settings–SYSTEMATIC review and meta-synthesis of qualitative methods studies. Crim Behav Ment Health. 2016;26(1):59–75. https://doi.org/10.1002/cbm.1966.
Soundy A, Stubbs B, Roskell C, Williams SE, Fox A, Vancampfort D. Identifying the facilitators and processes which influence recovery in individuals with schizophrenia: a systematic review and thematic synthesis. J Ment Health. 2015;24(2):103–10. https://doi.org/10.3109/09638237.2014.998811.
Tew J, Ramon S, Slade M, Bird V, Melton J, Le Boutillier C. Social factors and recovery from mental health difficulties: a review of the evidence. Br J Soc Work. 2012;42(3):443–60. https://doi.org/10.1093/bjsw/bcr076.
Shanks V, Williams J, Leamy M, Bird VJ, Le Boutillier C, Slade M. Measures of personal recovery: a systematic review. Psychiatr Serv. 2013;64(10):974–80. https://doi.org/10.1176/appi.ps.005012012.
Sklar M, Groessl EJ, O’Connell M, Davidson L, Aarons GA. Instruments for measuring mental health recovery: a systematic review. Clin Psychol Rev. 2013;33(8):1082–95. https://doi.org/10.1016/j.cpr.2013.08.002.
Chester P, Ehrlich C, Warburton L, Baker D, Kendall E, Crompton D. What is the work of recovery oriented practice? A systematic literature review. Int J Ment Health Nurs. 2016;25(4):270–85. https://doi.org/10.1111/inm.12241.
Lloyd-Evans B, Mayo-Wilson E, Harrison B, Istead H, Brown E, Pilling S, et al. A systematic review and meta-analysis of randomised controlled trials of peer support for people with severe mental illness. BMC Psychiatry. 2014;14(1):39. https://doi.org/10.1186/1471-244X-14-39.
Winsper C, Docherty AC, Weich S, Fenton S-J, Singh SP. How do recovery-oriented interventions contribute to personal mental health recovery? A systematic review and logic model. Clin Psychol Rev. 2020;76:101815.
Eiroa-Orosa FJ, García-Mieres H. A systematic review and meta-analysis of recovery educational interventions for mental health professionals. Adm Policy Ment Health Ment Health Serv Res. 2019;46(6):724–52. https://doi.org/10.1007/s10488-019-00956-9.
Ibrahim N, Thompson D, Nixdorf R, Kalha J, Mpango R, Moran G, et al. A systematic review of influences on implementation of peer support work for adults with mental health problems. Soc Psychiatry Psychiatr Epidemiol. 2020;55(3):285–93. https://doi.org/10.1007/s00127-019-01739-1.
Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health. 2014;35(1):29–45. https://doi.org/10.1146/annurev-publhealth-032013-182440.
Hong QN, Pluye P, Bujold M, Wassef M. Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence. Syst Rev. 2017;6(1):61. https://doi.org/10.1186/s13643-017-0454-2.
Carroll C, Booth A, Leaviss J, Rick J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13(1):37.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.
Booth A, Carroll C. How to build up the actionable knowledge base: the role of ‘best fit’ framework synthesis for studies of improvement in healthcare. BMJ Qual Saf. 2015;24(11):700–8. https://doi.org/10.1136/bmjqs-2014-003642.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. https://doi.org/10.7326/0003-4819-151-4-200908180-00135.
Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181. https://doi.org/10.1186/1471-2288-12-181.
Piat M, Sofouli E, Sabetti J, Lambrou A, Chodos H, Briand C, et al. Protocol for a mixed studies systematic review on the implementation of the recovery approach in adult mental health services. BMJ Open. 2017;7(8):e017080. https://doi.org/10.1136/bmjopen-2017-017080.
New Zealand Mental Health Commission. Blueprint for mental health services in New Zealand: how things need to be. Wellington: Mental Health Commission; 1998.
Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009;62(9):944–52. https://doi.org/10.1016/j.jclinepi.2008.10.012.
Evidence Partners. DistillerSR. Ottawa, Canada.
Hong QN, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Educ Inf. 2018;34(4):285–91.
Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459–67. https://doi.org/10.1111/jep.12884.
Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, Cochrane handbook for systematic reviews of interventions version 6.0 (updated July 2019): Cochrane; 2019.
Houghton C, Murphy K, Meehan B, Thomas J, Brooker D, Casey D. From screening to synthesis: using nvivo to enhance transparency in qualitative evidence synthesis. J Clin Nurs. 2017;26(5-6):873–81. https://doi.org/10.1111/jocn.13443.
Thomas J, Harden A, Oakley A, Oliver S, Sutcliffe K, Rees R, et al. Integrating qualitative research with trials in systematic reviews. BMJ. 2004;328(7446):1010–2. https://doi.org/10.1136/bmj.328.7446.1010.
QSR International Pty Ltd. NVivo. 12 ed2018.
Gammon D, Strand M, Eng LS, Børøsund E, Varsi C, Ruland C. Shifting practices toward recovery-oriented care through an e-recovery portal in community mental health care: a mixed-methods exploratory study. J Med Internet Res. 2017;19(5):1.
Korsbek L, Tonder ES. Momentum: a smartphone application to support shared decision making for people using mental health services. Psychiatr Rehabil J. 2016;39(2):167–72. https://doi.org/10.1037/prj0000173.
Mandiberg JM, Gates LB. A community of practice for peer mental workers: lessons learned. Am J Psychiatr Rehabil. 2017;20(2):156–74. https://doi.org/10.1080/15487768.2017.1304294.
Strand M, Gammon D, Eng LS, Ruland C. Exploring working relationships in mental health care via an e-recovery portal: qualitative study on the experiences of service users and health providers. JMIR Mental Health. 2017;4(4):e54. https://doi.org/10.2196/mental.8491.
Thomas N, Farhall J, Foley F, Leitan ND, Villagonzalo KA, Ladd E, et al. Promoting personal recovery in people with persisting psychotic disorders: development and pilot study of a novel digital intervention. Front Psychiatry Front Res Found. 2016;7:196.
Williams A, Fossey E, Farhall J, Foley F, Thomas N. Recovery after psychosis: qualitative study of service user experiences of lived experience videos on a recovery-oriented website. JMIR Mental Health. 2018;5(2):e37. https://doi.org/10.2196/mental.9934.
Biebel K, Nicholson J, Woolsey K, Wolf T. Shifting an agency’s paradigm: creating the capacity to intervene with parents with mental illness. Am J Psychiatr Rehabil. 2016;19(4):315–38. https://doi.org/10.1080/15487768.2016.1231641.
Foster K, Isobel S. Towards relational recovery: nursesʼ practices with consumers and families with dependent children in mental health inpatient units. Int J Ment Health Nurs. 2018;27(2):727–36. https://doi.org/10.1111/inm.12359.
McFarland L, Fenton A. Unfogging the future: investigating a strengths-based program to build capacity and resilience in parents with mental illness. Adv Ment Health. 2018;17(1):21.
Byrne L, Happell B, Reid-Searl K. Recovery as a lived experience discipline: a grounded theory study. Issues Mental Health Nurs. 2015;36(12):935–43. https://doi.org/10.3109/01612840.2015.1076548.
Byrne L, Roennfeldt H, OʼShea P, Macdonald F. Taking a gamble for high rewards? Management perspectives on the value of mental health peer workers. Int J Environ Res Public Health. 2018;15(4):13.
Chapman SA, Blash LK, Mayer K, Spetz J. Emerging roles for peer providers in mental health and substance use disorders. Am J Prev Med. 2018;54(6S3):S267–S74.
Chinman M, Salzer M, OʼBrien-Mazza D. National survey on implementation of peer specialists in the VA: implications for training and facilitation. Psychiatr Rehabil J. 2012;35(6):470–3. https://doi.org/10.1037/h0094582.
Cleary M, Raeburn T, Escott P, West S, Lopez V. ʻWalking the tightropeʼ: the role of peer support workers in facilitating consumersʼ participation in decision-making. Int J Ment Health Nurs. 2018;27(4):1266–72. https://doi.org/10.1111/inm.12474.
Clossey L, Gillen J, Frankel H, Hernandez J. The experience of certified peer specialists in mental health. Soc Work Ment Health. 2016;14(4):408–27. https://doi.org/10.1080/15332985.2015.1038412.
Eikmeier G, Kieser LD, Paap M, Utschakowski J, Lacroix A. Reorganising a department of psychiatry according to recovery principles: a pilot study with mixed-method design. Zeitschrift fur Evidenz Fortbildung und Qualitat im Gesundheitswesen. 2017;120:16–20. https://doi.org/10.1016/j.zefq.2016.11.005.
Ellison ML, Glickman ME, Chinman M, Mitchell-Miland C, Schutt RK, Schultz MR, et al. Patterns and Predictors of Engagement in Peer Support Among Homeless Veterans With Mental Health Conditions and Substance Use Histories. Psychiatr Rehabil J. 2016;39(3):266–73. https://doi.org/10.1037/prj0000221.
Gates LB, Akabas SH. Developing strategies to integrate peer providers into the staff of mental health agencies. Admin Pol Ment Health. 2007;34(3):293–306. https://doi.org/10.1007/s10488-006-0109-4.
Hamilton AB, Chinman M, Cohen AN, Oberman RS, Young AS. Implementation of consumer providers into mental health intensive case management teams. J Behav Health Serv Res. 2015;42(1):100–8. https://doi.org/10.1007/s11414-013-9365-8.
Hurley J, Cashin A, Mills J, Hutchinson M, Kozlowski D, Graham I. Qualitative study of peer workers within the ʻPartners in Recoveryʼ programme in regional Australia. Int J Ment Health Nurs. 2018;27(1):187–95. https://doi.org/10.1111/inm.12308.
Kido Y, Kayama M. Consumer providersʼ experiences of recovery and concerns as members of a psychiatric multidisciplinary outreach team: a qualitative descriptive study from the Japan Outreach Model Project 2011-2014. PLoS One. 2017;12(3):e0173330.
Lawn S, Smith A, Hunter K. Mental health peer support for hospital avoidance and early discharge: an Australian example of consumer driven and operated service. J Ment Health. 2008;17(5):498–508. https://doi.org/10.1080/09638230701530242.
Mahler L, Jarchov-Jadi I, Gervink A, Ayilmaz H, Wilfer A, Sischka K, et al. Multiperspectivity and peers on acute wards. [German]. Nervenheilkunde. 2015;34(4):249–52.
Mancini MA. An Exploration of Factors that Effect the Implementation of Peer Support Services in Community Mental Health Settings. Commun Mental Health J. 2018;54(2):127–37. https://doi.org/10.1007/s10597-017-0145-4.
Milton A, Lloyd-Evans B, Fullarton K, Morant N, Paterson B, Hindle D, et al. Development of a peer-supported, self-management intervention for people following mental health crisis. BMC Res Notes. 2017;10(1):588. https://doi.org/10.1186/s13104-017-2900-6.
Reed TA, Broussard B, Moore A, Smith KJ, Compton MT. Community navigation to reduce institutional recidivism and promote recovery: initial evaluation of opening doors to recovery in Southeast Georgia. Psychiatr Q. 2014;85(1):25–33. https://doi.org/10.1007/s11126-013-9267-1.
Scanlan JN, Hancock N, Honey A. Evaluation of a peer-delivered, transitional and post-discharge support program following psychiatric hospitalisation. BMC Psychiatry. 2017;17(1):307. https://doi.org/10.1186/s12888-017-1469-x.
Siantz E, Henwood B, Gilmer T. Implementation of peer providers in integrated mental health and primary care settings. J Soc Soc Work Res. 2016;7(2):231–46. https://doi.org/10.1086/686644.
Siantz E, Henwood B, Gilmer T. Peer support in full-service partnerships: a multiple case study analysis. Commun Mental Health J. 2017;53(5):542–9. https://doi.org/10.1007/s10597-017-0106-y.
Simpson A, Oster C, Muir-Cochrane E. Liminality in the occupational identity of mental health peer support workers: a qualitative study. Int J Ment Health Nurs. 2018;27(2):662–71. https://doi.org/10.1111/inm.12351.
Smith-Merry J, Freeman R, Sturdy S. Implementing recovery: an analysis of the key technologies in Scotland. Int J Ment Heal Syst. 2011;5(1):11. https://doi.org/10.1186/1752-4458-5-11.
Ashman M, Halliday V, Cunnane JG. Qualitative Investigation of the Wellness Recovery Action Plan in a UK NHS Crisis Care Setting. Issues Mental Health Nurs. 2017;38(7):570–7. https://doi.org/10.1080/01612840.2017.1300840.
Choy-Brown M, Hamovitch EK, Cuervo C, Stanhope V. I have my own lease--so why the service plan again? Perspectives on service planning in supportive housing. Psychiatr Rehabil J. 2016;39(4):313–20. https://doi.org/10.1037/prj0000202.
Kisely S, Wyder M, Dietrich J, Robinson G, Siskind D, Crompton D. Motivational aftercare planning to better care: applying the principles of advanced directives and motivational interviewing to discharge planning for people with mental illness. Int J Ment Health Nurs. 2017;26(1):41–8. https://doi.org/10.1111/inm.12261.
Lodge AC, Kaufman L, Stevens MS. Barriers to implementing person-centered recovery planning in public mental health organizations in Texas: results from nine focus groups. Admin Pol Ment Health. 2016;1:413.
Mak WWS, Chan RCH, Pang IHY, Chung NYL, Yau SSW, Tang JPS. Effectiveness of Wellness Recovery Action Planning (WRAP) for Chinese in Hong Kong. Am J Psychiatr Rehabil. 2016;19(3):235–51. https://doi.org/10.1080/15487768.2016.1197859.
Marshal SL, Oades LG, Growe TP. Australian mental health consumers contributions to the evaluation and improvement of recovery-oriented service provision. Israel J Psychiatry Relat Sci. 2010;47(3):198–205.
Reid R, Escott P, Isobel S. Collaboration as a process and an outcome: consumer experiences of collaborating with nurses in care planning in an acute inpatient mental health unit. Int J Ment Health Nurs. 2018;27(4):1204–11. https://doi.org/10.1111/inm.12463.
Uppal S, Oades LG, Crowe TP, Deane FP. Barriers to transfer of collaborative recovery training into Australian mental health services: implications for the development of evidence-based services. J Eval Clin Pract. 2010;16(3):451–5. https://doi.org/10.1111/j.1365-2753.2009.01141.x.
Wallace G, Bird V, Leamy M, Bacon F, Boutillier C, Janosik M, et al. Service user experiences of REFOCUS: a process evaluation of a pro-recovery complex intervention. Soc Psychiatry Psychiatr Epidemiol. 2016;51(9):1275–84. https://doi.org/10.1007/s00127-016-1257-9.
Cameron J, Hart A, Brooker S, Neale P, Reardon M. Collaboration in the design and delivery of a mental health recovery college course: experiences of students and tutors. J Ment Health. 2018;27:374.
Dalgarno M, Oates J. The meaning of co-production for clinicians: an exploratory case study of Practitioner Trainers in one Recovery College. J Psychiatr Ment Health Nurs. 2018;15:15.
Peer JE, Gardner M, Autrey S, Calmes C, Goldberg RW. Feasibility of implementing a recovery education center in a Veterans Affairs medical center. Psychiatr Rehabil J. 2018;41(2):135–40. https://doi.org/10.1037/prj0000295.
Perkins AM, Ridler JH, Hammond L, Davies S, Hackmann C. Impacts of attending recovery colleges on NHS staff. Ment Health Soc Incl. 2017;21(1):18–24. https://doi.org/10.1108/MHSI-11-2016-0035.
Zabel E, Donegan G, Lawrence K, French P. Exploring the impact of the recovery academy: a qualitative study of Recovery College experiences. J Ment Health Train Educ Pract. 2016;11(3):162–71. https://doi.org/10.1108/JMHTEP-12-2015-0052.
Banfield M, Forbes O. Health and social care coordination for severe and persistent mental illness in Australia: a mixed methods evaluation of experiences with the Partners in Recovery Program. Int J Ment Heal Syst. 2018;12(1):13. https://doi.org/10.1186/s13033-018-0194-2.
Dunstan D, Anderson D. Applying Strengths Model principles to build a rural community-based mental health support service and achieve recovery outcomes. Rural Remote Health. 2018;18(1):3708. https://doi.org/10.22605/RRH3708.
Isaacs AN, Sutton K, Dalziel K, Maybery D. Outcomes of a care coordinated service model for persons with severe and persistent mental illness: a qualitative study. Int J Soc Psychiatry. 2017;63(1):40–7. https://doi.org/10.1177/0020764016678014.
Stewart V, Slattery M, Roennfeldt H, Wheeler AJ. Partners in recovery: paving the way for the National Disability Insurance Scheme. Aust J Prim Health. 2018;24(3):208–15. https://doi.org/10.1071/PY17136.
Willging CE, Lamphere L, Rylko-Bauer B. The transformation of behavioral healthcare in New Mexico. Admin Pol Ment Health. 2015;42(3):343–55. https://doi.org/10.1007/s10488-014-0574-0.
Gilburt H, Slade M, Bird V, Oduola S, Craig TK. Promoting recovery-oriented practice in mental health services: a quasi-experimental mixed-methods study. BMC Psychiatry. 2013;13(1):167. https://doi.org/10.1186/1471-244X-13-167.
Kidd SA, McKenzie K, Collins A, Clark C, Costa L, Mihalakakos G, et al. Advancing the recovery orientation of hospital care through staff engagement with former clients of inpatient units. Psychiatr Serv. 2014;65(2):221–5. https://doi.org/10.1176/appi.ps.201300054.
Salkeld R, Wagstaff C, Tew J. Toward a new way of relating: an evaluation of recovery training delivered jointly to service users and staff. J Ment Health. 2013;22(2):165–73. https://doi.org/10.3109/09638237.2012.694506.
Williams V, Deane FP, Oades LG, Crowe TP, Ciarrochi J, Andresen R. A cluster-randomised controlled trial of values-based training to promote autonomously held recovery values in mental health workers. Implement Sci. 2016;11:13.
Young AS, Chinman M, Forquer SL, Knight EL, Vogel H, Miller A, et al. Use of a consumer-led intervention to improve provider competencies. Psychiatr Serv. 2005;56(8):967–75. https://doi.org/10.1176/appi.ps.56.8.967.
Ahern CC, Bieling P, McKinnon MC, McNeely HE, Langstaff K. A recovery-oriented care approach: weighing the pros and cons of a newly built mental health facility. J Psychosoc Nurs Ment Health Serv. 2016;54(2):39–48. https://doi.org/10.3928/02793695-20160119-05.
Bromage B, Kriegel L, Williamson B, Maclean K, Rowe M. Project Connect: a community intervention for individuals with mental illness. Am J Psychiatr Rehabil. 2017;20(3):218–33. https://doi.org/10.1080/15487768.2017.1338038.
Beehler S, Marsella SA, Henderson PM, Resnick SG, Meterko M. Factors contributing to the effective functioning of veterans mental health councils. Psychol Serv. 2018;10:10.
Hamilton S, Tew J, Szymczynska P, Clewett N, Manthorpe J, Larsen J, et al. Power, choice and control: how do personal budgets affect the experiences of people with mental health problems and their relationships with social workers and other practitioners? Br J Soc Work. 2016;46(3):719–36. https://doi.org/10.1093/bjsw/bcv023.
Lamont E, Harris J, McDonald G, Kerin T, Dickens GL. Qualitative investigation of the role of collaborative football and walking football groups in mental health recovery. Ment Health Phys Act. 2017;12:116–23. https://doi.org/10.1016/j.mhpa.2017.03.003.
Hungerford C, Fox C. Consumerʼs perceptions of Recovery-oriented mental health services: an Australian case-study analysis. Nurs Health Sci. 2014;16(2):209–15. https://doi.org/10.1111/nhs.12088.
Hungerford C, Kench P. The perceptions of health professionals of the implementation of Recovery-oriented health services: a case study analysis. J Ment Health Train Educ Pract. 2013;8(4):208–18. https://doi.org/10.1108/JMHTEP-04-2012-0005.
Hungerford C, Hungerford A, Fox C, Cleary M. Recovery, non-profit organisations and mental health services: ʻhit and missʼ or ʻdump and runʼ? Int J Soc Psychiatry. 2016;8:350.
Hungerford C, Richardson F. Operationalising recovery-oriented services: the challenges for carers. Adv Ment Health. 2013;12(1):11–21. https://doi.org/10.5172/jamh.2013.12.1.11.
Hurley E, McKay EA. Research article: the recognition and adoption of the recovery approach by occupational therapists in acute psychiatric settings in Ireland. Irish J Occup Ther. 2009;37(2):5–13.
Khoury E, Rodriguez del Barrio L. Recovery-oriented mental health practice: a social work perspective. Br J Soc Work. 2015;1:i127–i44.
Le Boutillier C, Slade M, Lawrence V, Bird VJ, Chandler R, Farkas M, et al. Competing priorities: staff perspectives on supporting recovery. Admin Pol Ment Health. 2015;42(4):429–38. https://doi.org/10.1007/s10488-014-0585-x.
McKenna B, Furness T, Dhital D, Park M, Connally F. The transformation from custodial to recovery-oriented care: a paradigm shift that needed to happen. J Foren Nurs. 2014;10(4):226–33. https://doi.org/10.1097/JFN.0000000000000045.
Piat M, Lal S. Service providersʼ experiences and perspectives on recovery-oriented mental health system reform. Psychiatr Rehabil J. 2012;35(4):289–96. https://doi.org/10.2975/35.4.2012.289.296.
Piat M, Sabetti J. The development of a recovery-oriented mental health system in Canada: what the experience of commonwealth countries tells us. Can J Commun Mental Health. 2009;28(2):17–33. https://doi.org/10.7870/cjcmh-2009-0020.
Mental Health Commission of Canada. Guidelines for Recovery-Oriented Practice. Ottawa, ON; 2015.
Esponda GM, Hartman S, Qureshi O, Sadler E, Cohen A, Kakuma R. Barriers and facilitators of mental health programmes in primary care in low-income and middle-income countries. Lancet Psychiatry. 2020;7(1):78–92. https://doi.org/10.1016/S2215-0366(19)30125-7.
Gaskins NJ, Bray E, Hill JE, Doherty PJ, Harrison A, Connell LA. Factors influencing implementation of aerobic exercise after stroke: a systematic review. Disabil Rehabil. 2019;1:1.
Hendricks-Sturrup RM, Mazor KM, Sturm AC, Lu CY. Barriers and Facilitators to Genetic Testing for Familial Hypercholesterolemia in the United States: a review. J Person Med. 2019;9:3.
Levin SK, Nilsen P, Bendtsen P, Bulow P. Structured risk assessment instruments: a systematic review of implementation determinants. Psychiatry Psychol Law. 2016;23(4):602–28. https://doi.org/10.1080/13218719.2015.1084661.
Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update). Implement Sci. 2016;11(1):146. https://doi.org/10.1186/s13012-016-0510-7.
Pellerin MA, Lamontagne ME, Viau-Guay A, Poulin V. Systematic review of determinants influencing knowledge implementation in occupational therapy. Aust Occup Ther J. 2019;66(6):670–81. https://doi.org/10.1111/1440-1630.12612.
Maritim P, Zulu JM, Jacobs C, Chola M, Chongwe G, Zyambo J, et al. Factors shaping the implementation of the SAFE strategy for trachoma using the Consolidated Framework for Implementation Research: a systematic review. Glob Health Action. 2019;12:1.
Kadu MK, Stolee P. Facilitators and barriers of implementing the chronic care model in primary care: a systematic review. BMC Fam Pract. 2015;16(1):12. https://doi.org/10.1186/s12875-014-0219-0.
Clark M. Co-production in mental health care. Ment Health Rev J. 2015;20(4):213–9. https://doi.org/10.1108/MHRJ-10-2015-0030.
Gill KH. Recovery colleges, co-production in action: the value of the lived experience in. Health Issues. 2014;113:10.
Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implement Sci. 2019;14(1):42. https://doi.org/10.1186/s13012-019-0892-4.
Borg M, Kristiansen K. Recovery-oriented professionals: helping relationships in mental health services. J Ment Health. 2004;13(5):493–505. https://doi.org/10.1080/09638230400006809.
Price-Robertson R, Obradovic A, Morgan B. Relational recovery: beyond individualism in the recovery approach. Adv Ment Health. 2017;15(2):108–20. https://doi.org/10.1080/18387357.2016.1243014.
Slade M, Amering M, Farkas M, Hamilton B, O’Hagan M, Panther G, et al. Uses and abuses of recovery: implementing recovery-oriented practices in mental health systems. World Psychiatry. 2014;13(1):12–20. https://doi.org/10.1002/wps.20084.
Garside R. Should we appraise the quality of qualitative research reports for systematic reviews, and if so, how? Innovation. 2014;27(1):67–79.
Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA. Cochrane Handbook for Systematic Reviews of Interventions version 6.1: Cochrane; 2020.
We would like to kindly acknowledge, Jill Boruff, Quan Nha Hong, Judith Sabetti, Laura Damschroder, Caitlin Reardon, Larry Davidson, and Florian Storch, for their input.
This study was funded by the Canadian Institutes of Health Research Grant # KRS 144043.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
PRISMA Checklist and ENTREQ Checklist.
Comparison of Protocol and Finished Review.
Search Strategy MEDLINE.
Modified CFIR Data Extraction Framework with Definitions.
Reference List of Included Studies.
Mixed Methods Appraisal Tool Results.
Study Characteristics table.
Illustrative Quotes for Each Theme.
About this article
Cite this article
Piat, M., Wainwright, M., Sofouli, E. et al. Factors influencing the implementation of mental health recovery into services: a systematic mixed studies review. Syst Rev 10, 134 (2021). https://doi.org/10.1186/s13643-021-01646-0
- Systematic review
- Mixed methods
- Mental health recovery
- Recovery-oriented services
- Recovery innovations
- Implementation science
- Consolidated framework for implementation research (CFIR)
- Best-fit framework synthesis