Skip to main content

The impact of technology systems and level of support in digital mental health interventions: a secondary meta-analysis

Abstract

Background

The majority of people with a chronic disease (e.g., diabetes, hypertension, COPD) have more than one concurrent condition and are also at higher risk for developing comorbidities in mental health, including anxiety and depression. There is an urgent need for more relevant and accurate data on digital interventions in this area to prepare for an increase demand for mental health services. The aim of this study was to conduct a meta-analysis of the digital mental health interventions for people with comorbid physical and mental chronic diseases to compare the effect of technology systems and level of support.

Methods

This secondary meta-analysis follows a rapid review of systematic reviews, a virtual workshop with knowledge users to identify research questions and a modified Delphi study to guide research methods: What types of digital health interventions (according to a recognized categorization) are the most effective for the management of concomitant mental health and chronic disease conditions in adults? We conducted a secondary analysis of the primary studies identified in the rapid review. Two reviewers independently screened the titles and abstracts and applied inclusion criteria: RCT design using a digital mental health intervention in a population of adults with another chronic condition, published after 2010 in French or English, and including an outcome measurement of anxiety or depression.

Results

Seven hundred eight primary studies were extracted from the systematic reviews and 84 primary studies met the inclusion criteria Digital mental health interventions were significantly more effective than in-person care for both anxiety and depression outcomes. Online messaging was the most effective technology to improve anxiety and depression scores; however, all technology types were effective. Interventions partially supported by healthcare professionals were more effective than self-administered.

Conclusions

While our meta-analysis identifies digital intervention’s characteristics are associated with better effectiveness, all technologies and levels of support could be used considering implementation context and population.

Trial registration

The protocol for this review is registered in the National Collaborating Centre for Methods and Tools (NCCMT) COVID-19 Rapid Evidence Service (ID 75).

Peer Review reports

Background

Chronic diseases are the main burden on health systems in developed countries and account for almost 70% of deaths worldwide [1]. The majority of people with a chronic disease (e.g., diabetes, hypertension, chronic obstructive pulmonary disease) have more than one concurrent condition and are also at higher risk for developing comorbidities in mental health, including anxiety and depression [2]. The prevalence of depression or anxiety together with another chronic health disease is approximated to 27% in outpatients populations [3, 4]. Studies have also reported a higher prevalence of anxiety disorders in relation to different chronic diseases [5]. Increased use of health services is also observed in people living with a chronic disease and with a concomitant depressive disorder [6]. Canadians primary healthcare interdisciplinary teams, surveyed during the COVID-19 pandemic, reported a need for broadening services offering to answer the increase in encounters for mental health issues [7]. There is an urgent need for more relevant and accurate data on digital interventions in this area to prepare for an increase demand for mental health services.

Practice-based interventions in primary care settings have been shown effective to improve the management of depression in people with chronic diseases [4]. In addition, a large number of interventions using digital technologies have been evaluated for the management of depression or anxiety [8, 9], and systematic reviews indicate that they are effective in providing timely and delocalized care for college students [10]. However, it is still unclear what elements or characteristics of digital interventions for mental health are effective [10].

A rapid review provides knowledge users with data that can be readily used to inform healthcare decisions [11]. When the topic is broad, it can lead to data that lack precision to fulfil knowledge users’ needs regarding the most effective content and implementation methods. In an effort to gather data on the effectiveness of digital mental health interventions for people with a chronic disease, a rapid review of systematic reviews was completed [12] and offered only an overview of the problem. The aim of this study was to conduct a meta-analysis of the digital mental health interventions for people with comorbid physical and mental chronic diseases to compare the effect of technology systems and level of support.

Methods

We engaged with a panel of knowledge users (clinicians, decision makers), lived experience experts (patients), review methodologists, and researchers throughout the review process, including research question development, literature screening, data interpretation and writing of results, and dissemination of findings. The panel was engaged in weekly online meeting to gather comments, present results or participate in problem solving.

Preliminary research

This secondary analysis is based on the data from a rapid review of systematic reviews [12]. We followed guidelines outlined by the Cochrane Handbook chapter regarding Overview of Reviews and the Cochrane Rapid Reviews Methods Group [13, 14]. The review identified a large body of evidence (35 systematic reviews) showing that digital mental health interventions were effective and safe for people with chronic diseases and cancer but that the evidence was still lacking for children and youth populations. To inform the knowledge users at each step, the first stage and lessons learned while developing the project were published elsewhere [12, 15]. The lessons learned paper was published in the native language of the knowledge users (French) and described the process of engaging with our panel and how it informed the review method.

Three research activities followed the rapid review: a virtual workshop with knowledge users to present our preliminary results and gather their suggestions in nine possible research questions, a modified Delphi study to prioritize the proposed suggestions for the next stage of the review, and a secondary analysis of the primary studies identified through the rapid review. All activities of the study are summarized in Fig. 1.

Fig. 1
figure 1

Summary of the activities and timeline

Workshop

A total of 10 knowledge users, from provincial (Quebec Ministry of Health and Social Services, Institut national d’excellence en santé et services sociaux), regional (Integrated Health and Social Services Centers) and local organizations were invited to take part in a virtual meeting on July 16th 2020 where the preliminary results from the rapid review were presented and discussed. During the workshop, knowledge users were invited to share their experience regarding digital health interventions for mental health issues, in particular in the context of the COVID-19 pandemic. They were welcome to ask questions and to comment on the findings of the rapid review and its relevance for their practice. They were also encouraged to identify knowledge gaps that could be addressed in the next stage of the review.

Delphi study

Following the workshop with knowledge users, a summary of the main knowledge gaps identified was performed by the research team. We translated these knowledge gaps into nine review questions that were used as the basis for a modified Delphi study. We developed a questionnaire using the REDCap system [16] and sent a personalized invitation to participants in the workshop, inviting them to complete the survey. These knowledge users were also invited to suggest names of potential additional knowledge users who could have an interest in the topic. The questionnaire comprised two sections. First, participants had to rate on a 5-point Likert scale the importance, relevance, and applicability in the context of COVID-19, each of the nine potential review questions. Second, participants were invited to rank each of the nine questions (1 = most important; 9 = less important) according to their preference (Additional file 1). A total of 16 knowledge users were invited to take part in a two-round Delphi process to identify the key question for the next stage of the knowledge synthesis. All the knowledge users completed the two rounds and all questions reached consensus using median and IQR. The prioritized question after the second round was “What types of digital health interventions (according to a recognized categorization) are the most effective for the management of concomitant mental health and chronic disease conditions in adults?”

Secondary analysis

To provide an answer to knowledge users, we conducted a secondary analysis of the primary studies included in the reviews identified in our previous rapid review, published elsewhere [1]. Based on the input from knowledge users, we added inclusion criteria at this stage. We included randomized-controlled trials (RCT) including a digital health intervention for the management of concomitant mental health and chronic disease conditions in adults, published during the last 10 years (since 2010) in French or English, and including an outcome measurement of anxiety and/or depression.

All the primary studies referenced in the 35 systematic reviews were extracted and included for the citation screening. Six reviewers individually performed screenings for titles, abstracts and then full text using pilot-tested standardized forms on 25 citations for the first level of screening. All citations were reviewed by two reviewers independently at the first level of screening. A standardized extraction form was developed that included study characteristics (e.g., authors, country, design), intervention characteristics (e.g., type of digital intervention), and outcomes reported (measurement tools used, means, standard deviation, and time of measurement). Data were extracted by four research associates, and a senior investigator (MPG) completed a quality appraisal of all extracted data. Information related to the study characteristics (first author, date of publication, country, population, health condition, type of intervention, outcomes measured, means, standard deviations, author’s conclusions) were extracted directly in the DistillerSR tool [17].

As knowledge users were interested in obtaining evidence on specific types of digital health interventions for concomitant mental health and chronic health conditions, we looked for existing classifications of digital health tools to sort interventions. We consulted the WHO Classification of digital health interventions [18] and previous reviews on digital mental health solutions [19, 20]. Given the limitations of existing categorizations, we used our own system which considered the technology system, the synchronous or asynchronous nature of the intervention, and the level of professional support (self-administration, partially guided, guided). The classification used ten technology systems categories (not exclusive): Internet or website, computer software, mobile application, electronic messaging (email, SMS), electronic health record, telehealth (telemedicine, telepsychiatry), virtual reality/augmented reality, robot, connected devices, and other system.

We completed a meta-analysis of the standardized means difference (SMD) with an analysis of heterogeneity (χ2and I 2) for the two outcomes of interest. We used Cohen’s D, fixed-effects meta-analysis and the R software for data analysis.

The Cochrane Risk of Bias for Intervention Studies (ROBIS) tool was completed by two investigators (MS, MPG) to assess the probability of bias in the included studies. Five types of biases were considered: (1) risk of bias arising from the randomization process; (2) risk of bias due to deviations from the intended interventions; (3) missing outcome data; (4) risk of bias in the measurement of the outcomes; and (5) risk of bias in the detection of the reported results. An overall risk of bias was also assessed.

We report our results based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement [21].

Result

The flow diagram of studies included in the secondary analyses is presented in Fig. 2. All individual primary studies included in the systematic reviews of the rapid review were considered.

Fig. 2
figure 2

Study flow diagram: meta-analysis. Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6(6): e1000097. doi:http://orcid.org/10.1371/journal.pmed1000097

A total of 708 primary studies were identified from the systematic reviews included in the rapid review. A total of 429 primary studies were excluded at title and abstract screening stage (duplicates 91; publication year or study design 338). Following screening of full text, we excluded 195 records with reasons (population 40; intervention and study design 86; outcomes 67; language 2), resulting in a total of 84 primary studies included in the secondary meta-analysis.

Characteristics of included studies

We included primary studies published between 2010 and 2019. Those studies comprised a total sample of 11,037 participants. Countries where the studies were conducted included Sweden (23), the USA (18), Australia (14), Netherlands (9), United Kingdom (7), Germany (6), Switzerland (2), Norway (1), Canada (1), Jordan (1), New Zealand (1), and South Korea (1).

Most studies described interventions performed in the community (33%) and targeted a mixed gender adult population (91%). All studies evaluated digital interventions to manage and treat mental health issues, and a majority (80%) were based on cognitive behavioural therapy (CBT). Most studies compared digital health interventions to usual care (76%), although some studies compared two or more digital interventions (24%).

The complete description of included studies is presented in Table 1 and interventions are described under the framework of digital mental health interventions including a description of the system use, the function of the digital intervention, the time, and the level of facilitation (Additional files 2 and 3).

Table 1 Description of included studies in the meta-analysis

A summary of the estimated effect size for each intervention characteristics, heterogeneity, and inconsistency for all comparisons, and for both outcomes are presented in Table 2.

Table 2 Summary of comparative intervention characteristics

Global mean differences

The first analysis aimed at the global group differences of any digital intervention compared to usual care or another digital intervention to manage anxiety or depression for people with any concomitant chronic condition.

A total of 62 studies including 8719 participants with anxiety outcomes measures were included in the meta-analysis of the overall effect of digital interventions on anxiety outcomes (Additional file 4). The results showed a significant decrease in the anxiety score related to digital health interventions compared to usual care or another digital intervention [standardized mean difference (SMD) = − 0.40; 95% confidence interval (CI) = − 0.35; − 0.44)] (Fig. 3). Although heterogeneity is high between studies (I2 = 85.77%) the results are consistent across studies (Table 2).

Fig. 3
figure 3

Forest plot: subgroup analysis of self-directed interventions for any digital intervention vs. usual care or another digital intervention to manage anxiety in people with any concomitant chronic condition

Regarding depression outcomes, we conducted a meta-analysis including 75 studies with 9970 participants. Figure 4 shows a significant reduction in depression scores associated with the use of digital health interventions compared to usual care (SDM = − 0.33; 95% CI [− 0.29, − 0.37]). Heterogeneity is also high for this overall comparison (I2 = 76.35%) with results consistent across studies (Table 2).

Fig. 4
figure 4

Forest plot: subgroup analysis of partially guided interventions for any digital intervention vs. usual care or another digital intervention to manage anxiety in people with any concomitant chronic condition

Level of professional support

The forest plots for comparing the level of professional support are presented for anxiety (Figs. 3 and 4) and depression (Figs. 5 and 6) outcomes separately.

Fig. 5
figure 5

Forest plot: subgroup analysis of self-directed interventions for any digital intervention vs. usual care or another digital intervention to manage depression in people with any concomitant chronic condition

Fig. 6
figure 6

Forest plot: subgroup analysis of partially guided interventions for any digital intervention vs. usual care or another digital intervention to manage depression in people with any concomitant chronic condition

Self-administration was the delivery method in 30 studies (5312 participants) with anxiety outcomes and 40 studies (6379 participants) reporting depression outcomes. Self-administered delivery showed a significant decrease in anxiety scores [SMD − 0.35 (− 0.30, − 0.41)] and depression scores [(SMD − 0.28 (− 0.23, − 0.33)].

Partial support by a healthcare provider was used in 29 studies (3206 participants) reporting anxiety outcomes, and 33 studies (3470 participants) reporting depression outcomes. Partial support showed a significant decrease in anxiety [SMD – 0.46 (− 0.39, − 0.53)] and depression scores [SMD – 0.43 (− 0.36, − 0.50)].

Interventions entirely guided by a healthcare professional were used in three studies (201 participants) reporting anxiety outcomes and two studies (121 participants) reporting depression outcomes. Interventions entirely supported by healthcare professionals showed a significant difference for anxiety scores [SMD − 0.46 (− 0.16, − 0.76)] but no significant difference between groups for depression scores [SMD 0.15 (0.53, − 0.21)].

Type of technology

Eight different technologies were used in studies reporting anxiety outcomes and half (n = 4) had multiple reporting to perform a meta-analysis (Figs. 7 and 8). For studies reporting a depression outcome, seven technologies were used, and five of them had more than one study (Figs. 9 and 10). Forest plots that include all studies are presented in Additional files 6 and 7.

Fig. 7
figure 7

Forest plot: subgroup analysis of electronic messaging interventions for any digital intervention vs. usual care or another digital intervention to manage anxiety in people with any concomitant chronic condition

Fig. 8
figure 8

Forest plot: subgroup analysis of internet or website interventions for any digital intervention vs. usual care or another digital intervention to manage anxiety in people with any concomitant chronic condition

Fig. 9
figure 9

Forest plot: subgroup analysis on electronic messaging interventions for any digital intervention vs. usual care or another digital intervention to manage depression in people with any concomitant chronic condition

Fig. 10
figure 10

Forest plot: subgroup analysis on internet and website interventions for any digital intervention vs. usual care or another digital intervention to manage depression in people with any concomitant chronic condition

Electronic messaging was used in 23 studies (2700 participants) reporting anxiety outcomes, and 25 studies (2915 participants) reporting depression outcomes. Electronic messaging showed significant improvement in anxiety scores [SMD − 0.48 (− 0.39, − 0.56)] and depression scores [SMD − 0.48 (− 0.40, − 0.56)].

Internet and website technologies were used in 58 studies (8305 participants) reporting anxiety outcomes, and 70 studies (9492 participants) reporting depression outcomes. Internet and website interventions showed significant improvement in anxiety [SMD − 0.39 (− 0.35, − 0.44)] and depression scores [SMD − 0.33 (− 0.29, − 0.37)].

Telehealth and telemedicine were used in four studies (394 participants) reporting anxiety and/or depression outcomes. Telehealth and telemedicine showed significant improvement in anxiety [SMD − 0.50 (− 0.29, − 0.70)] and depression scores [SMD − 0.75 (− 0.54, − 0.96)].

A computer software was used in two studies (114 participants) reporting anxiety outcomes and four studies (191 participants) with depression outcomes. Computer software showed significant improvement in anxiety [SMD − 0.57 (− 0.18, − 0.96)] and depression scores [SMD − 0.55 (− 0.26, − 0.85)].

Mobile applications were used in one study (76 participants) with anxiety outcomes and two studies (196 participants) with depression outcomes. Mobile applications showed significant improvement for anxiety scores [SMD − 0.52 (− 0.04, − 1.00)], but no significant difference between groups for depression scores [SMD − 0.26 (0.02, − 0.55)].

Connected devices were used in one study with 51 participants and showed no differences between groups for anxiety [SMD − 0.22 (0.33, − 0.77)] and depression scores [SMD − 0.13 (0.42, − 0.68)]

Virtual reality was used in one study with 80 participants with anxiety outcomes and showed significant improvement on anxiety scores [SMD − 1.73 (− 1.21, − 2.25)].

One other type of technology in the form of Digital Video Disk (DVD) was used in one study (220 participants) with anxiety outcomes and two studies (273 participants) with depression outcomes. DVD interventions showed no differences between groups for anxiety [SMD − 0.15 (0.11, − 0.42)] and depression scores [SMD − 0.10 (0.14, − 0.34)].

Risk of bias

Figure 11 presents the risk of bias across studies for each domain. Most of the included studies showed an overall low risk of bias. However, risk of bias was generally high for the Domain 4: Risk of bias in the measurement of the outcomes. In fact, blinding of study participants was not done in most studies and outcomes were self-reported, leading to a high risk of performance bias. This bias is present across studies because it is not possible in a behavioral intervention and would eventually lead to an overestimation of the effect.

Fig. 11
figure 11

Assessment of the risk of bias across studies

Discussion

This knowledge synthesis aimed to rapidly provide evidence for knowledge users regarding the types of digital mental health interventions that were the most effective for people living with a concomitant chronic disease. This secondary analysis answers a specific research question based on knowledge users’ needs and prioritization. Thus, preliminary work in the form of a workshop and a two-round Delphi study were conducted to identify the top-priority question for knowledge users. This question was “What types of digital health interventions are the most effective for the management of concomitant mental health and chronic disease conditions in adults?”. A total of 84 primary studies including anxiety and depression outcomes were identified from the systematic reviews.

Overall, the results show that digital health interventions are effective to manage mental health issues in adults living with a concomitant chronic condition. The magnitude of the effect varies for anxiety and depression, and heterogeneity is generally high, but the effect size and direction are consistent across studies. Subgroup analyses show that digital mental health interventions with partial support from a healthcare provider have a larger effect size than self-administered interventions. These results are in line with what is known for other populations [107, 108]. There is not enough evidence to conclude in the effectiveness of digital interventions that are completely guided by a healthcare professional because of the lack of studies in this category. One key challenge of self-administered digital mental health interventions is sustaining engagement and reducing dropout [109, 110]. Partially supported interventions are mitigating these challenges by improving interactivity and personalization [111, 112]. However, it is also documented that patients could prefer to only interact with a platform instead than talking with a healthcare professional, highlighting a need for flexible interventions [113]. This meta-analysis shows that partially supported and self-directed digital mental health interventions can be used for patients with chronic diseases and could save clinical time and resources as well as care engagement.

Regarding the type of technology used, our analyses show that the most effective type of intervention is electronic messaging, but that all types of technologies are effective for both anxiety and depression scores. This finding adds to the literature on the use of digital mental health to reduce disparities, while considering that technology have varying value across population (e.g., elder, lower socio-economic). Indeed, as our results show that all types of technologies are equally or more effective than usual care, stakeholders could choose and implement interventions in relation with the needs of the population. For example, decision-makers can tailor their choices with respect to cost, ease of access or easing stigma barriers [114].

More research will be needed for newer technologies, such as mobile apps and virtual reality, which have showed effectiveness only in a small number of studies with a large confidence interval.

The significant statistical heterogeneity observed between studies in every comparison is not surprising and could be likely due to differences in comorbidity, outcome measure used, and content of the intervention. However, patterns shown in this meta-analysis are useful for clinical use and implementation.

This knowledge synthesis was informed by knowledge users in order to validate the review questions considering their needs and identify knowledge gaps that would require more evidence. We used a two-stage process, starting with a rapid review of systematic reviews followed by a secondary analysis of the primary studies. Although we used a systematic approach for selecting these studies, a major limitation is that more recent studies were not included in the analyses. To meet the requirement of the funding agency and the urgent need for evidence in the current pandemic, we considered only the most recent studies (published from 2010) from the included reviews. We also assessed the risk of bias in the included studies.

Results from the meta-analyses should be interpreted with caution since heterogeneity was generally high. Further analyses, including subgroup analyses for different populations, are needed to provide a more detailed and nuanced portrait of the effectiveness of digital mental health interventions. Furthermore, sensitivity analyses, notably by considering the risk of bias related to the lack of blinding of participants, would be required to minimize the risk of an overestimation of the effect. Some studies used multiples systems in the same intervention, which could overestimate the effect size. We also merged together comparator groups, which could affect the interpretation of results for clinical application. Finally, we cannot rule out the possibility of publication bias, as well as other factors that could lessen the level of confidence in the reported effects.

Available evidence suggests that digital health interventions such as internet-based cognitive behavioural therapy (iCBT) could be effective and provide an alternative to face-to-face psychological interventions to manage mental health issues in adults living with a concomitant chronic condition. In the context of the COVID-19 pandemic, digital technologies have played a key role in healthcare. Many of these innovations support the care of people in need of medical attention, including those with chronic illnesses. In response to the current crisis, but also to better prepare for the post-crisis and future crises, digital mental health interventions could be a useful tool to manage mental health problems in people living with chronic conditions.

Conclusion

This knowledge synthesis provides an overview of the current evidence regarding the use of digital health interventions to improve mental health in people living with a chronic condition. Knowledge users’ most urgent need was for evidence on which type of digital interventions to use for mental health management. While our meta-analysis indicates different levels of effectiveness associated with digital interventions’ characteristics, all technologies and levels of support can be used with consideration of implementation context and population, and self-administered and partially supported interventions could help save time and resources as well as supporting engagement in care.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

QIR:

Interquartile range

RCT:

Randomized-controlled trials

WHO:

World Health Organization

SMD:

Standardized means difference

ROBIS:

Risk of Bias for Intervention Studies

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

CBT:

Cognitive behavioural therapy

CI:

Confidence interval

iCBT:

Internet-based cognitive behavioural therapy

References

  1. World Health Organisation. Global status report on noncommunicable diseases. Geneva: Switzerland; 2014.

    Google Scholar 

  2. DeJean D, Giacomini M, Vanstone M, Brundisini F. Patient experiences of depression and anxiety with chronic disease: a systematic review and qualitative meta-synthesis. Ont Health Technol Assess Ser. 2013;13(16):1–33.

    CAS  PubMed  PubMed Central  Google Scholar 

  3. Wang J, Wu X, Lai W, Long E, Zhang X, Li W, et al. Prevalence of depression and depressive symptoms among outpatients: a systematic review and meta-analysis. BMJ Open. 2017;7(8): e017173.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Watson LC, Amick HR, Gaynes BN, Brownley KA, Thaker S, Viswanathan M, et al. Practice-based interventions addressing concomitant depression and chronic medical conditions in the primary care setting: a systematic review and meta-analysis. J Prim Care Community Health. 2013;4(4):294–306.

    Article  PubMed  Google Scholar 

  5. Sherbourne CD, Wells KB, Meredith LS, Jackson CA, Camp P. Comorbid anxiety disorder and the functioning and well-being of chronically ill patients of general medical providers. Arch Gen Psychiatry. 1996;53(10):889–95.

    Article  CAS  PubMed  Google Scholar 

  6. Stein MB, Cox BJ, Afifi TO, Belik SL, Sareen J. Does co-morbid depressive illness magnify the impact of chronic physical illness? A population-based perspective. Psychol Med. 2006;36(5):587–96.

    Article  PubMed  Google Scholar 

  7. Donnelly C, Ashcroft R, Bobbette N, Mills C, Mofina A, Tran T, et al. Interprofessional Primary Care During COVID-19: The Provider Perspective. 2020. Available at SSRN 3629453.

    Google Scholar 

  8. García-Lizana F, Muñoz-Mayorga I. Telemedicine for depression: a systematic review. Perspect Psychiatr Care. 2010;46(2):119–26.

    Article  PubMed  Google Scholar 

  9. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42.

    Article  PubMed  Google Scholar 

  10. Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital mental health interventions for depression, anxiety, and enhancement of psychological well-being among college students: systematic review. J Med Internet Res. 2019;21(7): e12869.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, et al. Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2020;130:13–22.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Sasseville M, LeBlanc A, Boucher M, Dugas M, Mbemba G, Tchuente J, et al. Digital health interventions for the management of mental health in people with chronic diseases: a rapid review. BMJ Open. 2021;11(4):e044437.

  13. Garritty CGG, Kamel C, King VJ, Nussbaumer-Streit B, Stevens A, Hamel C, et al. Cochrane Rapid Reviews. Interim Guidance from the Cochrane Rapid Reviews Methods Group. 2020.

  14. Higgins J TJ, Chandler J, Cumpston M, Li T, Page M, et al. Cochrane Handbook for Systematic Reviews of Interventions Version 6.0 (Updated July 2019). 2019.

  15. Gagnon M-P, Sasseville M, LeBlanc A. A stepped approach for knowledge synthesis to rapidly inform clinical decisions: methods and lessons learned during the COVID-19 pandemic. Sci Nurs Health Pract. 4(1);1–9.

  16. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95: 103208.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Evidence Partners. DistillerSR [Computer Program]. Ottawa, Canada: Evidence Partners. 2011.

  18. World Health O. Classification of digital health interventions v1.0: a shared language to describe the uses of digital technology for health. Geneva: World Health Organization; 2018. Contract No.: WHO/RHR/18.06.

    Google Scholar 

  19. Liverpool S, Mota CP, Sales CMD, Čuš A, Carletto S, Hancheva C, et al. Engaging children and young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers. J Med Internet Res. 2020;22(6): e16317.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Hollis C, Falconer CJ, Martin JL, Whittington C, Stockton S, Glazebrook C, et al. Annual Research Review: digital health interventions for children and young people with mental health problems - a systematic and meta-review. J Child Psychol Psychiatry. 2017;58(4):474–503.

    Article  PubMed  Google Scholar 

  21. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7): e1000097.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Aguado L, Claudia X, Taylor, Teletia R, McMillan, Susan, et al. Use and helpfulness of self-administered stress management therapy in patients undergoing cancer chemotherapy in community clinical settings. J Psychosocial Oncol. 2012;30(1):57–80.

    Article  Google Scholar 

  23. Andersson E, Enander J, Andren P, et al. Internet-based cognitive behaviour therapy for obsessive-compulsive disorder: a randomized controlled trial. Psychol Med. 2012;42(10):2193–203.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Andersson, Gerhard, Carlbring, Per, Furmark, Tomas, et al. Therapist experience and knowledge acquisition in internet-delivered CBT for social anxiety disorder: a randomized controlled trial. PLOS One. 2012;7(5):e37411.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Andersson G, Paxling B, Roch NP. Internet-based psychodynamic versus cognitive behavioral guided self-help for generalized anxiety disorder: a randomized controlled trial. Psychother Psychosomatics. 2012;81(6):344–55.

    Article  Google Scholar 

  26. Bani Eslam M, Ahmad Muayyad. Virtual reality as a distraction technique for pain and anxiety among patients with breast cancer: a randomized control trial. Palliat Support Care. 2019;17(1):29–34.

    Article  Google Scholar 

  27. Bell Caroline J, Colhoun Helen C, Carter Frances A, et al. Effectiveness of computerised cognitive behaviour therapy for anxiety disorders in secondary care. Australian N Z J Psychiatry. 2012;46(7):630–40.

    Article  Google Scholar 

  28. Berger T, Hammerli K, Gubser N, et al. Internet-based treatment of depression: a randomized controlled trial comparing guided with unguided self-help. Cogn Behav Ther. 2011;40(4):251–66.

    Article  PubMed  Google Scholar 

  29. Bergström Jan, Andersson Gerhard, Ljótsson Brjánn, et al. Internet-versus group-administered cognitive behaviour therapy for panic disorder in a psychiatric setting: a randomised trial. BMC Psychiatry. 2010;10(1):54.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Boele Florien W, Klein Martin, Verdonck-de L, Irma M, et al. Internet-based guided self-help for glioma patients with depressive symptoms: a randomized controlled trial. J Neuro-Oncol. 2018;137(1):191–203.

    Article  Google Scholar 

  31. Bond Gail E, Burr Robert L, Wolf Fredric M, et al. The effects of a web-based intervention on psychosocial well-being among adults aged 60 and older with diabetes. Diabetes Educ. 2010;36(3):446–56.

    Article  PubMed  Google Scholar 

  32. Bowler Jennifer O, Mackintosh Bundy, Dunn Barnaby D, et al. A comparison of cognitive bias modification for interpretation and computerized cognitive behavior therapy: effects on anxiety, depression, attentional control, and interpretive bias. J Consult Clin Psychol. 2012;80(6):1021–33.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Braamse A. M J, van M B, Visser OJ, et al. A randomized clinical trial on the effectiveness of an intervention to treat psychological distress and improve quality of life after autologous stem cell transplantation. Ann Hematol. 2016;95(1):105–14.

    Article  CAS  PubMed  Google Scholar 

  34. Bromberg J, Wood ME, Black RA, et al. A randomized trial of a web-based intervention to improve migraine self-management and coping. Headache. 2012;52(2):244–61.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Buhrman M, Fredriksson A, Edstrom G, et al. Guided Internet-delivered cognitive behavioural therapy for chronic pain patients who have residual symptoms after rehabilitation treatment: randomized controlled trial. Eur J Pain. 2013;17(5):753–65.

    Article  CAS  PubMed  Google Scholar 

  36. Buhrman M, Nilsson I E, Jannert M, et al. Guided internet-based cognitive behavioural treatment for chronic back pain reduces pain catastrophizing: a randomized controlled trial. J Rehabil Med. 2011;43(6):500–5.

    Article  PubMed  Google Scholar 

  37. Buhrman Monica, Skoglund Astrid, Husell Josefin, et al. Guided internet-delivered acceptance and commitment therapy for chronic pain patients: a randomized controlled trial. Behav Res Ther. 2013;51(6):307–15.

    Article  PubMed  Google Scholar 

  38. Buhrman, Monica, Syk Martin, Burvall Olle, et al. Individualized guided internet-delivered cognitive-behavior therapy for chronic pain patients with comorbid depression and anxiety: a randomized controlled trial. 2015;31(6):504–16.

    Google Scholar 

  39. Carlbring P, Maurin L, Torngren C, et al. Individually-tailored, Internet-based treatment for anxiety disorders: a randomized controlled trial. Behav Res Ther. 2011;49(1):18–24.

    Article  PubMed  Google Scholar 

  40. Carrard I, Crepin C, Rouget P, et al. Randomised controlled trial of a guided self-help treatment on the Internet for binge eating disorder. Behav Res Ther. 2011;49(8):482–91.

    Article  CAS  PubMed  Google Scholar 

  41. Cohn MA, Pietrucha ME, Saslow LR, et al. An online positive affect skills intervention reduces depression in adults with type 2 diabetes. J Posit Psychol. 2014;9(6):523–34.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Cooper CL, Hind D, Parry GD, et al. Computerised cognitive behavioural therapy for the treatment of depression in people with multiple sclerosis: external pilot trial. Trials. 2011;12:259.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Damholdt MF, Mehlsen M, O’Toole MS, et al. Web-based cognitive training for breast cancer survivors with cognitive complaints-a randomized controlled trial. Psychooncology. 2016;25(11):1293–300.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Dear Blake F, Gandy Milena, Karin Eyal, et al. The Pain Course: a randomised controlled trial examining an internet-delivered pain management program when provided with different levels of clinician support. Pain. 2015;156(10):1920–35.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Dear Blake F, Titov Nick, Perry Kathryn N, et al. The Pain Course: a randomised controlled trial of a clinician-guided Internet-delivered cognitive behaviour therapy program for managing chronic pain and emotional well-being0. PAIN®. 2013;154(6):942–5.

    Article  PubMed  Google Scholar 

  46. Devi Reena, Powell John, Singh Sally. A web-based program improves physical activity outcomes in a primary care angina population: randomized controlled trial.  J Med Internet Res 2014;16(9):e186. 2014;16(9):e186.

    Google Scholar 

  47. Drozd F, Skeie LG, Kraft P, et al. A web-based intervention trial for depressive symptoms and subjective well-being in patients with chronic HIV infection. AIDS Care. 2014;26(9):1080–9.

    Article  PubMed  Google Scholar 

  48. Engel CC, Litz B, Magruder KM, et al. Delivery of self training and education for stressful situations (DESTRESS-PC): a randomized trial of nurse assisted online self-management for PTSD in primary care. Gen Hosp Psychiatry. 2015;37(4):323–8.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Everitt Hazel, Moss M Rona, Sibelli Alice, et al. Management of irritable bowel syndrome in primary care: the results of an exploratory randomised controlled trial of mebeverine, methylcellulose, placebo and a self-management website. BMC Gastroenterol. 2013;13(1):68.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Farrer L, Christensen H, Griffiths KM, et al. Internet-based CBT for depression with and without telephone tracking in a national helpline: randomised controlled trial. PLoS One. 2011;6(11): e28099.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Friesen Lindsay N, Hadjistavropoulos Heather D, Schneider Luke H, et al. Examination of an internet-delivered cognitive behavioural pain management course for adults with fibromyalgia: a randomized controlled trial. Pain. 2017;158(4):593–604.

    Article  PubMed  Google Scholar 

  52. Glozier Nicholas, Christensen Helen, Naismith Sharon, et al. Internet-delivered cognitive behavioural therapy for adults with mild to moderate depression and high cardiovascular disease risks: a randomised attention-controlled trial. PLOS One. 2013;8(3):e59139.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Hedborg Kerstin, Muhr Carin. Multimodal behavioral treatment of migraine: An Internet-administered, randomized, controlled trial. Upsala J Med Sci. 2011;116(3):169–86.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Hedman E, Andersson G, Lindefors N, et al. Personality change following internet-based cognitive behavior therapy for severe health anxiety. PLoS One. 2014;9(12): e113871.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Hedman Erik, Andersson Gerhard, Andersson Erik, et al. Internet-based cognitive–behavioural therapy for severe health anxiety: randomised controlled trial. Br J Psychiatry. 2011;198(3):230–6.

    Article  PubMed  Google Scholar 

  56. Hesser Hugo, Gustafsson Tore, Lundén Charlotte, et al. A randomized controlled trial of internet-delivered cognitive behavior therapy and acceptance and commitment therapy in the treatment of tinnitus. J Consult Clin Psychol. 2012;80(4):649–61.

    Article  PubMed  Google Scholar 

  57. Ivarsson David, Blom Marie, Hesser Hugo, et al. Guided internet-delivered cognitive behavior therapy for post-traumatic stress disorder: a randomized controlled trial. Internet Interventions. 2014;1(1):33–40.

    Article  Google Scholar 

  58. Jacobi C, Volker U, Trockel MT, et al. Effects of an Internet-based intervention for subthreshold eating disorders: a randomized controlled trial. Behav Res Ther. 2012;50(2):93–9.

    Article  PubMed  Google Scholar 

  59. Jasper K, Weise C, Conrad I, et al. Internet-based guided self-help versus group cognitive behavioral therapy for chronic tinnitus: a randomized controlled trial. Psychother Psychosomatics. 2014;83(4):234–46.

    Article  Google Scholar 

  60. Johansson Birgitta, Bjuhr Helena, Karlsson Magdalena, et al. Mindfulness-Based Stress Reduction (MBSR) Delivered Live on the Internet to Individuals Suffering from Mental Fatigue After an Acquired Brain Injury. Mindfulness. 2015;6(6):1356–65.

    Article  Google Scholar 

  61. Johnston Luke, Titov Nickolai, Andrews Gavin, et al. A RCT of a Transdiagnostic Internet-Delivered Treatment for Three Anxiety Disorders: Examination of Support Roles and Disorder-Specific Outcomes. PLOS One. 2011;6(11):e28079.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  62. Knaevelsrud C, Brand J, Lange A, et al. Web-based psychotherapy for posttraumatic stress disorder in war-traumatized Arab patients: randomized controlled trial. J Med Internet Res. 2015;17(3): e71.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Kok Robin N, van Annemieke S, Beekman Aartjan TF, et al. Short-term effectiveness of web-based guided self-help for phobic outpatients: randomized controlled trial. J Med Internet Res. 2014;16(9):e226.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Kraaij Vivian, van Arnold E, Garnefski Nadia, et al. Effects of a cognitive behavioral self-help program and a computerized structured writing intervention on depressed mood for HIV-infected people: A pilot randomized controlled trial. Patient Educ Counsel 2010;80(2):200-4. 2010;80(2):200–4.

    Article  Google Scholar 

  65. Kuhn Eric, Kanuri Nitya, Hoffman Julia E, et al. A randomized controlled trial of a smartphone app for posttraumatic stress disorder symptoms. J Consult Clin Psychol. 2017;85(3):267–73.

    Article  PubMed  Google Scholar 

  66. Lewis CE, Farewell D, Groves V, et al. Internet-based guided self-help for posttraumatic stress disorder (PTSD): Randomized controlled trial. Depress Anxiety. 2017;34(6):555–65.

    Article  PubMed  Google Scholar 

  67. Littleton H, Grills AE, Kline KD, et al. The From Survivor to Thriver program: RCT of an online therapist-facilitated program for rape-related PTSD. J Anxiety Disord. 2016;43:41–51.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Ljótsson B, Hedman E, Andersson E, et al. Internet-delivered exposure-based treatment vs. stress management for irritable bowel syndrome: a randomized trial. Am J Gastroenterol. 2011;106(8):1481–91.

    Article  PubMed  Google Scholar 

  69. Ljótsson Brjánn, Falk Lisa, Vesterlund Amanda W, et al. Internet-delivered exposure and mindfulness based therapy for irritable bowel syndrome – a randomized controlled trial. Behav Res Ther. 2010;48(6):531–9.

    Article  PubMed  Google Scholar 

  70. Lundgren Johan G, Dahlström Örjan, Andersson Gerhard, et al. The Effect of Guided Web-Based Cognitive Behavioral Therapy on Patients With Depressive Symptoms and Heart Failure: a Pilot Randomized Controlled Trial. J Med Internet Res. 2016;18(8):e194.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Mailey Emily L, Wójcicki Thomas R, Motl Robert W, et al. Internet-delivered physical activity intervention for college students with mental health disorders: A randomized pilot trial. Psychology Health Med. 2010;15(6):646–59.

    Article  Google Scholar 

  72. Migliorini C, Sinclair A, Brown D, et al. A randomised control trial of an Internet-based cognitive behaviour treatment for mood disorder in adults with chronic spinal cord injury. Spinal Cord. 2016;54(9):695–701.

    Article  CAS  PubMed  Google Scholar 

  73. Newby JM, Mackenzie A, Williams AD, et al. Internet cognitive behavioural therapy for mixed anxiety and depression: a randomized controlled trial and evidence of effectiveness in primary care. Psychol Med. 2013;43(12):2635–48.

    Article  CAS  PubMed  Google Scholar 

  74. Newby Jill M, Williams Alishia D, Gavin Andrews. Reductions in negative repetitive thinking and metacognitive beliefs during transdiagnostic internet cognitive behavioural therapy (iCBT) for mixed anxiety and depression. Behav Res Ther. 2014;59:52–60.

    Article  PubMed  Google Scholar 

  75. Newby Jill, Robins Lisa, Wilhelm Kay, et al. Web-based cognitive behavior therapy for depression in people with diabetes mellitus: a randomized controlled trial. J Med Internet Res. 2017;19(5):e157.

    Article  PubMed  PubMed Central  Google Scholar 

  76. Nordgren, Lise B, Hedman Erik, Etienne Julie, et al. Effectiveness and cost-effectiveness of individually tailored Internet-delivered cognitive behavior therapy for anxiety disorders in a primary care population: a randomized controlled trial. Behav Res Ther. 2014;59:1–11.

    Article  PubMed  Google Scholar 

  77. Paxling B, Almlov J, Dahlin M, et al. Guided internet-delivered cognitive behavior therapy for generalized anxiety disorder: a randomized controlled trial. Cogn Behav Ther. 2011;40(3):159–73.

    Article  PubMed  Google Scholar 

  78. Peters Madelon L, Smeets Elke, Feijge Marion, et al. Happy Despite Pain: A Randomized Controlled Trial of an 8-Week Internet-delivered Positive Psychology Intervention for Enhancing Well-being in Patients With Chronic Pain. Clin J Pain. 2017;33(11):962–75.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Possemato Kyle, Kuhn Eric, Johnson Emily, et al. Using PTSD Coach in primary care with and without clinician support: a pilot randomized controlled trial. Gen Hosp Psychiatry. 2016;38:94–8.

    Article  PubMed  Google Scholar 

  80. Robinson Emma, Titov Nickolai, Andrews Gavin, et al. Internet treatment for generalized anxiety disorder: a randomized controlled trial comparing clinician vs. technician assistance. PLOS One. 2010;5(6):e10942.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Rosmarin David H, Pargament Kenneth I, Pirutinsky Steven, et al. A randomized controlled evaluation of a spiritually integrated treatment for subclinical anxiety in the Jewish community, delivered via the Internet. JAnxiety Disord. 2010;24(7):799–808.

    Article  Google Scholar 

  82. Roy B, Craske Peter, Michelle G, Sullivan Greer, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA. 2010;303(19):1921–8.

    Article  Google Scholar 

  83. Ruehlman LS, Karoly P, Enders C. A randomized controlled evaluation of an online chronic pain self management program. Pain. 2012;153(2):319–30.

    Article  PubMed  Google Scholar 

  84. Ruwaard, Jeroen, Broeksteeg Janneke, Schrieken Bart, et al. Web-based therapist-assisted cognitive behavioral treatment of panic symptoms: a randomized controlled trial with a three-year follow-up. J Anxiety Disord. 2010;24(4):387–96.

    Article  PubMed  Google Scholar 

  85. Sanchez OVC, Munro C, Stahl D, et al. A randomized controlled trial of internet-based cognitive-behavioural therapy for bulimia nervosa or related disorders in a student population. Psychol Med. 2011;41(2):407–17.

    Article  Google Scholar 

  86. Seekles Wike, van Annemieke S, Beekman Aartjan, et al. Effectiveness of guided self-help for depression and anxiety disorders in primary care: a pragmatic randomized controlled trial.  Psychiatry Res. 2011;187(1):113–20.

    Article  PubMed  Google Scholar 

  87. Sexton Minden B, Byrd Michelle R, O’Donohue William T, et al. Web-based treatment for infertility-related psychological distress. Arch Women’s Mental Health. 2010;13(4):347–58.

    Article  Google Scholar 

  88. Shigaki Cheryl L, Smarr Karen L, Siva Chokkalingam, et al. RAHelp: An Online Intervention for Individuals With Rheumatoid Arthritis. Arthritis Care Res. 2013;65(10):1573–81.

    Google Scholar 

  89. Silfvernagel Kristin, Carlbring Per, Kabo Julia, et al. Individually tailored internet-based treatment for young adults and adults with panic attacks: randomized controlled trial. J Med Internet Res 2012;14(3): 2012;14(3):e65.

    Google Scholar 

  90. Spence J, Titov N, Johnston L, et al. Internet-based trauma-focused cognitive behavioural therapy for PTSD with and without exposure components: a randomised controlled trial. J Affect Disord. 2014;162:73–80.

    Article  PubMed  Google Scholar 

  91. Spence Jay, Titov Nickolai, Dear Blake F, et al. Randomized controlled trial of Internet-delivered cognitive behavioral therapy for posttraumatic stress disorder. Depress Anxiety. 2011;28(7):541–50.

    Article  PubMed  Google Scholar 

  92. Titov, N, Andrews G, Davies M, et al. Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One. 2010;5(6):e10939.

    Article  PubMed  Google Scholar 

  93. Titov Nickolai, Andrews Gavin, Johnston Luke. Transdiagnostic Internet treatment for anxiety disorders: a randomized controlled trial. Behav Res Ther. 2010;48(9):890–9.

    Article  PubMed  Google Scholar 

  94. Trompetter HR, Bohlmeijer ET, Veehof MM, et al. Internet-based guided self-help intervention for chronic pain based on Acceptance and Commitment Therapy: a randomized controlled trial. J Behav Med. 2015;38(1):66–80.

    Article  PubMed  Google Scholar 

  95. Trudeau Kimberlee J, Pujol Lynette A, DasMahapatra Pronabesh. A randomized controlled trial of an online self-management program for adults with arthritis pain. J Behav Med. 2015;38(3):483–96.

    Article  PubMed  PubMed Central  Google Scholar 

  96. van Wouter B, Riper Heleen, Klein Britt, et al. An Internet-Based Guided Self-Help Intervention for Panic Symptoms: Randomized Controlled Trial. J Med Internet Res. 2013;15(7):e154.

    Article  Google Scholar 

  97. Varley Rachel, Webb Thomas L, Sheeran Paschal. Making self-help more helpful: A randomized controlled trial of the impact of augmenting self-help materials with implementation intentions on promoting the effective self-management of anxiety symptoms. J Consult Clin Psychol. 2011;79(1):123–8.

    Article  PubMed  Google Scholar 

  98. Vernmark K, Lenndin J, Bjarehed J, et al. Internet administered guided self-help versus individualized e-mail therapy: a randomized trial of two versions of CBT for major depression. Behav Res Ther. 2010;48(5):368–76.

    Article  PubMed  Google Scholar 

  99. Weise C, Kleinstäuber M, Andersson G. Internet-delivered cognitive-behavior therapy for tinnitus: a randomized controlled trial. Psychosomatic Med. 2016;78(4):501–10.

    Article  Google Scholar 

  100. Willems Roy A, Mesters Ilse, Lechner, et al. Long-term effectiveness and moderators of a web-based tailored intervention for cancer survivors on social and emotional functioning, depression, and fatigue: randomized controlled trial. J Cancer Survivor. 2017;11(6):691–703.

    Article  Google Scholar 

  101. Williams DA, Kuper D, Segar M, et al. Internet-enhanced management of fibromyalgia: a randomized controlled trial. Pain. 2010;151(3):694–702.

    Article  PubMed  PubMed Central  Google Scholar 

  102. Wilson M, Roll JM, Corbett C, et al. Empowering Patients with Persistent Pain Using an Internet-based Self-Management Program. Pain Manag Nurs. 2015;16(4):503–14.

    Article  PubMed  Google Scholar 

  103. Wilson Marian, Hewes Casey, Barbosa L Celestina, et al. Engaging adults with chronic disease in online depressive symptom self-management. Western J Nurs Res. 2017;40(6):834–53.

    Article  Google Scholar 

  104. Wims Edward, Titov Nickolai, Andrews Gavin, et al. Clinician-assisted internet-based treatment is effective for panic: a randomized controlled trial. Australian  N Z J Psychiatry. 2010;44(7):599–607.

    Article  Google Scholar 

  105. Wootton Bethany M, Dear Blake F, Johnston Luke, et al. Remote treatment of obsessive-compulsive disorder: a randomized controlled trial. J Obsessive-Compulsive Relat Disord. 2013;2(4):375–84.

    Article  Google Scholar 

  106. Yun YH, Lee KS, Kim YW, et al. Web-based tailored education program for disease-free cancer survivors with cancer-related fatigue: a randomized controlled trial. J Clin Oncol. 2012;30(12):1296–303.

    Article  PubMed  Google Scholar 

  107. Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clin Psychol. 2017;24(1):27–45.

    Google Scholar 

  108. Wright JH, Owen JJ, Richards D, Eells TD, Richardson T, Brown GK, et al. Computer-assisted cognitive-behavior therapy for depression: a systematic review and meta-analysis. J Clin Psychiatry. 2019;80(2):0.

    Article  Google Scholar 

  109. Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1): e11.

    Article  PubMed  PubMed Central  Google Scholar 

  110. Karapanos E. Sustaining user engagement with behavior-change tools. Interactions. 2015;22(4):48–52.

    Article  Google Scholar 

  111. Doherty G, Coyle D, Sharry J, editors. Engagement with online mental health interventions: an exploratory clinical study of a treatment for depression. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; 2012.

  112. Rennick-Egglestone S, Knowles S, Toms G, Bee P, Lovell K, Bower P, editors. Health technologies' in the wild' experiences of engagement with computerised CBT. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems; 2016.

  113. Bradford S, Rickwood D. Young people’s views on electronic mental health assessment: prefer to type than talk? J Child Fam Stud. 2015;24(5):1213–21.

    Article  PubMed  Google Scholar 

  114. Ralston AL, Andrews AR III, Hope DA. Fulfilling the promise of mental health technology to reduce public health disparities: review and research agenda. Clin Psychol. 2019;26(1): e12277.

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the knowledge users for their support throughout this review and the SPOR Evidence Alliance for their support.

Funding

This review was funded by the Canadian Institute for Health Research in the Operating Grant: Knowledge Synthesis: COVID-19 in Mental Health & Substance Use. Grant number: 202005CMS-442711-CMV-CFBA-111141

Author information

Authors and Affiliations

Authors

Contributions

Maxime Sasseville, Annie LeBlanc, Marie-Pierre Gagnon, Maud-Christine Chouinard, Marianne Beaulieu, Nicolas Beaudet, Pascale Cholette Christine Aspiros, Alain Larouche, Guylaine Chabot identified the need for this study and contributed to its conception and design. Maxime Sasseville, Marie-Pierre Gagnon, Mylène Boucher, Michèle Dugas, Mbemba Gisèle, Jack Tchuente, and Romina Barony conducted the data collection. Jack Tchuente and Maxime Sasseville performed the data analysis. Maxime Sasseville developed the first draft of the report. All authors contributed to writing and editing and gave the final approval of the version submitted.

Corresponding author

Correspondence to Maxime Sasseville.

Ethics declarations

Ethics approval and consent to participate

Not applicable

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Nine research questions identified by the knowledge user group (translated from French).

Additional file 2.

Classification framework of digital mental health interventions, reproduced from Gagnon et al. 2022.

Additional file 3:

Additional Table 3. Classification of the System: 1. Internet or Website 2. Computer (software) 3. Mobile app 4. Electronic messaging (email, SMS) 5. Electronic health record 6. Telehealth (telemedicine, telepsychiatry) 7. Virtual reality/ augmented reality 8. Robot 9. Connected devices 10. Social media 11. Other system;Function: A.Decision support a)Screening b)Prompts and alerts B. Communication a. Transmission of information (one way) b. Communication (with healthcare provider) c. Communication (peer to peer, e.g., virtual peer group for clients) C. Therapy a. Cognitive Behavioural Therapy (CBT) b. Other psychotherapy c. Gamification D. Monitoring a. Provider monitoring b. Self-monitoring; Time: = Synchronous + Asynchronous. Facilitation: G. Entirely supported by healthcare providers PG.Partially supported by healthcare providers S. Self-administered.

Additional file 4.

Forest plot: Subgroup analysis of self-directed interventions for any digital intervention vs. usual care or another digital intervention to manage anxiety in people with any concomitant chronic condition.

Additional file 5.

Forest plot: Subgroup analysis on level of professional support for any digital intervention vs. usual care or another digital intervention to manage depression in people with any concomitant chronic condition.

Additional file 6.

Forest plot: Subgroup analysis on type of technology for any digital intervention vs. usual care or another digital intervention to manage anxiety in people with any concomitant chronic condition.

Additional file 7.

Forest plot: Subgroup analysis on type of technology for any digital intervention vs. usual care or another digital intervention to manage depression in people with any concomitant chronic condition.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sasseville, M., LeBlanc, A., Tchuente, J. et al. The impact of technology systems and level of support in digital mental health interventions: a secondary meta-analysis. Syst Rev 12, 78 (2023). https://doi.org/10.1186/s13643-023-02241-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-023-02241-1

Keywords