Skip to main content

Intervention components, mediators, and mechanisms of change of Internet- and mobile-based interventions for post-traumatic stress disorder: protocol for a systematic review and meta-analysis

Abstract

Background

While Internet- and mobile-based interventions (IMIs) might possess the potential to increase access to evidence-based therapies for post-traumatic stress disorder (PTSD), comprehensive knowledge on active intervention components and change mechanisms underlying their efficacy is largely pending so far. The proposed systematic review and meta-analysis will systematically review the current status of research on the efficacy of IMIs for adult PTSD compared to active control conditions and identify active intervention components and mediators responsible for therapeutic change.

Methods

A systematic literature search (PsycINFO, Medline/PubMed, Embase, CENTRAL, ICTRP, and Web of Science) will be conducted using keywords targeting “PTSD” and “Internet- and mobile-based interventions”. Two independent researchers will retrieve studies eligible for inclusion and extract and evaluate data (design, population, outcomes, sample size, duration of intervention and follow-up, drop-out rate). Risk of bias will be assessed, and results will be synthesized qualitatively and evaluated meta-analytically when possible.

Discussion

The results of this systematic review and meta-analysis might further contribute to the development of IMIs for PTSD by highlighting intervention components and mediators associated with their efficacy. Knowledge about the active ingredients might ultimately lead to more effective interventions and treatment packages, with implications for clinical practice and dissemination of these rather novel interventions.

Systematic review registration

PROSPERO (CRD42019130314).

Peer Review reports

Background

Post-traumatic stress disorder (PTSD) is a burdensome [1] and highly prevalent disorder with an estimated 6.8% lifetime prevalence rate of PTSD for the adult US population [2]. PTSD also ranks under the 15 mental and neurological conditions that are most threatening for disability-adjusted life years in Europe [3], but prevalence rates and exposure to potential traumatic events may vary between countries [4]. In DSM-5, PTSD is classified as among the group of trauma- and stressor-related disorders following exposure to a traumatic or stressful event with the diagnostic criteria including at least one stressor (e.g., exposure to threatened death, sexual violence), intrusion symptoms, avoidance, negative alterations in cognitions and mood, alterations in arousal and reactivity, a duration of at least 1 month, functional significance, and exclusion of other explanatory factors (e.g., substance use [5]). The current draft of the ICD-11 diagnostic criteria suggests a symptom cluster of re-experiencing, avoidance, and enduring perceptions of heightened current threat; furthermore, the upcoming ICD-11 will also allow the diagnosis of complex PTSD which is additionally characterized by problems in affect regulation, beliefs about oneself as diminished, defeated, or worthless, accompanied by feelings of shame, guilt, or failure related to the traumatic event and difficulties in sustaining relationships and in feeling close to others [6].

Psychological interventions to treat PTSD are numerous with exposure-based therapy, cognitive processing therapy (CPT), cognitive therapy (CT), therapies based on cognitive behavioral therapy (CBT) principles, eye movement desensitization and reprocessing (EMDR), and narrative exposure therapy showing at least moderate effects ranging from standardized mean differences (SMD) of − 2.0 to − 0.3 [7]. Patient preferences demonstrate a threefold higher preference for psychological treatments compared to medication [8]. Still, although there is a well-established evidence-base for effective psychotherapeutic face-to-face treatments for this condition [7, 9], only a fractional number of patients receive treatment [10,11,12]. For example, in a survey interviewing US veterans with self-reported mental disorders (i.e., PTSD, generalized anxiety, major depression) after duty in Iraq and Afghanistan, only 23 to 40% stated that they received any professional help [10]. Another study examining asylum seekers in the Netherlands reports that 54% of the participants originating from Asian and African countries diagnosed with PTSD did not receive any treatment [13]. Reasons for the limited uptake of evidence-based treatments may be associated with fear of stigmatization or logistic barriers to treatment [10, 12]. Additionally, among those who actually do seek treatment, many do not receive evidence-based treatments or an adequate treatment dose [10].

Compared to traditional face-to-face intervention settings, using the Internet as a medium for the delivery of psychological interventions offers several advantages that might help to overcome treatment barriers [14]. Several meta-analyses showed their efficacy both for other mental disorders (e.g., depression or anxiety [15,16,17,18,19]) and PTSD in particular [20,21,22]. In addition, Internet- and mobile-based interventions (IMIs) are easy to access and offer users the opportunity to flexibly integrate the treatment into daily life, regardless of any limits in terms of space and time [23]. Moreover, users can set their own pace going through each session (potentially with automated feedback on their personal progress) as frequently or as quickly as they like [24]. Looking at PTSD in particular, online interventions can offer a unique and geographically independent treatment opportunity in underserved post-conflict areas [25]. It is also proposed that the anonymity in conduct of an online intervention for PTSD is one of its main advantages, particularly in some cultures (e.g., Arab cultures [25]). Correspondingly, one study has shown that anonymity, privacy, and confidentiality are the most frequently listed reasons for the use of the Internet for mental health support by survey respondents [26]. Additionally, studies also found IMIs on some mental health conditions such as depression to be scalable and cost-effective [14, 27, 28], a valid argument considering limited resources in many health care systems worldwide. Nevertheless, risks concerning IMIs (e.g., lacking adherence, non-detected negative outcomes, negative attitudes of both patients and clinicians towards these interventions, crisis management in case of anonymous users) should be carefully considered and comprehensively investigated [14].

However, given their presumed potential to overcome treatment gaps and advance mental health services on a large scale, a closer inspection of the evolving field of IMIs for PTSD is worthwhile. Gaining insight on the efficacy as well as on active intervention components (i.e., intervention components that are responsible for the efficacy and can therefore deemed active, e.g., human support, exposure, prompts, cognitive processing/restructuring) and mechanisms of change (i.e., processes or events responsible for the change of the outcome [29]) in IMIs may allow to further optimize outcomes and prevent possible adverse events [30,31,32,33].

To test their efficacy, IMIs can be compared with active or inactive controls. Considering the confounding situation in the latter designs with specific ingredients (i.e., variables (e.g., therapeutic techniques) unique to a certain form of psychotherapy [34]) becoming mixed up with common factors (i.e., active ingredients contributing to the outcome while being common to all forms of psychotherapy [34, 35]), this systematic review and meta-analysis focusses on active controls. For example, in the context of IMIs for PTSD, one study [36] compares a self-guided web-based CBT intervention for cancer patients with web-based information-only with results favoring the intervention. Moreover, these active controls can be classified as either bonafide (i.e., treatments that were intended to be therapeutic [37]) or non-bonafide. Hereby, it is particularly proposed to compare IMIs with common factor controls as active controls (i.e., structural equivalent packages that do not contain the specific components of the IMI hypothesized as the active verum of the intervention [38]).

In contrast, so-called component studies that compare one treatment with a treatment in which one specific component is left out (i.e., dismantling studies) or added (i.e., additive studies) offer the possibility to examine active intervention components and assess their incremental (add on) effect sizes [39]. For instance, there is a study [40] comparing a self-guided web-based intervention for war veterans with (subthreshold) PTSD and hazardous alcohol use with peer support with the same intervention without peer support, whereas no between-group differences are reported. Nevertheless, to date, there is ample evidence for guidance as a beneficial feature of Internet-based interventions [16, 31] with pending evidence for incremental effects of other single components [16].

Lastly, mechanisms of change (i.e., the actual processes responsible for therapeutic change) can be indicated by mediators (e.g., functional cognitions, emotional regulation, or problem-solving skills), and thus, the study of mediators is an important first step to understand mechanism of change [29]. Hence, a quantitative assessment of changes within a well-established mediation analysis is necessary in this context. For example, one study [41] assessed the mediating role of self-efficacy beliefs on PTSD symptom reduction in an Internet-based self-efficacy intervention and reports that health and human services professionals experiencing increased levels of self-efficacy are more likely to show lower secondary traumatic stress at follow-up. Another study on the mechanisms of change in CPT and prolonged exposure therapy for PTSD assessed habituation and hopelessness [42] while a study on mechanisms of change in IMIs irrespective of disorders concluded that cognitive factors are an important mechanism of change while assuming causal effects without mediation analyses [33]. This leaves room for an explorative assessment of intervention components and mediators and mechanisms of change specific for PTSD. In line with previous publications [29, 43, 44], we hereby conceptualize mediators as intervening variables that may statistically account for the relationship between the independent variable and the outcome. In contrast, moderators are variables or characteristics that influence the magnitude (or direction) of the relationship between an intervention and outcome [29], thereby indicating on whom and under which conditions treatments have differential effects [44]. As such, moderators suggest that different processes are involved (i.e., “moderated mediation”), but conceptually represent no mechanisms of therapeutic change themselves [29, 44].

Additionally, adherence is an important aspect aside symptom severity, considering both the high drop-out rates in IMIs for PTSD in various trials (e.g., 51.2% post-intervention [41]) and the hypothesized dose-response relationship for the use of IMIs (e.g., [45, 46]), which suggests an underestimation of effects in case of low adherence. Thus, reviewing adherence data in this field is highly valuable in order to gather knowledge on intervention components contributing to increased adherence rates and thereby inform intervention development.

To our knowledge, two meta-analyses in this field solely investigated telehealth interventions [47, 48], whereas three recent meta-analyses [20,21,22] investigated Internet-based interventions for posttraumatic stress and found evidence for their efficacy. In particular, one meta-analysis [20] found effects ranging from SMD = − .66 to − .83 while including 13 studies with passive and 7 with active comparison conditions and an overall sufficient quality of included studies reported by the authors. Another meta-analysis [21] compared Internet-based CBT (iCBT) to both waitlist/TAU controls (SMD = − .71; 10 studies) and other interventions (SMD = − .28; 3 studies), with authors reporting a varying methodological quality of included studies. A third meta-analysis [22] with 33 included studies reported a pooled SMD of − .35 favoring Internet-based interventions independent of the comparison condition while including 18 active and 20 waitlist/TAU comparisons and reporting a slightly increased effect size when studies with reported high risk of bias were excluded (8 comparisons). However, none of these meta-analyses distinguished between bonafide and non-bonafide active controls, and to the best of our knowledge, there has been no systematic review or meta-analysis on IMIs for PTSD examining intervention components in additive or dismantling studies. The existing meta-analyses only provide indirect evidence on a possible larger effect of IMIs with therapeutic support compared to those without therapeutic support [21] and no evidence for responsible intervention components [20, 22] while including (predominantly) passive comparison conditions. The same holds true for mediators or mechanisms of change that have not been meta-analytically summarized so far. Moreover, even though the results indicate that Internet-based treatments are effective, interventions designed as smartphone applications were excluded in former reviews [20, 21].

Thus, this review and meta-analysis will provide a broader and updated overview of this field of research, focusing on intervention components and mediators. The proposed systematic review and meta-analysis aims to systematically review, critically evaluate, and statistically integrate the existing literature on IMIs for PTSD in order to answer the following research questions:

  1. (1)

    Are IMIs for PTSD efficacious regarding symptom reduction?

    1. a)

      Are IMIs for PTSD equally efficacious when compared to bonafide control conditions/interventions?

    2. b)

      Are IMIs for PTSD more efficacious than attention/psychological placebos, or other non-bonafide active (online) control conditions?

  2. (2)

    Which intervention components are responsible for the efficacy of IMIs for PTSD?

  3. (3)

    What potential mediators and mechanisms of change in IMIs for PTSD are examined so far?

Methods

This review and meta-analysis is registered with the International Prospective Register of Systematic Reviews (PROSPERO, CRD42019130314) and will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [41]. The PRISMA-P checklist can be found in Additional file 1.

Search strategy

A systematic literature search in the electronic databases PsycINFO, Medline/PubMed, Embase, and CENTRAL (Cochrane Central Register of Controlled Trials) with no restriction on dates of coverage and language will identify relevant studies. The sensitive search strategy employs a combination of search terms including the target diagnosis PTSD and the type of treatment delivery (i.e., Internet- or mobile-based). The predefined set of search strings can be found in Appendix 1.

A review of reference lists from identified studies (i.e., backward searches), a search of the WHO International Clinical Trials Registry Platform (ICTRP; Appendix 2) for ongoing studies with preliminary/unpublished results, and a citation search using Web of Science will complement the search. If necessary, study authors will be contacted to obtain further information regarding study characteristics. In case study protocols are identified without subsequent publication of results, protocol authors will be contacted to obtain missing or unpublished data and determine eligibility for inclusion in this review and meta-analysis.

Eligibility criteria

Population

Studies are eligible for inclusion if they focus on an adult target population (≥ 18 years; no upper limit) with PTSD or subthreshold PTSD assessed by standardized diagnostic interviews, observer-rated instruments with normed cutoff points, or validated self-reports (see Types of Outcomes). Studies of participants with different mental disorders (e.g., generalized anxiety disorder) will be included only if PTSD symptom severity is defined as primary outcome or main diagnosis of interest and results are reported specific to the respective disorders.

Intervention

Studies will be included if at least one trial arm constitutes of an Internet- and mobile-based intervention (IMI) targeting PTSD symptoms. IMIs are defined as self-guided/unguided or guided interventions delivered via Internet- and mobile-based communication technology with a psychological/psychotherapeutic focus (e.g., trauma-focused CBT, CPT-based interventions [49, 50]). Interventions may vary concerning to the amount of guidance provided to participants (i.e., pure self-help interventions as well as guided interventions with different amounts and types of human support will be included). The following variations of IMIs are all eligible for inclusion: (a) guided interventions (i.e., with regular therapist contact), (b) mostly unguided interventions (i.e., predominantly self-help, e.g., with additional technical guidance on demand), and (c) completely unguided interventions (i.e., self-help, with no therapeutic support but assessment at most [51]). Therefore, studies are eligible for inclusion if IMIs involved an initial face-to-face interview or an initial face-to-face session.

Comparison

Eligible comparisons differ by each research question. First, to investigate the efficacy of IMIs for PTSD, studies must include an active control group. Second, to investigate intervention components, studies must classify as additive or dismantling design study (see the “Study type” section). Third, to investigate mediators and mechanisms of change, studies are eligible for inclusion if they compare an IMI group with an active (e.g., IMI, face-to-face, treatment as usual, or placebo) or non-active control group (e.g., wait-list or no intervention).

To be classified as bonafide [37] in this systematic review and meta-analysis, the treatment for the control groups has to aim to reduce symptom severity (non-inferiority trials). If the authors postulate a superiority of the IMI group, we are classifying the control group as non-bonafide. In case authors do not specify their hypotheses clearly, we will decide the allocation depending on the existence of empirical evidence for the efficacy of the control treatment.

Outcome

Primary outcome

Change in PTSD symptom severity has to be measured by scores on a standardized, observer-rated instrument, for example, the Clinician-Administered PTSD Scale for DSM-IV (CAPS [52]), or a validated self-report measure of PTSD symptoms, for example, the Posttraumatic Stress Disorder Checklist - DSM-5 Version (PCL-5 [53]) or precursor version. Negative values characterize effect sizes favoring the intervention group.

Secondary outcomes

To depict the influence of the participants’ engagement with the online intervention, adherence will be operationalized as (a) the mean number of main intervention units completed (e.g., lectures, diaries) and (b) the percentage of participants that completed the whole treatment [54, 55].

Possible mediators

Possible mediators (e.g., functional cognitions, mindfulness, or problem-solving skills) are to be measured by validated psychometric instruments (e.g., Posttraumatic Cognitions Inventory [56]). Hereby, mediators are defined as intervening variables that statistically account for the relationship between an independent (i.e., the treatment) and a dependent variable (i.e., the outcome [29]).

Timing of outcome assessment

To be able to meaningfully comment on any post-intervention symptom reduction, separate analyses based on different periods of assessment will be performed (e.g., immediately post-treatment and after the follow-up period). The resulting follow-up periods will be clustered in three time frames: short-term (1–3 months after post-treatment), medium-term (> 3 to ≤ 12 months after post-treatment), and long-term (> 12 months after post-treatment) effects. If studies report more than one follow-up assessment point, the longest follow-up period will be used to provide the best estimate of the crucial long-term outcomes of the PTSD intervention.

Study type

In order to investigate the efficacy of IMIs for PTSD and active intervention components, only randomized controlled trials (RCTs [57]) with active control groups or comparing IMIs to dismantled variations of the same intervention will be included. The latter allows to investigate specific effects of single components of IMIs by adding or subtracting specific elements [58]. To study potential mediator variables, both original RCTs and secondary analyses on previous RCTs will be eligible. They have to include repeated measures and use well-established mediation analyses (e.g., [59]) or include a quantitative assessment of changes in investigated psychological mediators. Studies have to be written in English and either be published in peer-reviewed journals or classified as ongoing trials in ICTRP with already existing results.

Study selection process

Two independent reviewers (LS, AS) will conduct the selection of articles. First, one reviewer (LS) will screen all titles and abstracts of articles yielded by the database search. Second, full texts of the selected articles will be retrieved and screened by both reviewers (LS, AS) in terms of the aforementioned eligibility criteria. Third, reference lists of finally included articles will be screened in the same way. Disagreement will be resolved by discussion among reviewers or, if necessary, by consultation of a third reviewer (MD). To illustrate the study selection process and reasons for exclusion, a PRISMA-P flow chart [60] will be provided. Records will be managed using the literature management program CITAVI 6.

Data extraction

The following data items will be extracted by two independent reviewers (LS, AS) for each study: (a) study identification items (year of publication, first author, country), (b) study and intervention characteristics (inclusion and exclusion criteria, screening instruments, therapeutic background, sample size, intervention design/type, level of human support/guidance, control group, duration of intervention/number of sessions, follow-up assessments, recruitment strategy, communication mode, prompts, standardization), (c) target population items (gender, age, specific population groups if applicable, comorbidities, trauma type, type of PTSD), (d) setting (nationality, environment, recruitment strategy), (e) drop-out rate, (f) human support characteristics (e.g., qualification of e-coaches if any), (g) platform characteristics, (h) frequency of adverse events if assessed and reported in primary studies, and (i) dimensional clinical outcomes.

In case of overlapping studies or multiple studies on the same data set, all information will be extracted with a note, highlighting the shared data set. Should there be any data missing or the reported data unclear, study authors will be contacted and asked for further clarification.

In case of multiple outcome measures for the assessment of PTSD symptom severity, the primary outcome measure of the study will be selected. If outcomes are assessed by several instruments, data will be extracted as follows: (a) the primary outcome measure of the study will be prioritized; (b) in case of multiple outcome measures of the same hierarchical level, the most used outcome measure will be chosen for the meta-analysis; and (c) should the aforementioned steps be not be possible, we will randomly select one outcome measure.

Quality assessment

Two independent reviewers (LS, AS) will assess the risk of bias using the Cochrane Collaboration’s tool for assessing risk of bias in RCTs [61] in order to evaluate the quality of included studies. As recommended, each study will be rated in the following domains: (a) random sequence generation, (b) allocation concealment, (c) blinding of participants and personnel, (d) blinding of outcome assessment, (e) incomplete outcome data, and (f) other bias (e.g., study has been claimed to be deceitful, baseline differences between intervention and control group). Studies will be rated as showing an “unclear”, “low”, or “high” risk of bias on each domain. Inter-rater reliability will be calculated by means of Cohen’s kappa, whereby a value between .60 and .80 can be considered as substantial and a value > .80 as perfect [62]. It is important to note that the third domain on blinding of participants and personnel is not warranted in (guided) IMIs, which would result in a high risk of bias rating. To prevent a distorted rating, we will rate this domain as “unclear” if this is the case.

To examine possible publication bias, the trim and fill procedure [63, 64], Egger’s test of funnel plot asymmetry [61], and visual inspection of funnel plots will be utilized.

Additionally, mediation studies will be qualitatively rated with the following criteria, originally proposed by Kazdin [29]: (a) underlying theory or conceptual model, (b) RCT and inclusion of a control group, (c) sufficient sample size per condition (defined as n ≥ 40), (d) examination of multiple mediators in one study, (e) assessment of temporality (defined as ≥ 3 assessments in treatment phase), and (f) direct experimental manipulation of the mediator.

Data synthesis and presentation

Both text and tables will provide a detailed description of the results for all included studies. Characteristics of selected studies will be listed and qualitatively described. Characteristics include (a) study design and characteristics (sample size, duration, follow-up period) and patient population (age, gender, specific population group), (b) intervention characteristics (name, intervention content (e.g., CBT)), (c) technical implementation (e.g., Internet-only or Internet- and mobile-based), (d) duration, (e) level of human support/guidance, (f) study and intervention drop-out rate, (g) assessment tool used to determine presence of PTSD (clinical interview, questionnaire), (h) recruitment procedure, and (i) any covariates assessed (list of variables).

Data analysis

To assess the efficacy of IMIs compared to active control conditions and the efficacy of their intervention components, data analyses will be performed using the Review Manager 5.3 software developed by the Cochrane Collaboration [65]. Meta-analytic pooling will be conducted when at least three studies report outcome parameters. If applicable, random-effects meta-analyses will be used to compute overall estimates of treatment outcomes. Standardized mean differences (SMD) and their 95% confidence intervals (CI) will be calculated for all continuous outcomes. As Hedges’ g is less biased than Cohen’s d in small samples [66], SMD will be given as values of the former measure. Dichotomous outcomes will be analyzed using risk ratios and corresponding 95% CIs and completer rate using odds ratios and their 95% CIs.

Heterogeneity will be evaluated with the I2 statistic, whereby an I2 value < 40% may not be important, a value between 30 and 60% may represent moderate heterogeneity, between 50 and 90% substantial heterogeneity, and > 75% considerable heterogeneity [57].

A forest plot will be created and used to visually investigate the presence and nature of statistical heterogeneity. In addition, statistical heterogeneity of the effect sizes will be evaluated using the Q statistic [67], with a significant Q indicating heterogeneity across studies that warrants further exploration.

For further comparisons of intervention and study characteristics (concerning, e.g., content, form, therapeutic background, guidance, trauma type, study quality, target population, and active intervention components), subgroup analysis will be performed if feasible. The possible influence of publication bias will be determined by inspection of funnel plots if feasible [57]. Feasibility will be given with at least three trials per subgroup for subgroup analysis and at least ten trials to determine possible influence of publication bias [57].

Sensitivity analyses will be conducted to test the robustness of the results by comparing the pooled SMD of the different times of outcome assessment (see the “Timing of outcome assessment” section): (1) short term, (2) medium term, and (3) long term. Further sensitivity analyses will be conducted to examine the effect of including studies at high risk of bias. Should a quantitative synthesis not be appropriate, results will be summarized qualitatively.

To evaluate and synthesize evidence for possible mediators, a two-stage structural equation modeling (TSSEM) approach employing R will be used if appropriate [68, 69]. This approach combines meta-analytic techniques and structural equation modeling (SEM) and has been considered superior to conventional approaches to synthesize studies that use SEM (e.g., Pearson correlations, generalized least squares [70]). Means, SD, t statistics, F statistics, and effect sizes will be used to calculate bivariate correlations if studies do not report bivariate correlation between treatment, mediator, and outcome [66]. Should a quantitative synthesis not be appropriate, results will be summarized qualitatively by summarizing the (significant) mediators found.

To measure the confidence in the cumulative evidence, the strength of the body of evidence will be assessed using the GRADE approach [71]. This system classifies the quality of evidence in four levels ranging from “very low” and “low” to “moderate” and “high” (influenced by, e.g., study limitations, inconsistency of results) and offers “strong” and “weak” as grades of recommendation (influenced by, e.g., quality of evidence, uncertainty, or variability in values and preferences [71]).

Discussion

This systematic review and meta-analysis will add to previous research by summarizing, synthesizing, and discussing the existing literature on Internet- and mobile-based interventions for PTSD. The findings of this review will go beyond previous meta-analyses and systematic reviews in this field (e.g., [20,21,22]), as results will extend to intervention components and mediators and mechanisms of change, while also covering mobile-based interventions. By identifying and quantifying the active intervention components and mediators and mechanisms of change, it may advance our understanding on how Internet- and mobile-based intervention take effect. This can help to develop more effective interventions and prevent possible adverse events. Moreover, results might assist in the verification and advancement of psychotherapeutic theories and the development of an extensive model on how IMIs for PTSD and psychotherapies in general might work [29, 72].

However, there are several limitations to the proposed systematic review and meta-analysis. One important limitation might be caused by substantial heterogeneity of included studies. The clinical, methodological, and statistical differences might limit the possibility of quantitatively pooling trials as well as the generalizability of findings. Previous meta-analyses on IMIs for PTSD have shown up to considerably high heterogeneity while suggesting differences in employed therapeutic techniques among others to be responsible (e.g., [22]). Moreover, only studies written in English will be included, which may lead to an overestimation of effects as trials with statistically significant results have been shown to be more likely published in English [73]. Furthermore, despite the attempts to include unpublished and non-significant studies, the proposed systematic review and meta-analysis might also be limited by publication bias.

In sum, given the substantial burden of disease associated with PTSD and the opportunities of IMIs for extending and augmenting available service supplies, the proposed review and meta-analysis is urgently needed and will substantially add to the current evidence. The results will inform intervention development by highlighting active intervention components and mediators responsible for therapeutic change, and extend the evidence base on the efficacy of IMIs for PTSD.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CAPS:

Clinician-Administered PTSD Scale

CBT:

Cognitive behavioral therapy

CENTRAL:

Cochrane Central Register of Controlled Trials

CPT:

Cognitive processing therapy

CT:

Cognitive therapy

DSM:

Diagnostic and Statistical Manual of Mental Disorders

EMDR:

Eye movement desensitization and reprocessing

GRADE:

Grading of Recommendations Assessment, Development and Evaluation

iCBT:

Internet-based CBT

ICD:

International Statistical Classification of Diseases and Related Health Problems

ICTRP:

International Clinical Trials Registry Platform

IMIs:

Internet- and mobile-based interventions

PCL-5:

Posttraumatic Stress Disorder Checklist—DSM-5 Version

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

PTSD:

Post-traumatic stress disorder

RCT:

Randomized controlled trial

SMD:

Standardized mean difference

TSSEM:

Two-stage structural equation modeling

References

  1. McMillen C, North C, Mosley M, Smith E. Untangling the psychiatric comorbidity of posttraumatic stress disorder in a sample of flood survivors. Compr Psychiatry. 2002;43(6):478–85.

    Article  PubMed  Google Scholar 

  2. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:593–768.

    Article  PubMed  Google Scholar 

  3. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011;21(9):655–79.

    Article  CAS  PubMed  Google Scholar 

  4. Dückers MLA, Alisic E, Brewin CR. A vulnerability paradox in the cross-national prevalence of post-traumatic stress disorder. Br J Psychiatry. 2016;209(4):300–5.

    Article  PubMed  Google Scholar 

  5. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.

    Book  Google Scholar 

  6. World Health Organization. International statistical classification of diseases and related health problems. 11th revision; 2018.

    Google Scholar 

  7. Cusack K, Jonas DE, Forneris CA, Wines C, Sonis J, Middleton JC, et al. Psychological treatments for adults with posttraumatic stress disorder: a systematic review and meta-analysis. Clin Psychol Rev. 2016;43:128–41.

    Article  PubMed  Google Scholar 

  8. McHugh RK, Whitton SW, Peckham AD, Welge JA, Otto MW. Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry. 2013;74(6):595–602.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Watts BV, Schnurr PP, Mayo L, Young-Xu Y, Weeks WB, Friedman MJ. Meta-analysis of the efficacy of treatments for posttraumatic stress disorder. J Clin Psychiatry. 2013;74(6):e541–50.

    Article  PubMed  Google Scholar 

  10. Hoge CW, Catro CA, Messer SC, McGruk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004;351(1):13–22.

    Article  CAS  PubMed  Google Scholar 

  11. Mueser KT, Rosenberg SD, Rosenberg HJ. Treatment of posttraumatic stress disorder in special populations: A cognitive restructuring program. Washington, DC: American Psychological Association; 2009.

    Chapter  Google Scholar 

  12. Stecker T, Fortney JC, Hamilton F, Ajzen I. An assessment of beliefs about mental health care among veterans who served in Iraq. Psychiatr Serv. 2007;58(10):1358–61.

    Article  PubMed  Google Scholar 

  13. Drozdek B, Noor AK, Lutt M, Foy DW. Chronic PTSD and medical services utilization by asylum seekers. J Refug Stud. 2003;16(2):202–11.

    Article  Google Scholar 

  14. Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014;13:4–11.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. 2018;47(1):1–18.

    Article  PubMed  Google Scholar 

  16. Domhardt M, Geßlein H, von Rezori RE, Baumeister H. Internet- and mobile-based interventions for anxiety disorders: a meta-analytic review of intervention components. Depress Anxiety. 2019;36(3):213–24.

    Article  PubMed  Google Scholar 

  17. Domhardt M, Steubl L, Baumeister H. Internet- and mobile-based interventions for mental and somatic conditions in children and adolescents. Z Kinder Jugendpsychiatr Psychother. 2018:1–14.

  18. Königbauer J, Letsch J, Doebler P, Ebert DD, Baumeister H. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord. 2017;223:28–40.

    Article  Google Scholar 

  19. Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. 2016;3:CD011565.

    PubMed  Google Scholar 

  20. Kuester A, Niemeyer H, Knaevelsrud C. Internet-based interventions for posttraumatic stress: a meta-analysis of randomized controlled trials. Clin Psychol Rev. 2016;43:1–16.

    Article  PubMed  Google Scholar 

  21. Sijbrandij M, Kunovski I, Cuijpers P. Effectiveness of internet-delivered cognitive behavioral therapy for posttraumatic stress disorder: a systematic review and meta-analysis. Depress Anxiety. 2016;33(9):783–91.

    Article  PubMed  Google Scholar 

  22. Simblett S, Birch J, Matcham F, Yaguez L, Morris R. A systematic review and meta-analysis of e-mental health interventions to treat symptoms of posttraumatic stress. JMIR Ment Health. 2017;4(2):e14.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Cuijpers P, van Straten A, Warmerdam L, van Rooy MJ. Recruiting participants for interventions to prevent the onset of depressive disorders: possible ways to increase participation rates. BMC Health Serv Res. 2010;10:181.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Sander L, Rausch L, Baumeister H. Effectiveness of Internet- and mobile-based psychological interventions for the prevention of mental disorders: a systematic review and meta-analysis protocol. Syst Rev. 2016;5:30.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Wagner B, Schulz W, Knaevelsrud C. Efficacy of an Internet-based intervention for posttraumatic stress disorder in Iraq: a pilot study. Psychiatry Res. 2012;195(1–2):85–8.

    Article  PubMed  Google Scholar 

  26. Horgan A, Sweeney J. Young students’ use of the Internet for mental health information and support. J Psychiatr Ment Health Nurs. 2010;17(2):117–23.

    Article  CAS  PubMed  Google Scholar 

  27. Titov N, Dear BF, Ali S, Zou JB, Lorian CN, Johnston L, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of depression: a randomized controlled trial. Behav Ther. 2015;46:193–205.

    Article  PubMed  Google Scholar 

  28. Warmerdam L, van Straten A, Jongsma J, Twisk J, Cuijpers P. Online cognitive behavioral therapy and problem-solving therapy for depressive symptoms: exploring mechanisms of change. J Behav Ther Exp Psychiatry. 2010;41(1):64–70.

    Article  PubMed  Google Scholar 

  29. Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.

    Article  PubMed  Google Scholar 

  30. Andersson G. Internet-delivered psychological treatments. Annu Rev Clin Psychol. 2016;12:157–79.

    Article  PubMed  Google Scholar 

  31. Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — a systematic review. Internet Interv. 2014;1(4):205–15.

    Article  Google Scholar 

  32. Mogoașe C, Cobeanu O, David O, Giosan C, Szentagotai A. Internet-based psychotherapy for adult depression: what about the mechanisms of change? J Clin Psychol. 2017;73(1):5–64.

    Article  PubMed  Google Scholar 

  33. Mureşan V, Montgomery GH, David D. Emotional outcomes and mechanisms of change in online cognitive-behavioral interventions: a quantitative meta-analysis of clinical controlled studies. J Technol Hum Serv. 2012;30(1):1–13.

    Article  Google Scholar 

  34. Lambert MJ, Vermeersch DA. Effectiveness of psychotherapy. In: Encyclopedia of psychotherapy, vol. 1; 2002. p. 709–14.

    Chapter  Google Scholar 

  35. Karlsson P, Bergmark A. Compared with what? An analysis of control-group types in Cochrane and Campbell reviews of psychosocial treatment efficacy with substance use disorders. Addiction. 2015;110(3):420–8.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Beatty L, Koczwara B, Wade T. Evaluating the efficacy of a self-guided web-based CBT intervention for reducing cancer-distress: a randomised controlled trial. Support Care Cancer. 2016;24(3):1043–51.

    Article  PubMed  Google Scholar 

  37. Wampold BE, Mondin GW, Moody M, Stich F, Benson K, Ahn H-N. A meta-analysis of outcome studies comparing bona fide psychotherapies: empiricially, “all must have prizes”. Psychol Bull. 1997;122(3):203–15.

    Article  Google Scholar 

  38. Stevens S, Hynan M, Allen M. A meta-analysis of common factor and specific treatment effects across the outcome domains of the phase model of psychotherapy. Clin Psychol Sci Pract. 2000;7(4):273–90.

    Article  Google Scholar 

  39. Bell EC, Marcus DK, Goodlad JK. Are the parts as good as the whole? A meta-analysis of component treatment studies. J Consult Clin Psychol. 2013;81(4):722–36.

    Article  PubMed  Google Scholar 

  40. Possemato K, Johnson EM, Emery JB, Wade M, Acosta MC, Marsch LA, et al. A pilot study comparing peer supported web-based CBT to self-managed web CBT for primary care veterans with PTSD and hazardous alcohol use. Psychiatr Rehabil J. 2019;42(3):305–13.

    Article  PubMed  Google Scholar 

  41. Cieslak R, Benight CC, Rogala A, Smoktunowicz E, Kowalska M, Zukowska K, et al. Effects of internet-based self-efficacy intervention on secondary traumatic stress and secondary posttraumatic growth among health and human services professionals exposed to indirect trauma. Front Psychol. 2016;7:1009.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Gallagher MW, Resick PA. Mechanisms of change in cognitive processing therapy and prolonged exposure therapy for PTSD: preliminary evidence for the differential effects of hopelessness and habituation. Cognit Ther Res. 2012;36(6):750–5.

    Article  Google Scholar 

  43. Cuijpers P, Reijnders M, Huibers MJH. The role of common factors in psychotherapy outcomes. Annu Rev Clin Psychol. 2019;15:207–31.

    Article  PubMed  Google Scholar 

  44. Kraemer HC, Wilson GT, Fairburn CG, Agras WS. Mediators and moderators of treatment effects in randomized clinical trials. Arch Gen Psychiatry. 2002;59(10):877–83.

    Article  PubMed  Google Scholar 

  45. Graham AL, Cobb NK, Raymond L, Sill S, Young J. Effectiveness of an internet-based worksite smoking cessation intervention at 12 months. J Occup Environ Med. 2007;49(8):821–8.

    Article  PubMed  Google Scholar 

  46. Steele RM, Mummery WK, Dwyer T. Examination of program exposure across intervention delivery modes: face-to-face versus internet. Int J Behav Nutr Phys Act. 2007;4:7.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Bolton AJ, Dorstyn DS. Telepsychology for posttraumatic stress disorder: a systematic review. J Telemed Telecare. 2015;21(5):254–67.

    Article  CAS  PubMed  Google Scholar 

  48. Sloan DM, Gallagher MW, Feinstein BA, Lee DJ, Pruneau GM. Efficacy of telehealth treatments for posttraumatic stress-related symptoms: a meta-analysis. Cogn Behav Ther. 2011;40(2):111–25.

    Article  PubMed  Google Scholar 

  49. Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med. 2009;38(1):4–17.

    Article  PubMed  Google Scholar 

  50. Domhardt M, Ebert DD, Baumeister H. Internet- und mobile-basierte Interventionen. In: Kohlmann C, Salewski C, Wirtz MA, editors. Bern: Psychologie in der Gesundheitsförderung; 2018. p. 397–410.

  51. Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev. 2011;31(1):89–103.

    Article  PubMed  Google Scholar 

  52. Blake DD, Weathers FW, Nagy LM, Kaloupek DG, Gusman FD, Charney DS, et al. The development of a clinician-administered PTSD scale. J Trauma Stress. 1995;8(1):75–90.

    Article  CAS  PubMed  Google Scholar 

  53. Blevins CA, Weathers FW, Davis MT, Witte TK, Domino JL. The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J Trauma Stress. 2015;28(6):489–98.

    Article  PubMed  Google Scholar 

  54. Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. 2011;13(3):e52.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833–42.

    Article  PubMed  Google Scholar 

  56. Foa EB, Ehlers A, Clark DM, Tolin DF, Orsillo SM. The posttraumatic cognitions inventory (PTCI): development and validation. Psychol Assess. 1999;11(3):303–14.

    Article  Google Scholar 

  57. Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions: The Cochrane Collaboration; 2011. Available from: URL: https://handbook.cochrane.org/

  58. Borkovec TD, Castonguay LG. What is the scientific meaning of empirically supported therapy? J Consult Clin Psychol. 1998;66(1):136–42.

    Article  CAS  PubMed  Google Scholar 

  59. Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986;51(6):1173–82.

    Article  CAS  PubMed  Google Scholar 

  60. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  63. Duval S, Tweedie R. A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. J Am Stat Assoc. 2000;95(449):89–98.

    Google Scholar 

  64. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.

    Article  CAS  PubMed  Google Scholar 

  65. Review Manager software, The Nordic Cochrane Center, Copenhagen, Denmark. Available at revman.cochrane.org.

  66. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis. Chichester: Wiley; 2009.

    Book  Google Scholar 

  67. Hedges LV, Olkin I. Statistical methods for meta-analysis. London: Academic; 1985.

    Google Scholar 

  68. Cheung MW-L. metaSEM: an R package for meta-analysis using structural equation modeling. Front Psychol. 2014;5:1521.

    PubMed  Google Scholar 

  69. Cheung MWL, Chan W. A two-stage approach to synthesizing covariance matrices in meta-analytic structural equation modeling. Struct Equ Model Multidiscip J. 2009;16(1):28–53.

    Article  Google Scholar 

  70. Cheung MW-L, Chan W. Meta-analytic structural equation modeling: a two-stage approach. Psychol Methods. 2005;10(1):40–64.

    Article  PubMed  Google Scholar 

  71. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–6.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Lemmens LHJM, Müller VNLS, Arntz A, Huibers MJH. Mechanisms of change in psychotherapy for depression: an empirical update and evaluation of research aimed at identifying psychological mediators. Clin Psychol Rev. 2016;50:95–107.

    Article  PubMed  Google Scholar 

  73. Egger M, Zellweger-Zähner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet. 1997;350(9074):326–9.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Anna-Lena Schröder (AS; University of Ulm) will contribute to the study selection, data extraction, and quality assessment as second independent reviewer.

Funding

MD and LS are working on the project “Mechanisms of change in Internet- and mobile-based interventions for depression: A systematic review and meta-analysis of individual participant data” funded by the German Federal Ministry of Education and Research (grant identification FKZ 01KG1802). The funding agency did not have any role in developing the protocol.

Author information

Authors and Affiliations

Authors

Contributions

LS, CS, HB, and MD were involved in the concept and review design of the study and data analysis plan. All authors had major contributions to the write-up and editing of the manuscript and read and approved the final manuscript.

Corresponding author

Correspondence to Lena Steubl.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

PRISMA-P 2015 Checklist. This checklist has been adapted for use with systematic review protocol submissions to BioMed Central journals from Table 3 in Moher D et al.: Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews 2015 4:1. An Editorial from the Editors-in-Chief of Systematic Reviews details why this checklist was adapted - Moher D, Stewart L & Shekelle P: Implementing PRISMA-P: recommendations for prospective authors. Systematic Reviews 2016 5:15.

Appendices

Appendix 1

Table 1 Search strings for PsycINFO/PSYNDEX, Medline, Embase, and CENTRAL (Ovid)

Appendix 2

Table 2 Search strings for ICRTP

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Steubl, L., Sachser, C., Baumeister, H. et al. Intervention components, mediators, and mechanisms of change of Internet- and mobile-based interventions for post-traumatic stress disorder: protocol for a systematic review and meta-analysis. Syst Rev 8, 265 (2019). https://doi.org/10.1186/s13643-019-1190-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-019-1190-6

Keywords