- Open Access
Intervention components, mediators, and mechanisms of change of Internet- and mobile-based interventions for post-traumatic stress disorder: protocol for a systematic review and meta-analysis
Systematic Reviews volume 8, Article number: 265 (2019)
While Internet- and mobile-based interventions (IMIs) might possess the potential to increase access to evidence-based therapies for post-traumatic stress disorder (PTSD), comprehensive knowledge on active intervention components and change mechanisms underlying their efficacy is largely pending so far. The proposed systematic review and meta-analysis will systematically review the current status of research on the efficacy of IMIs for adult PTSD compared to active control conditions and identify active intervention components and mediators responsible for therapeutic change.
A systematic literature search (PsycINFO, Medline/PubMed, Embase, CENTRAL, ICTRP, and Web of Science) will be conducted using keywords targeting “PTSD” and “Internet- and mobile-based interventions”. Two independent researchers will retrieve studies eligible for inclusion and extract and evaluate data (design, population, outcomes, sample size, duration of intervention and follow-up, drop-out rate). Risk of bias will be assessed, and results will be synthesized qualitatively and evaluated meta-analytically when possible.
The results of this systematic review and meta-analysis might further contribute to the development of IMIs for PTSD by highlighting intervention components and mediators associated with their efficacy. Knowledge about the active ingredients might ultimately lead to more effective interventions and treatment packages, with implications for clinical practice and dissemination of these rather novel interventions.
Systematic review registration
Post-traumatic stress disorder (PTSD) is a burdensome  and highly prevalent disorder with an estimated 6.8% lifetime prevalence rate of PTSD for the adult US population . PTSD also ranks under the 15 mental and neurological conditions that are most threatening for disability-adjusted life years in Europe , but prevalence rates and exposure to potential traumatic events may vary between countries . In DSM-5, PTSD is classified as among the group of trauma- and stressor-related disorders following exposure to a traumatic or stressful event with the diagnostic criteria including at least one stressor (e.g., exposure to threatened death, sexual violence), intrusion symptoms, avoidance, negative alterations in cognitions and mood, alterations in arousal and reactivity, a duration of at least 1 month, functional significance, and exclusion of other explanatory factors (e.g., substance use ). The current draft of the ICD-11 diagnostic criteria suggests a symptom cluster of re-experiencing, avoidance, and enduring perceptions of heightened current threat; furthermore, the upcoming ICD-11 will also allow the diagnosis of complex PTSD which is additionally characterized by problems in affect regulation, beliefs about oneself as diminished, defeated, or worthless, accompanied by feelings of shame, guilt, or failure related to the traumatic event and difficulties in sustaining relationships and in feeling close to others .
Psychological interventions to treat PTSD are numerous with exposure-based therapy, cognitive processing therapy (CPT), cognitive therapy (CT), therapies based on cognitive behavioral therapy (CBT) principles, eye movement desensitization and reprocessing (EMDR), and narrative exposure therapy showing at least moderate effects ranging from standardized mean differences (SMD) of − 2.0 to − 0.3 . Patient preferences demonstrate a threefold higher preference for psychological treatments compared to medication . Still, although there is a well-established evidence-base for effective psychotherapeutic face-to-face treatments for this condition [7, 9], only a fractional number of patients receive treatment [10,11,12]. For example, in a survey interviewing US veterans with self-reported mental disorders (i.e., PTSD, generalized anxiety, major depression) after duty in Iraq and Afghanistan, only 23 to 40% stated that they received any professional help . Another study examining asylum seekers in the Netherlands reports that 54% of the participants originating from Asian and African countries diagnosed with PTSD did not receive any treatment . Reasons for the limited uptake of evidence-based treatments may be associated with fear of stigmatization or logistic barriers to treatment [10, 12]. Additionally, among those who actually do seek treatment, many do not receive evidence-based treatments or an adequate treatment dose .
Compared to traditional face-to-face intervention settings, using the Internet as a medium for the delivery of psychological interventions offers several advantages that might help to overcome treatment barriers . Several meta-analyses showed their efficacy both for other mental disorders (e.g., depression or anxiety [15,16,17,18,19]) and PTSD in particular [20,21,22]. In addition, Internet- and mobile-based interventions (IMIs) are easy to access and offer users the opportunity to flexibly integrate the treatment into daily life, regardless of any limits in terms of space and time . Moreover, users can set their own pace going through each session (potentially with automated feedback on their personal progress) as frequently or as quickly as they like . Looking at PTSD in particular, online interventions can offer a unique and geographically independent treatment opportunity in underserved post-conflict areas . It is also proposed that the anonymity in conduct of an online intervention for PTSD is one of its main advantages, particularly in some cultures (e.g., Arab cultures ). Correspondingly, one study has shown that anonymity, privacy, and confidentiality are the most frequently listed reasons for the use of the Internet for mental health support by survey respondents . Additionally, studies also found IMIs on some mental health conditions such as depression to be scalable and cost-effective [14, 27, 28], a valid argument considering limited resources in many health care systems worldwide. Nevertheless, risks concerning IMIs (e.g., lacking adherence, non-detected negative outcomes, negative attitudes of both patients and clinicians towards these interventions, crisis management in case of anonymous users) should be carefully considered and comprehensively investigated .
However, given their presumed potential to overcome treatment gaps and advance mental health services on a large scale, a closer inspection of the evolving field of IMIs for PTSD is worthwhile. Gaining insight on the efficacy as well as on active intervention components (i.e., intervention components that are responsible for the efficacy and can therefore deemed active, e.g., human support, exposure, prompts, cognitive processing/restructuring) and mechanisms of change (i.e., processes or events responsible for the change of the outcome ) in IMIs may allow to further optimize outcomes and prevent possible adverse events [30,31,32,33].
To test their efficacy, IMIs can be compared with active or inactive controls. Considering the confounding situation in the latter designs with specific ingredients (i.e., variables (e.g., therapeutic techniques) unique to a certain form of psychotherapy ) becoming mixed up with common factors (i.e., active ingredients contributing to the outcome while being common to all forms of psychotherapy [34, 35]), this systematic review and meta-analysis focusses on active controls. For example, in the context of IMIs for PTSD, one study  compares a self-guided web-based CBT intervention for cancer patients with web-based information-only with results favoring the intervention. Moreover, these active controls can be classified as either bonafide (i.e., treatments that were intended to be therapeutic ) or non-bonafide. Hereby, it is particularly proposed to compare IMIs with common factor controls as active controls (i.e., structural equivalent packages that do not contain the specific components of the IMI hypothesized as the active verum of the intervention ).
In contrast, so-called component studies that compare one treatment with a treatment in which one specific component is left out (i.e., dismantling studies) or added (i.e., additive studies) offer the possibility to examine active intervention components and assess their incremental (add on) effect sizes . For instance, there is a study  comparing a self-guided web-based intervention for war veterans with (subthreshold) PTSD and hazardous alcohol use with peer support with the same intervention without peer support, whereas no between-group differences are reported. Nevertheless, to date, there is ample evidence for guidance as a beneficial feature of Internet-based interventions [16, 31] with pending evidence for incremental effects of other single components .
Lastly, mechanisms of change (i.e., the actual processes responsible for therapeutic change) can be indicated by mediators (e.g., functional cognitions, emotional regulation, or problem-solving skills), and thus, the study of mediators is an important first step to understand mechanism of change . Hence, a quantitative assessment of changes within a well-established mediation analysis is necessary in this context. For example, one study  assessed the mediating role of self-efficacy beliefs on PTSD symptom reduction in an Internet-based self-efficacy intervention and reports that health and human services professionals experiencing increased levels of self-efficacy are more likely to show lower secondary traumatic stress at follow-up. Another study on the mechanisms of change in CPT and prolonged exposure therapy for PTSD assessed habituation and hopelessness  while a study on mechanisms of change in IMIs irrespective of disorders concluded that cognitive factors are an important mechanism of change while assuming causal effects without mediation analyses . This leaves room for an explorative assessment of intervention components and mediators and mechanisms of change specific for PTSD. In line with previous publications [29, 43, 44], we hereby conceptualize mediators as intervening variables that may statistically account for the relationship between the independent variable and the outcome. In contrast, moderators are variables or characteristics that influence the magnitude (or direction) of the relationship between an intervention and outcome , thereby indicating on whom and under which conditions treatments have differential effects . As such, moderators suggest that different processes are involved (i.e., “moderated mediation”), but conceptually represent no mechanisms of therapeutic change themselves [29, 44].
Additionally, adherence is an important aspect aside symptom severity, considering both the high drop-out rates in IMIs for PTSD in various trials (e.g., 51.2% post-intervention ) and the hypothesized dose-response relationship for the use of IMIs (e.g., [45, 46]), which suggests an underestimation of effects in case of low adherence. Thus, reviewing adherence data in this field is highly valuable in order to gather knowledge on intervention components contributing to increased adherence rates and thereby inform intervention development.
To our knowledge, two meta-analyses in this field solely investigated telehealth interventions [47, 48], whereas three recent meta-analyses [20,21,22] investigated Internet-based interventions for posttraumatic stress and found evidence for their efficacy. In particular, one meta-analysis  found effects ranging from SMD = − .66 to − .83 while including 13 studies with passive and 7 with active comparison conditions and an overall sufficient quality of included studies reported by the authors. Another meta-analysis  compared Internet-based CBT (iCBT) to both waitlist/TAU controls (SMD = − .71; 10 studies) and other interventions (SMD = − .28; 3 studies), with authors reporting a varying methodological quality of included studies. A third meta-analysis  with 33 included studies reported a pooled SMD of − .35 favoring Internet-based interventions independent of the comparison condition while including 18 active and 20 waitlist/TAU comparisons and reporting a slightly increased effect size when studies with reported high risk of bias were excluded (8 comparisons). However, none of these meta-analyses distinguished between bonafide and non-bonafide active controls, and to the best of our knowledge, there has been no systematic review or meta-analysis on IMIs for PTSD examining intervention components in additive or dismantling studies. The existing meta-analyses only provide indirect evidence on a possible larger effect of IMIs with therapeutic support compared to those without therapeutic support  and no evidence for responsible intervention components [20, 22] while including (predominantly) passive comparison conditions. The same holds true for mediators or mechanisms of change that have not been meta-analytically summarized so far. Moreover, even though the results indicate that Internet-based treatments are effective, interventions designed as smartphone applications were excluded in former reviews [20, 21].
Thus, this review and meta-analysis will provide a broader and updated overview of this field of research, focusing on intervention components and mediators. The proposed systematic review and meta-analysis aims to systematically review, critically evaluate, and statistically integrate the existing literature on IMIs for PTSD in order to answer the following research questions:
Are IMIs for PTSD efficacious regarding symptom reduction?
Are IMIs for PTSD equally efficacious when compared to bonafide control conditions/interventions?
Are IMIs for PTSD more efficacious than attention/psychological placebos, or other non-bonafide active (online) control conditions?
Which intervention components are responsible for the efficacy of IMIs for PTSD?
What potential mediators and mechanisms of change in IMIs for PTSD are examined so far?
This review and meta-analysis is registered with the International Prospective Register of Systematic Reviews (PROSPERO, CRD42019130314) and will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines . The PRISMA-P checklist can be found in Additional file 1.
A systematic literature search in the electronic databases PsycINFO, Medline/PubMed, Embase, and CENTRAL (Cochrane Central Register of Controlled Trials) with no restriction on dates of coverage and language will identify relevant studies. The sensitive search strategy employs a combination of search terms including the target diagnosis PTSD and the type of treatment delivery (i.e., Internet- or mobile-based). The predefined set of search strings can be found in Appendix 1.
A review of reference lists from identified studies (i.e., backward searches), a search of the WHO International Clinical Trials Registry Platform (ICTRP; Appendix 2) for ongoing studies with preliminary/unpublished results, and a citation search using Web of Science will complement the search. If necessary, study authors will be contacted to obtain further information regarding study characteristics. In case study protocols are identified without subsequent publication of results, protocol authors will be contacted to obtain missing or unpublished data and determine eligibility for inclusion in this review and meta-analysis.
Studies are eligible for inclusion if they focus on an adult target population (≥ 18 years; no upper limit) with PTSD or subthreshold PTSD assessed by standardized diagnostic interviews, observer-rated instruments with normed cutoff points, or validated self-reports (see Types of Outcomes). Studies of participants with different mental disorders (e.g., generalized anxiety disorder) will be included only if PTSD symptom severity is defined as primary outcome or main diagnosis of interest and results are reported specific to the respective disorders.
Studies will be included if at least one trial arm constitutes of an Internet- and mobile-based intervention (IMI) targeting PTSD symptoms. IMIs are defined as self-guided/unguided or guided interventions delivered via Internet- and mobile-based communication technology with a psychological/psychotherapeutic focus (e.g., trauma-focused CBT, CPT-based interventions [49, 50]). Interventions may vary concerning to the amount of guidance provided to participants (i.e., pure self-help interventions as well as guided interventions with different amounts and types of human support will be included). The following variations of IMIs are all eligible for inclusion: (a) guided interventions (i.e., with regular therapist contact), (b) mostly unguided interventions (i.e., predominantly self-help, e.g., with additional technical guidance on demand), and (c) completely unguided interventions (i.e., self-help, with no therapeutic support but assessment at most ). Therefore, studies are eligible for inclusion if IMIs involved an initial face-to-face interview or an initial face-to-face session.
Eligible comparisons differ by each research question. First, to investigate the efficacy of IMIs for PTSD, studies must include an active control group. Second, to investigate intervention components, studies must classify as additive or dismantling design study (see the “Study type” section). Third, to investigate mediators and mechanisms of change, studies are eligible for inclusion if they compare an IMI group with an active (e.g., IMI, face-to-face, treatment as usual, or placebo) or non-active control group (e.g., wait-list or no intervention).
To be classified as bonafide  in this systematic review and meta-analysis, the treatment for the control groups has to aim to reduce symptom severity (non-inferiority trials). If the authors postulate a superiority of the IMI group, we are classifying the control group as non-bonafide. In case authors do not specify their hypotheses clearly, we will decide the allocation depending on the existence of empirical evidence for the efficacy of the control treatment.
Change in PTSD symptom severity has to be measured by scores on a standardized, observer-rated instrument, for example, the Clinician-Administered PTSD Scale for DSM-IV (CAPS ), or a validated self-report measure of PTSD symptoms, for example, the Posttraumatic Stress Disorder Checklist - DSM-5 Version (PCL-5 ) or precursor version. Negative values characterize effect sizes favoring the intervention group.
To depict the influence of the participants’ engagement with the online intervention, adherence will be operationalized as (a) the mean number of main intervention units completed (e.g., lectures, diaries) and (b) the percentage of participants that completed the whole treatment [54, 55].
Possible mediators (e.g., functional cognitions, mindfulness, or problem-solving skills) are to be measured by validated psychometric instruments (e.g., Posttraumatic Cognitions Inventory ). Hereby, mediators are defined as intervening variables that statistically account for the relationship between an independent (i.e., the treatment) and a dependent variable (i.e., the outcome ).
Timing of outcome assessment
To be able to meaningfully comment on any post-intervention symptom reduction, separate analyses based on different periods of assessment will be performed (e.g., immediately post-treatment and after the follow-up period). The resulting follow-up periods will be clustered in three time frames: short-term (1–3 months after post-treatment), medium-term (> 3 to ≤ 12 months after post-treatment), and long-term (> 12 months after post-treatment) effects. If studies report more than one follow-up assessment point, the longest follow-up period will be used to provide the best estimate of the crucial long-term outcomes of the PTSD intervention.
In order to investigate the efficacy of IMIs for PTSD and active intervention components, only randomized controlled trials (RCTs ) with active control groups or comparing IMIs to dismantled variations of the same intervention will be included. The latter allows to investigate specific effects of single components of IMIs by adding or subtracting specific elements . To study potential mediator variables, both original RCTs and secondary analyses on previous RCTs will be eligible. They have to include repeated measures and use well-established mediation analyses (e.g., ) or include a quantitative assessment of changes in investigated psychological mediators. Studies have to be written in English and either be published in peer-reviewed journals or classified as ongoing trials in ICTRP with already existing results.
Study selection process
Two independent reviewers (LS, AS) will conduct the selection of articles. First, one reviewer (LS) will screen all titles and abstracts of articles yielded by the database search. Second, full texts of the selected articles will be retrieved and screened by both reviewers (LS, AS) in terms of the aforementioned eligibility criteria. Third, reference lists of finally included articles will be screened in the same way. Disagreement will be resolved by discussion among reviewers or, if necessary, by consultation of a third reviewer (MD). To illustrate the study selection process and reasons for exclusion, a PRISMA-P flow chart  will be provided. Records will be managed using the literature management program CITAVI 6.
The following data items will be extracted by two independent reviewers (LS, AS) for each study: (a) study identification items (year of publication, first author, country), (b) study and intervention characteristics (inclusion and exclusion criteria, screening instruments, therapeutic background, sample size, intervention design/type, level of human support/guidance, control group, duration of intervention/number of sessions, follow-up assessments, recruitment strategy, communication mode, prompts, standardization), (c) target population items (gender, age, specific population groups if applicable, comorbidities, trauma type, type of PTSD), (d) setting (nationality, environment, recruitment strategy), (e) drop-out rate, (f) human support characteristics (e.g., qualification of e-coaches if any), (g) platform characteristics, (h) frequency of adverse events if assessed and reported in primary studies, and (i) dimensional clinical outcomes.
In case of overlapping studies or multiple studies on the same data set, all information will be extracted with a note, highlighting the shared data set. Should there be any data missing or the reported data unclear, study authors will be contacted and asked for further clarification.
In case of multiple outcome measures for the assessment of PTSD symptom severity, the primary outcome measure of the study will be selected. If outcomes are assessed by several instruments, data will be extracted as follows: (a) the primary outcome measure of the study will be prioritized; (b) in case of multiple outcome measures of the same hierarchical level, the most used outcome measure will be chosen for the meta-analysis; and (c) should the aforementioned steps be not be possible, we will randomly select one outcome measure.
Two independent reviewers (LS, AS) will assess the risk of bias using the Cochrane Collaboration’s tool for assessing risk of bias in RCTs  in order to evaluate the quality of included studies. As recommended, each study will be rated in the following domains: (a) random sequence generation, (b) allocation concealment, (c) blinding of participants and personnel, (d) blinding of outcome assessment, (e) incomplete outcome data, and (f) other bias (e.g., study has been claimed to be deceitful, baseline differences between intervention and control group). Studies will be rated as showing an “unclear”, “low”, or “high” risk of bias on each domain. Inter-rater reliability will be calculated by means of Cohen’s kappa, whereby a value between .60 and .80 can be considered as substantial and a value > .80 as perfect . It is important to note that the third domain on blinding of participants and personnel is not warranted in (guided) IMIs, which would result in a high risk of bias rating. To prevent a distorted rating, we will rate this domain as “unclear” if this is the case.
To examine possible publication bias, the trim and fill procedure [63, 64], Egger’s test of funnel plot asymmetry , and visual inspection of funnel plots will be utilized.
Additionally, mediation studies will be qualitatively rated with the following criteria, originally proposed by Kazdin : (a) underlying theory or conceptual model, (b) RCT and inclusion of a control group, (c) sufficient sample size per condition (defined as n ≥ 40), (d) examination of multiple mediators in one study, (e) assessment of temporality (defined as ≥ 3 assessments in treatment phase), and (f) direct experimental manipulation of the mediator.
Data synthesis and presentation
Both text and tables will provide a detailed description of the results for all included studies. Characteristics of selected studies will be listed and qualitatively described. Characteristics include (a) study design and characteristics (sample size, duration, follow-up period) and patient population (age, gender, specific population group), (b) intervention characteristics (name, intervention content (e.g., CBT)), (c) technical implementation (e.g., Internet-only or Internet- and mobile-based), (d) duration, (e) level of human support/guidance, (f) study and intervention drop-out rate, (g) assessment tool used to determine presence of PTSD (clinical interview, questionnaire), (h) recruitment procedure, and (i) any covariates assessed (list of variables).
To assess the efficacy of IMIs compared to active control conditions and the efficacy of their intervention components, data analyses will be performed using the Review Manager 5.3 software developed by the Cochrane Collaboration . Meta-analytic pooling will be conducted when at least three studies report outcome parameters. If applicable, random-effects meta-analyses will be used to compute overall estimates of treatment outcomes. Standardized mean differences (SMD) and their 95% confidence intervals (CI) will be calculated for all continuous outcomes. As Hedges’ g is less biased than Cohen’s d in small samples , SMD will be given as values of the former measure. Dichotomous outcomes will be analyzed using risk ratios and corresponding 95% CIs and completer rate using odds ratios and their 95% CIs.
Heterogeneity will be evaluated with the I2 statistic, whereby an I2 value < 40% may not be important, a value between 30 and 60% may represent moderate heterogeneity, between 50 and 90% substantial heterogeneity, and > 75% considerable heterogeneity .
A forest plot will be created and used to visually investigate the presence and nature of statistical heterogeneity. In addition, statistical heterogeneity of the effect sizes will be evaluated using the Q statistic , with a significant Q indicating heterogeneity across studies that warrants further exploration.
For further comparisons of intervention and study characteristics (concerning, e.g., content, form, therapeutic background, guidance, trauma type, study quality, target population, and active intervention components), subgroup analysis will be performed if feasible. The possible influence of publication bias will be determined by inspection of funnel plots if feasible . Feasibility will be given with at least three trials per subgroup for subgroup analysis and at least ten trials to determine possible influence of publication bias .
Sensitivity analyses will be conducted to test the robustness of the results by comparing the pooled SMD of the different times of outcome assessment (see the “Timing of outcome assessment” section): (1) short term, (2) medium term, and (3) long term. Further sensitivity analyses will be conducted to examine the effect of including studies at high risk of bias. Should a quantitative synthesis not be appropriate, results will be summarized qualitatively.
To evaluate and synthesize evidence for possible mediators, a two-stage structural equation modeling (TSSEM) approach employing R will be used if appropriate [68, 69]. This approach combines meta-analytic techniques and structural equation modeling (SEM) and has been considered superior to conventional approaches to synthesize studies that use SEM (e.g., Pearson correlations, generalized least squares ). Means, SD, t statistics, F statistics, and effect sizes will be used to calculate bivariate correlations if studies do not report bivariate correlation between treatment, mediator, and outcome . Should a quantitative synthesis not be appropriate, results will be summarized qualitatively by summarizing the (significant) mediators found.
To measure the confidence in the cumulative evidence, the strength of the body of evidence will be assessed using the GRADE approach . This system classifies the quality of evidence in four levels ranging from “very low” and “low” to “moderate” and “high” (influenced by, e.g., study limitations, inconsistency of results) and offers “strong” and “weak” as grades of recommendation (influenced by, e.g., quality of evidence, uncertainty, or variability in values and preferences ).
This systematic review and meta-analysis will add to previous research by summarizing, synthesizing, and discussing the existing literature on Internet- and mobile-based interventions for PTSD. The findings of this review will go beyond previous meta-analyses and systematic reviews in this field (e.g., [20,21,22]), as results will extend to intervention components and mediators and mechanisms of change, while also covering mobile-based interventions. By identifying and quantifying the active intervention components and mediators and mechanisms of change, it may advance our understanding on how Internet- and mobile-based intervention take effect. This can help to develop more effective interventions and prevent possible adverse events. Moreover, results might assist in the verification and advancement of psychotherapeutic theories and the development of an extensive model on how IMIs for PTSD and psychotherapies in general might work [29, 72].
However, there are several limitations to the proposed systematic review and meta-analysis. One important limitation might be caused by substantial heterogeneity of included studies. The clinical, methodological, and statistical differences might limit the possibility of quantitatively pooling trials as well as the generalizability of findings. Previous meta-analyses on IMIs for PTSD have shown up to considerably high heterogeneity while suggesting differences in employed therapeutic techniques among others to be responsible (e.g., ). Moreover, only studies written in English will be included, which may lead to an overestimation of effects as trials with statistically significant results have been shown to be more likely published in English . Furthermore, despite the attempts to include unpublished and non-significant studies, the proposed systematic review and meta-analysis might also be limited by publication bias.
In sum, given the substantial burden of disease associated with PTSD and the opportunities of IMIs for extending and augmenting available service supplies, the proposed review and meta-analysis is urgently needed and will substantially add to the current evidence. The results will inform intervention development by highlighting active intervention components and mediators responsible for therapeutic change, and extend the evidence base on the efficacy of IMIs for PTSD.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Clinician-Administered PTSD Scale
Cognitive behavioral therapy
Cochrane Central Register of Controlled Trials
Cognitive processing therapy
Diagnostic and Statistical Manual of Mental Disorders
Eye movement desensitization and reprocessing
Grading of Recommendations Assessment, Development and Evaluation
International Statistical Classification of Diseases and Related Health Problems
International Clinical Trials Registry Platform
Internet- and mobile-based interventions
Posttraumatic Stress Disorder Checklist—DSM-5 Version
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Post-traumatic stress disorder
Randomized controlled trial
Standardized mean difference
Two-stage structural equation modeling
McMillen C, North C, Mosley M, Smith E. Untangling the psychiatric comorbidity of posttraumatic stress disorder in a sample of flood survivors. Compr Psychiatry. 2002;43(6):478–85.
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:593–768.
Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011;21(9):655–79.
Dückers MLA, Alisic E, Brewin CR. A vulnerability paradox in the cross-national prevalence of post-traumatic stress disorder. Br J Psychiatry. 2016;209(4):300–5.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.
World Health Organization. International statistical classification of diseases and related health problems. 11th revision; 2018.
Cusack K, Jonas DE, Forneris CA, Wines C, Sonis J, Middleton JC, et al. Psychological treatments for adults with posttraumatic stress disorder: a systematic review and meta-analysis. Clin Psychol Rev. 2016;43:128–41.
McHugh RK, Whitton SW, Peckham AD, Welge JA, Otto MW. Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry. 2013;74(6):595–602.
Watts BV, Schnurr PP, Mayo L, Young-Xu Y, Weeks WB, Friedman MJ. Meta-analysis of the efficacy of treatments for posttraumatic stress disorder. J Clin Psychiatry. 2013;74(6):e541–50.
Hoge CW, Catro CA, Messer SC, McGruk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004;351(1):13–22.
Mueser KT, Rosenberg SD, Rosenberg HJ. Treatment of posttraumatic stress disorder in special populations: A cognitive restructuring program. Washington, DC: American Psychological Association; 2009.
Stecker T, Fortney JC, Hamilton F, Ajzen I. An assessment of beliefs about mental health care among veterans who served in Iraq. Psychiatr Serv. 2007;58(10):1358–61.
Drozdek B, Noor AK, Lutt M, Foy DW. Chronic PTSD and medical services utilization by asylum seekers. J Refug Stud. 2003;16(2):202–11.
Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014;13:4–11.
Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. 2018;47(1):1–18.
Domhardt M, Geßlein H, von Rezori RE, Baumeister H. Internet- and mobile-based interventions for anxiety disorders: a meta-analytic review of intervention components. Depress Anxiety. 2019;36(3):213–24.
Domhardt M, Steubl L, Baumeister H. Internet- and mobile-based interventions for mental and somatic conditions in children and adolescents. Z Kinder Jugendpsychiatr Psychother. 2018:1–14.
Königbauer J, Letsch J, Doebler P, Ebert DD, Baumeister H. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord. 2017;223:28–40.
Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. 2016;3:CD011565.
Kuester A, Niemeyer H, Knaevelsrud C. Internet-based interventions for posttraumatic stress: a meta-analysis of randomized controlled trials. Clin Psychol Rev. 2016;43:1–16.
Sijbrandij M, Kunovski I, Cuijpers P. Effectiveness of internet-delivered cognitive behavioral therapy for posttraumatic stress disorder: a systematic review and meta-analysis. Depress Anxiety. 2016;33(9):783–91.
Simblett S, Birch J, Matcham F, Yaguez L, Morris R. A systematic review and meta-analysis of e-mental health interventions to treat symptoms of posttraumatic stress. JMIR Ment Health. 2017;4(2):e14.
Cuijpers P, van Straten A, Warmerdam L, van Rooy MJ. Recruiting participants for interventions to prevent the onset of depressive disorders: possible ways to increase participation rates. BMC Health Serv Res. 2010;10:181.
Sander L, Rausch L, Baumeister H. Effectiveness of Internet- and mobile-based psychological interventions for the prevention of mental disorders: a systematic review and meta-analysis protocol. Syst Rev. 2016;5:30.
Wagner B, Schulz W, Knaevelsrud C. Efficacy of an Internet-based intervention for posttraumatic stress disorder in Iraq: a pilot study. Psychiatry Res. 2012;195(1–2):85–8.
Horgan A, Sweeney J. Young students’ use of the Internet for mental health information and support. J Psychiatr Ment Health Nurs. 2010;17(2):117–23.
Titov N, Dear BF, Ali S, Zou JB, Lorian CN, Johnston L, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of depression: a randomized controlled trial. Behav Ther. 2015;46:193–205.
Warmerdam L, van Straten A, Jongsma J, Twisk J, Cuijpers P. Online cognitive behavioral therapy and problem-solving therapy for depressive symptoms: exploring mechanisms of change. J Behav Ther Exp Psychiatry. 2010;41(1):64–70.
Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.
Andersson G. Internet-delivered psychological treatments. Annu Rev Clin Psychol. 2016;12:157–79.
Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — a systematic review. Internet Interv. 2014;1(4):205–15.
Mogoașe C, Cobeanu O, David O, Giosan C, Szentagotai A. Internet-based psychotherapy for adult depression: what about the mechanisms of change? J Clin Psychol. 2017;73(1):5–64.
Mureşan V, Montgomery GH, David D. Emotional outcomes and mechanisms of change in online cognitive-behavioral interventions: a quantitative meta-analysis of clinical controlled studies. J Technol Hum Serv. 2012;30(1):1–13.
Lambert MJ, Vermeersch DA. Effectiveness of psychotherapy. In: Encyclopedia of psychotherapy, vol. 1; 2002. p. 709–14.
Karlsson P, Bergmark A. Compared with what? An analysis of control-group types in Cochrane and Campbell reviews of psychosocial treatment efficacy with substance use disorders. Addiction. 2015;110(3):420–8.
Beatty L, Koczwara B, Wade T. Evaluating the efficacy of a self-guided web-based CBT intervention for reducing cancer-distress: a randomised controlled trial. Support Care Cancer. 2016;24(3):1043–51.
Wampold BE, Mondin GW, Moody M, Stich F, Benson K, Ahn H-N. A meta-analysis of outcome studies comparing bona fide psychotherapies: empiricially, “all must have prizes”. Psychol Bull. 1997;122(3):203–15.
Stevens S, Hynan M, Allen M. A meta-analysis of common factor and specific treatment effects across the outcome domains of the phase model of psychotherapy. Clin Psychol Sci Pract. 2000;7(4):273–90.
Bell EC, Marcus DK, Goodlad JK. Are the parts as good as the whole? A meta-analysis of component treatment studies. J Consult Clin Psychol. 2013;81(4):722–36.
Possemato K, Johnson EM, Emery JB, Wade M, Acosta MC, Marsch LA, et al. A pilot study comparing peer supported web-based CBT to self-managed web CBT for primary care veterans with PTSD and hazardous alcohol use. Psychiatr Rehabil J. 2019;42(3):305–13.
Cieslak R, Benight CC, Rogala A, Smoktunowicz E, Kowalska M, Zukowska K, et al. Effects of internet-based self-efficacy intervention on secondary traumatic stress and secondary posttraumatic growth among health and human services professionals exposed to indirect trauma. Front Psychol. 2016;7:1009.
Gallagher MW, Resick PA. Mechanisms of change in cognitive processing therapy and prolonged exposure therapy for PTSD: preliminary evidence for the differential effects of hopelessness and habituation. Cognit Ther Res. 2012;36(6):750–5.
Cuijpers P, Reijnders M, Huibers MJH. The role of common factors in psychotherapy outcomes. Annu Rev Clin Psychol. 2019;15:207–31.
Kraemer HC, Wilson GT, Fairburn CG, Agras WS. Mediators and moderators of treatment effects in randomized clinical trials. Arch Gen Psychiatry. 2002;59(10):877–83.
Graham AL, Cobb NK, Raymond L, Sill S, Young J. Effectiveness of an internet-based worksite smoking cessation intervention at 12 months. J Occup Environ Med. 2007;49(8):821–8.
Steele RM, Mummery WK, Dwyer T. Examination of program exposure across intervention delivery modes: face-to-face versus internet. Int J Behav Nutr Phys Act. 2007;4:7.
Bolton AJ, Dorstyn DS. Telepsychology for posttraumatic stress disorder: a systematic review. J Telemed Telecare. 2015;21(5):254–67.
Sloan DM, Gallagher MW, Feinstein BA, Lee DJ, Pruneau GM. Efficacy of telehealth treatments for posttraumatic stress-related symptoms: a meta-analysis. Cogn Behav Ther. 2011;40(2):111–25.
Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med. 2009;38(1):4–17.
Domhardt M, Ebert DD, Baumeister H. Internet- und mobile-basierte Interventionen. In: Kohlmann C, Salewski C, Wirtz MA, editors. Bern: Psychologie in der Gesundheitsförderung; 2018. p. 397–410.
Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev. 2011;31(1):89–103.
Blake DD, Weathers FW, Nagy LM, Kaloupek DG, Gusman FD, Charney DS, et al. The development of a clinician-administered PTSD scale. J Trauma Stress. 1995;8(1):75–90.
Blevins CA, Weathers FW, Davis MT, Witte TK, Domino JL. The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J Trauma Stress. 2015;28(6):489–98.
Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. 2011;13(3):e52.
Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833–42.
Foa EB, Ehlers A, Clark DM, Tolin DF, Orsillo SM. The posttraumatic cognitions inventory (PTCI): development and validation. Psychol Assess. 1999;11(3):303–14.
Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions: The Cochrane Collaboration; 2011. Available from: URL: https://handbook.cochrane.org/
Borkovec TD, Castonguay LG. What is the scientific meaning of empirically supported therapy? J Consult Clin Psychol. 1998;66(1):136–42.
Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986;51(6):1173–82.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100.
Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Duval S, Tweedie R. A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. J Am Stat Assoc. 2000;95(449):89–98.
Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.
Review Manager software, The Nordic Cochrane Center, Copenhagen, Denmark. Available at revman.cochrane.org.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis. Chichester: Wiley; 2009.
Hedges LV, Olkin I. Statistical methods for meta-analysis. London: Academic; 1985.
Cheung MW-L. metaSEM: an R package for meta-analysis using structural equation modeling. Front Psychol. 2014;5:1521.
Cheung MWL, Chan W. A two-stage approach to synthesizing covariance matrices in meta-analytic structural equation modeling. Struct Equ Model Multidiscip J. 2009;16(1):28–53.
Cheung MW-L, Chan W. Meta-analytic structural equation modeling: a two-stage approach. Psychol Methods. 2005;10(1):40–64.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–6.
Lemmens LHJM, Müller VNLS, Arntz A, Huibers MJH. Mechanisms of change in psychotherapy for depression: an empirical update and evaluation of research aimed at identifying psychological mediators. Clin Psychol Rev. 2016;50:95–107.
Egger M, Zellweger-Zähner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet. 1997;350(9074):326–9.
Anna-Lena Schröder (AS; University of Ulm) will contribute to the study selection, data extraction, and quality assessment as second independent reviewer.
MD and LS are working on the project “Mechanisms of change in Internet- and mobile-based interventions for depression: A systematic review and meta-analysis of individual participant data” funded by the German Federal Ministry of Education and Research (grant identification FKZ 01KG1802). The funding agency did not have any role in developing the protocol.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
PRISMA-P 2015 Checklist. This checklist has been adapted for use with systematic review protocol submissions to BioMed Central journals from Table 3 in Moher D et al.: Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews 2015 4:1. An Editorial from the Editors-in-Chief of Systematic Reviews details why this checklist was adapted - Moher D, Stewart L & Shekelle P: Implementing PRISMA-P: recommendations for prospective authors. Systematic Reviews 2016 5:15.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Steubl, L., Sachser, C., Baumeister, H. et al. Intervention components, mediators, and mechanisms of change of Internet- and mobile-based interventions for post-traumatic stress disorder: protocol for a systematic review and meta-analysis. Syst Rev 8, 265 (2019). https://doi.org/10.1186/s13643-019-1190-6
- Internet- and mobile-based
- Intervention components
- Mechanism of change