Psychological interventions for the treatment of depression, anxiety, alcohol misuse or anger in armed forces veterans and their families: systematic review and meta-analysis protocol
Systematic Reviews volume 6, Article number: 112 (2017)
Evidence highlights a high prevalence of common mental health disorders in armed forces veterans and their families, with depression, anxiety, alcohol misuse and anger being more common than PTSD. This paper presents a protocol for a systematic review and meta-analysis to identify existing randomised controlled trial (RCT) research testing the effectiveness of psychological interventions for these difficulties in armed forces veterans and their family members.
Electronic databases (CENTRAL, PsycInfo, MEDLINE, CINAHL, The Cochrane Register of Clinical Trials, EMBASE and ASSIA) will be searched to identify suitable studies for inclusion in the review supplemented by forward and backward reference checking, grey literature searches and contact with subject authors. Research including armed forces veterans and their family members will be included in the review with research including serving personnel or individuals under the age of 18 being excluded. Few RCTs examining the treatment of depression, anxiety, alcohol misuse or anger exist in armed forces veterans to date. The primary outcome will be symptomatic change following intervention for these difficulties. The secondary outcomes will include methodological aspects of interest such as discharge type and recruitment setting if data permits. In the event that the number of studies identified is too low to undertake a meta-analysis, a narrative review will be conducted. Quality assessment will be undertaken using the Cochrane Collaboration Tool and Cochran’s Q statistic calculated to test for heterogeneity as suggested by the Cochrane handbook.
The review will examine the findings of existing intervention research for depression, anxiety, alcohol misuse or anger in armed forces veterans and their families, along with any effect sizes that may exist.
Systematic review registration
The most common mental health disorders in the general population are depression, generalised anxiety disorder, social anxiety, obsessive compulsive disorder, panic and post-traumatic stress disorder (PTSD) . Growing evidence exists that some of these disorders are also highly prevalent in armed forces veterans , with depression, anxiety and alcohol misuse highly prevalent, and more common than PTSD [3, 4]. Another common problem for armed forces veterans is anger that can inhibit psychosocial functioning and lead to loss of emotional support . It is clear from the research to date that certain mental health difficulties prevalent in the general population are also prominent in armed forces veterans. Further investigation examining interventions targeting these difficulties is therefore warranted.
Despite the prevalence of these difficulties, many armed forces veterans do not seek mental health treatment . One of the causes of this may be the anticipation of stigma, which remains a powerful barrier preventing members of the UK armed forces accessing help . Not seeking treatment may exacerbate difficulties for some individuals, as those who are discharged from service with psychological problems are at high risk of experiencing ongoing ill health . One group in which this may be particularly prominent is early service leavers (those who leave before the minimum term of their contract) who have poorer mental health and are at higher risk of developing mental health disorders than non-early service leavers . No existing review takes the mental health of early service leavers into account; therefore, an integration of existing research addressing early service leavers or ways of altering interventions to promote participation and reduce barriers to treatment is required.
The high prevalence of common mental health difficulties is not only limited to armed forces veterans but is also experienced in their spouses and family members. This is due to the unique daily stressors they face, such as relocations and separations that affect all family members [9,10,11]. Given that research indicates a high prevalence of mental health difficulties in the family members of armed forces veterans, this review will focus on research addressing interventions in this population as well.
Whilst little is known about the mental health treatment of the family members of armed forces veterans, two systematic reviews exist that examine mental health treatments for armed forces veterans. The existing systematic reviews have found cognitive behavioural therapy (CBT) and psychosocial interventions effective for the treatment of mental health disorders in armed forces veterans. Kitchiner et al.,  included 29 randomised controlled trials (RCTs) examining the efficacy of psychosocial interventions for anxiety and depressive disorders in armed forces veterans. They found telephone support effective for the treatment of depression and at risk drinking in two of the RCTs. Hundt et al.,  included nine studies (five RCTs and four open trials) examining the effectiveness of CBT for depression in armed forces veterans. The open trials reported larger effect sizes, which may be due to them having fewer participants or arising as a consequence of confounding methodological factors, with the open trials of lower methodological quality than the RCTs. Furthermore, only two of the five RCTs found CBT more effective than wait-list and psychoeducational control conditions.
Despite these findings, the existing reviews are dated as they were conducted in 2012 and 2014. In addition to this, one review was limited to CBT for depression only, and neither review addressed anger or the mental health of the families of armed forces veterans. A broader, more up to date review of the topic area is therefore warranted.
In developing services and guiding future research, it is imperative to know the range of evidence-based treatments that are available and have been evaluated in armed forces veterans and their family members. In order to broaden the scope of the proposed review, a diverse list of search terms has been developed that will examine the treatment of depression, anxiety, alcohol misuse or anger in armed forces veterans and their families. This will facilitate a comprehensive review of research in the area of mental health treatments for depression, anxiety, alcohol misuse or anger in armed forces veterans, including early service leavers, and their families.
Types of study design
The review will include studies with an RCT design, with both active and inactive control groups. This will allow causal determinants around the effectiveness of existing interventions to be reliably explored.
Participants will include armed forces veterans and family members reporting symptoms of depression, anxiety, alcohol misuse or anger. There is a need to operationalise the term ‘veteran’ in this review as the term differs from country to country. For instance, the Canadian government considers a veteran to be ‘any former member of the Canadian armed forces released with an honourable discharge and who successfully completed basic training’ . This is similar to the US definition of a ‘person who served in the active military, naval or air service, and was discharged or released therefrom under conditions other than dishonourable’ . This review will use the more inclusive British definition of ‘Those who have served for at least one day in HM Armed Forces, whether as a regular or reservist’, which may lead to the inclusion of individuals who would not have been considered a veteran if an alternative definition were applied, and includes early service leavers .
Studies using psychological or psychosocial interventions for one of the target disorders/behaviours will be included in the review. A psychological intervention is a treatment that works to modify thoughts, feelings, behaviour or emotional state. “A ‘psychosocial intervention’ is a broad term used to describe different ways to support people to overcome challenges and maintain good mental health. Psychosocial interventions do not involve the use of medication” (, p2.).
Interventions may be delivered face-to-face as high-intensity psychological therapy or in a low-intensity format via the use of CBT self-help interventions with/without support provided face-to-face, over the telephone or in a written format or a combination of these support modalities. In order to reduce bias associated with short-term posttreatment effects, effect size will be calculated from data obtained both at immediate posttreatment up to 6 months follow-up.
Studies that report pharmaceutical interventions plus therapy intervention groups will be included in the review; however, those focusing solely on psychopharmacological interventions will be excluded.
Potential comparators could include treatment as usual, alternative treatment, watchful waiting, attention control or information provision groups.
The primary outcome in this review will be symptomatic change in depression, anxiety, anger or alcohol misuse in armed forces veterans or their family members on standardised measures between intervention and control groups post intervention and up to 6 months post intervention. Symptomatic change may be from formal diagnosis or observer-rated or self-report measures such as PHQ-9, GAD-7, AUDIT and NAS-PI [20,21,22,23]. Outcomes post intervention up to and including 6 months post intervention will be extracted to enable a potential moderator analysis on length of follow-up. Secondary outcomes will include methodological aspects of interest such as comparator group or recruitment settings or follow-up outcomes which will allow the impact these factors may have in relation to primary outcomes to be explored. Effect sizes will be calculated using the Campbell Collaboration effect size calculator , examining the differences that comparator groups or recruitment settings may have on outcomes. Studies will be categorised by target disorder, with studies with multiple target disorders discussed in each category. Studies with multiple outcome measures per target disorder will be detailed in the narrative analysis. Meta-analyses will be conducted for each target disorder and comparator where data allows. The measure used in the meta-analysis was based on the following hierarchy: depression (PHQ-9, Hamilton rating scale for depression—HRSD, Beck depression inventory—BDI [20, 25, 26]), anxiety (GAD-7, State-trait anxiety inventory—STAI, Beck Anxiety Inventory and the Hospital Anxiety and Depression Scale [21, 27,28,29]), anger (NAS-PI, DAR, State-trait anger expression inventory—STAXI [23, 30, 31]), alcohol misuse (Audit, Timeline follow-back—TLFB [22, 32]) where multiple outcome measures have been used in studies. No general categories will be employed with studies being required to directly measure one of the four target disorders in order to warrant inclusion in the review. In order to control for upward bias, only target outcomes shall be analysed with secondary disorders identified through questionnaire battery not included.
Methods for identification of studies
Electronic searches of CENTRAL, PsycInfo, MEDLINE, CINAHL, The Cochrane Register of Clinical Trials, EMBASE and ASSIA will be undertaken using free text, MESH headings and Boolean operators, with the search adjusted to fit each database. A proposed search strategy for the MEDLINE database is attached (Additional file 2).
Forward and backward citations will be explored by examining the reference lists of identified studies. A grey literature search will also be undertaken examining conference proceedings, grey literature databases and relevant websites. Subject authors will be contacted to identify missing data and any additional studies that meet the inclusion criteria. There will be no country exclusions for studies; however, only studies available in English will be included in the review.
The search process will begin with title and abstract examination by LO, with full papers then obtained and compared against the inclusion/exclusion criteria. A subset of the papers (10%) will also be reviewed by an independent reviewer not connected to the study in order to check reliability using a Kappa statistic . Any discrepancies about study inclusion will be resolved through discussion in consensus meetings.
A PRISMA flow chart will be produced. The initial database searches will take place between June and July 2016. The next steps of the research process will depend on the number of studies identified. Any study published in English up to the date that the searches commence will be included in the review.
Data extraction and analysis
A data extraction form will be produced and trialled. Missing data will be requested from authors. If it is not possible to obtain missing data, sensitivity analysis will be conducted to assess the impact of removing this study from the data analysis on any statistical synthesis of data. Data extraction will be undertaken by LO again checked by an independent reviewer to test for reliability. Any discrepancies will again be resolved through discussion at consensus meetings. Data to be extracted will cover the following areas: participant characteristics (number, age, gender, rank, regular or reservist etc.), service branch (Army, Navy, Airforce), intervention used (face-to-face high intensity therapy, self-help, guided help etc.), comparator group(s) (treatment as usual, alternative treatment, watchful waiting), outcome measure(s) used (PHQ-9, GAD-7, HADS, AUDIT, BDI, NAS-PI), study outcome (symptomatic change and any associated effect size) with discrepancies resolved through discussion. Follow-up data will be extracted where applicable. Standard mean difference between intervention group(s) and control post intervention, along with the respective 95% confidence intervals, will be calculated using the Campbell Collaboration effect size calculator using study outcome means, standard deviations and number of participants . This will be done using between groups post intervention and follow-up (up to and including 6 months post intervention) means, standard deviations and number of participants, with missing data again requested from study authors. As the review only focuses on symptomatic change, dichotomous data will not be applicable.
Risk of bias
Quality assessment will be conducted using the Cochrane Collaboration Tool . The tool will allow the quality of identified studies to be discussed in a manner consistent with the Centre for Reviews and Dissemination guidelines . Studies identified as poor quality will be dropped from the analysis in order to improve the reliability of findings.
Extracted data will be presented in a tabulated format. A risk of bias table will be compiled using RevMan .
Where a sufficient number of papers meeting inclusion criteria are identified, meta-analysis will be undertaken. Although meta-analysis can be conducted with as little as two studies, if a large amount of heterogeneity exists, concerns regarding the reliability of any statistical synthesis can arise. In addition to this, because a random effects model will be used, a small number of studies may lead to an error in the between studies variance estimation. The number of studies identified and the level of heterogeneity will therefore be taken into account when considering the suitability of the data for a meta-analysis. If a meta-analysis is deemed appropriate, effect sizes (standardised mean difference, Cohen’s d) and 95% confidence intervals will be calculated again using the Campbell Collaboration effect size calculator  with forest plots produced to visually represent findings. Effect size will be interpreted using Cohen’s classification (small, 0.20 to 0.49; medium, 0.5 to 0.79; large >0.80) .
In the event that only a small number of studies are identified with a large amount of heterogeneity present, a full narrative review will be undertaken using the ‘Narrative Synthesis in Systematic Reviews’ tool  which will allow for a textual approach to be adopted and applied, explaining the findings of the study data.
It is expected that a number of different interventions will be examined across studies. Therefore, a random effects model will be adopted, as advised by Borenstein . Cochran’s Q statistics will be calculated to test for heterogeneity, with I 2 statistics calculated to quantify the degree of heterogeneity found. If at least 10 studies are identified (as per Cochrane handbook for systematic reviews of interventions advice ), funnel plots will be produced using RevMan  to check for publication bias with Eggers’ test of intercept used to determine if funnel plot asymmetry exists .
If heterogeneity exists, subgroup analysis will be conducted in order to determine whether this is due to methodological or participant factors. Moderators may include clinical presentation, branch of service, high/medium quality study, country of origin and early service leaver vs non-early service leaver, or methodological moderators such as recruitment source.
The effectiveness of existing interventions for depression, anxiety, alcohol misuse and anger in armed forces veterans and their families will be explored through the planned systematic review.
The two existing reviews [12, 13] in the area of armed forces veteran mental health have employed narrow searches. Therefore, the effectiveness of interventions addressing anger and alcohol misuse remains unknown. The proposed review will employ a robust method following PRISMA, Cochrane and CRD guidelines and a broad range of search terms used to establish a comprehensive picture of the research in the area to date.
Most research addressing the mental health of armed forces veterans has been conducted in the USA. This review will attempt to adopt a more inclusive approach by using the British definition of the term armed forces veteran, which may lead to the inclusion of studies that may have been excluded when a narrower definition of veteran, such as that used in the USA, is applied.
Given the prevalence and significant impact of poor mental health in armed forces veterans, results of this review may be important in guiding future research, service development, clinical practice and health care policy such as the armed forces covenant that focuses on the mental health of armed forces veterans and their families .
Cognitive behavioural therapy
Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocol
International Prospective Register of Systematic Reviews
Post-traumatic stress disorder
NICE. Common mental health problems: identification and pathways to care. NICE Guidelines. 2011. p. CG123.
Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004;351:13–22.
Iversen A, Greenberg N. Mental health of regular and reserve military veterans. Adv Psychiatr Treat. 2009;15(2):100–6.
Iversen AC, van Staden L, Hacker Hughes J, Greenberg N, Hotopf M, Rona RJ, et al. The stigma of mental health problems and other barriers to care in the UK armed forces. BMC Health Serv Res. 2011;11:31.
Anger MS, Veterans M. Journal of student social work. Columbia Univ Acad Commons. 2006;4:7–16.
Vogt D. Mental health-related beliefs as a barrier to service use for military personnel an veterans: a review. Psychiatr Serv. 2011;62(2):135–42.
King’s College for Military Health Research. A fifteen year report: what has been achieved by fifteen years of research into the health of UK Armed Forces? London: Kings College London, University of London; 2010.
Buckman JEJ, Forbes HJ, Clayton T, Jones M, Jones N, Greenberg N, et al. Early service leavers: a study of the factors associated with premature separation from the UK Armed Forces and the mental health of those that leave early. Eur J Public Health. 2012. doi:10.1093/eurpub/cks042.
Dimiceli EE, Steinhardt MA, Smith SE. Stressful experiences, coping strategies, and predictors of health-related outcomes among wives of deployed military servicemen. Armed Forces Soc. 2010;36(2):351–73.
Spelman JF, Hunt SC, Seal KH, Burgo-Black AL. Post deployment care for returning combat veterans. J Gen Intern Med. 2012;27(9):1200–9.
Drummet AR, Coleman M, Cable S. Military families under stress: implications for family life education. Fam Relat. 2003;52(3):279–87.
Kitchiner NJ, Roberts NP, Wilcox D, Bisson JI. Systematic review and meta-analyses of psychosocial interventions for veterans in the military. Eur J Psychotraumatol. 2012;3(1):19267.
Hundt NE, Barrera TL, Robinson A, Cully JA. A systematic review of cognitive behavioural therapy for depression in veterans. Mil Med. 2014;179(9):942–9.
PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.
Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]. The Cochrane Collaboration. 2011. http://handbook.cochrane.org/. Accessed 14 Jan 2016.
Veterans Affairs Canada. Definition of a veteran. Government of Canada. 2015. Available at: http://www.veterans.gc.ca/eng/about-us/definition-veteran.
Szymendera SD. Who is a “Veteran”?—basic eligibility for veterans’ benefits. (CRS Report R42324). Washington, DC: Congressional Research Service; 2015.
Ministry of Defence. The armed forces covenant. The Ministry of Defence UK. 2013. Available at: https://www.gov.uk/government/publications/the-armed-forces-covenant.
British Psychological Society. A guide to psychosocial interventions in early stages of dementia. Division of Clinical Psychology. 2014.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Spitzer RL, Kroenke K, Williams JB, Lowe B, 7. A brief measure for assessing generalised anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092.
Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The alcohol use disorders identification test, guidelines for use in primary care, Department of Mental Health and Substance Dependence, World Health Organization. 2nd ed. 2001.
Novaco RW. The novaco anger scale and provocation inventory (NAS-PI) manual. Los Angeles: Western Psychological Services; 2003.
Wilson BD. Practical meta-analysis effect size calculator [Online calculator]. 2017. Available at: https://www.campbellcollaboration.org/this-is-a-web-based-effect-size-calculator/explore/this-is-a-web-based-effect-size-calculator.
Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960;23:56–62.
Beck AT, Steer RA, Brown GK. Manual for the Beck depression inventory-II. San Antonio: Psychological Corporation; 1996.
Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA. Manual for the state-trait anxiety inventory. Palo Alto: Consulting psychologists press; 1983.
Beck AT, Steer RA. Beck anxiety inventory manual. San Antonio: Psychological corporation; 1993.
Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67:361–70.
Novaco RW. Dimensions of anger reactions. Irvine: University of California; 1975.
Spielberger CD. Manual for the state-trait anger inventory (STAXI). Odessa: Psychological assessment resources; 1988.
Sobell LC, Sobell MB. Timeline Follow-back: a technique for assessing self-reported ethanol consumption. In: Allen J, Litten RZ, editors. Measuring Alcohol Consumption: Psychosocial and Biological Methods. Totowa: Humana Press; 1992. p. 41–72.
Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.
Higgins JPT, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s Tool for assessing risk of bias in randomised trials. BMJ. 2011. doi:10.1136/bmj.d5928.
Centre for Reviews and Dissemination. Systematic reviews: CRD’s guidance for undertaking reviews in healthcare. York: University of York; 2009.
Review Manager (RevMan). Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration. 2014.
Cohen J. A power primer. Psychol Bull. 1992;112(1):155–9.
Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme. Lancaster University. 2006.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis.1st ed. West Sussex: Wiley; 2009.
Egger M, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997. doi:10.1136/bmj.315.7109.629.
This paper is part of the doctoral project of the first author (LO), who is funded by a doctoral research training fellowship, funded as part of the Hidden Wounds Programme and funded by the Libor Fund to the Help for Heroes charity in partnership with the University of Exeter.
Availability of data and materials
The manuscript was drafted by LO with substantial input from EW and PF. All authors had input with the development of the protocol, search strategy, data extraction and analysis, as well as input in the final write up of the protocol. All authors read and approved the final manuscript.
LO is a PhD candidate researching low-intensity interventions for armed forces veterans and their family members. EW is a professor of experimental and applied clinical psychology. PF is a professor of psychology and a cognitive behavioural psychotherapist.
The authors declare that they have no competing interests.
Ethical approval and consent to participate
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
O’Shea, L., Watkins, E. & Farrand, P. Psychological interventions for the treatment of depression, anxiety, alcohol misuse or anger in armed forces veterans and their families: systematic review and meta-analysis protocol. Syst Rev 6, 112 (2017). https://doi.org/10.1186/s13643-017-0513-8
- Armed forces
- Alcohol misuse
- Systematic review
- Military family