- Open Access
- Open Peer Review
Psychological treatments for common mental health problems experienced by informal carers of adults with chronic physical health conditions (Protocol)
Systematic Reviewsvolume 2, Article number: 9 (2013)
Improved life expectancy is resulting in increased outpatient treatment of people with chronic physical health conditions and reliance on the provision of informal care in the community. However, informal care is also associated with increased risk of experiencing common mental health difficulties such as depression and anxiety. Currently there is a lack of evidence-based treatments for such difficulties, resulting in poor health outcomes for both the informal carer and care recipient.
Electronic databases will be systemically searched for randomised controlled trials examining the effectiveness of psychological interventions targeted at treating depression or anxiety experienced by informal carers of patients with chronic physical health conditions. Database searches will be supplemented by contact with experts, reference and citation checking and grey literature. Both published and unpublished research in English language will be reviewed with no limitations on year or source. Individual, group and patient-carer dyad focused interventions will be eligible. Primary outcomes of interest will be validated self-report or clinician administered measures of depression or anxiety. If data allows a meta-analysis will examine: (1) the overall effectiveness of psychological interventions in relation to outcomes of depression or anxiety; (2) intervention components associated with effectiveness.
This review will provide evidence on the effectiveness of psychological interventions for depression and anxiety experienced by informal carers of patients with chronic physical health conditions. In addition, it will examine intervention components associated with effectiveness. Results will inform the design and development of a psychological intervention for carers of people with chronic physical health conditions experiencing depression and anxiety.
PROSPERO registration number: CRD42012003114
Advances in public health and medical technology have resulted in continued increases in life expectancy across developed countries . Within the UK alone the projected rise in adults aged over 80 years is due to rise from 2.9 million adults in 2010 to 5.9 million in 2035 . These increases in life expectancy are presenting significant challenges to existing healthcare systems with regards to the management and treatment of patients with chronic or disabling illnesses [1, 3]. This is manifesting itself in an increased reliance on informal carers as a fundamental part of patient management which has become important following an increasing emphasis upon outpatient treatment of patients with chronic physical health conditions . Currently around 5 million people in the UK provide informal care to someone with a physical or mental health difficulty .
The shift to outpatient treatment alongside a concomitant increase in the role of informal carer in patient management and treatment has led to a reduction in patient hospital and physician care as well as delaying the receipt of nursing home care . However given demands associated with supporting the treatment and recovery of patients with a physical or mental health difficulty now being placed upon informal carers, the potential is that costs are simply being shifted elsewhere. Informal care is not only associated with greater risks of poor mental and physical health [7–10] but additional personal and societal costs arising from reductions in hours of paid work, restriction in social and recreational activities , and sleep disturbances . Additionally poor mental health in carers may also negatively impact on outcomes associated with the care recipient .
A clear need therefore exists to develop evidence-based psychological interventions to support the long-term emotional needs of informal carers. However such long-term emotional needs of carers have been neglected across a range of chronic physical health conditions [14–18]. Furthermore, services that do exist to provide emotional support are often inadequately developed and are generally not tailored to address the unique difficulties carers’ experience . Such difficulties may include the management of behavioural problems , physical impairments , cognitive decline  and the development of communication techniques . Developing interventions have however potentially been hindered given that the needs of carers often change dependent upon the course of the chronic physical health condition of the care recipient, the setting care is provided in and length of time care has been provided . Recognition of the unique and multifaceted needs of informal carers has led to the suggestion that multicomponent interventions are required [17, 23].
A number of meta-analyses have been undertaken to identify factors associated with positive outcomes in informal carers, such as caregiver burden, knowledge, depression and symptoms of care recipients. Commonly such meta-analyses have included a large number of potential factors, such as respite and day care, knowledge and training, group- and individual-based interventions, type of setting and various caregiver characteristics . Additionally they have focused upon a variety of specific patient carer groups such as stroke , cancer  and dementia [23, 27]. Far less attention has however been directed towards identifying specific psychological interventions that may be targeted at the treatment of depression and anxiety. Where this focus has been included within the meta-analysis as treatment moderators, psychological treatments mostly consistent with elements of cognitive behavioural therapy (CBT) have been identified to have a small effect on caregiver depression [24, 28]. Furthermore, one review has identified cognitive reframing, a specific component commonly found within CBT, as an intervention component promising for depressed informal carers of dementia patients .
To date little research has sought to identify specific intervention components that have been utilised in interventions targeting depression and anxiety in carers of adults with chronic physical health conditions. Additionally, when such components have been identified through approaches such as systematic reviews, it has been reported that too little attention has then been paid to identifying the specific components associated with effectiveness [29, 30]. Recent systematic reviews have therefore examined not only the overall effectiveness of interventions but also the specific intervention components associated with their effectiveness [30, 31]. This systematic review therefore seeks to examine both the overall effectiveness of psychological interventions for depressed or anxious carers and specific intervention components associated with effectiveness. The identification of effective intervention components utilised in interventions targeting depression and anxiety in carers of adults with chronic physical health conditions is an important next step to inform the future design and development of evidence-based treatments.
First, to undertake a comprehensive systematic review and meta-analysis examining the effectiveness of psychological interventions targeted at treating emotional difficulties, such as depression or anxiety, across a range of carer-care recipient populations. Second, to identify intervention components associated with effectiveness. The results of the systematic review will also be used to feed into the development of an evidence-based complex intervention for carers of people with chronic physical health conditions using the Medical Research Council’s (MRC) guidance [32, 33].
The review will follow the Centre for Reviews and Dissemination (CRD) guidance on undertaking systemic reviews  and be reported to established criteria . The review is registered with the PROSPERO International Prospective Register of Systematic Reviews (registration number CRD42012003114).
Inclusion and exclusion criteria
Eligible populations are informal adult (aged 16 years and older) carers of adults with chronic physical health conditions who are experiencing depression or anxiety. Formal diagnosis of depression or anxiety will not be required. No limitations will be placed on severity of depression or anxiety (though it is estimated carers will be depressed or anxious), length of time caring, chronic physical health condition of the person cared for, or relationship to person cared for. Informal carers will be defined as non-professionals who support people who are sick, infirm or disabled . Commonly this group is made up of the patients’ close family, however non-family informal carers will be eligible for inclusion. Given the recognition that provision of care is dynamic and fluctuates from providing intensive assistance on a daily basis to more infrequent support no constraints will be placed on how much assistance informal carers provide .
The review will include psychological or psychosocial interventions that are targeted at depression or anxiety. There will be no limitation in terms of psychological theory informing the intervention, the person delivering the intervention or the setting in which the intervention is delivered. Group, one-to-one and unsupported interventions will be included. Interventions for the carer-patient dyad will also be included as long as a target of the intervention is carer depression or anxiety.
Only interventions compared with an inactive control will be considered. This may include: a waiting list control; treatment-as-usual (normally defined as standard care provided by a general practitioner/family doctor); no treatment and attention-controls. Interventions compared with another active intervention will not be eligible for inclusion.
Studies eligible for inclusion will have a primary or secondary outcome measurement of a validated self-report or clinician administered measure of depression or anxiety that elicits continuous data. Outcomes of caregiver burden and quality of life will also be examined. Dropout rates will also be recorded. Outcomes for any time period will be eligible for inclusion. However, in the case of studies reporting multiple time points the follow-up time point used for analysis will be the longest time point ≤6 months.
Only randomised controlled trials using a method of random sequence generation and allocation concealment assessed as low or unclear risk of bias using the Cochrane Collaboration’s Risk of Bias tool  will be included within the review.
A comprehensive search will be conducted on the following electronic databases: Cumulative Index to Nursing and Allied Health Literature (CINAHL); Excerpta Medica DataBase (EMBASE); PsychInfo; Medline; Social Science Citation Index; Applied Social Sciences Index and Abstracts (ASSIA) and the Cochrane Central Register of Controlled Trials (CENTRAL). Reference lists and citations will be hand searched for all included studies to identify further studies. The results of the database searches will be analysed to identify journals that contain the largest number of included studies which will be hand searched for recent publications and conference abstracts (less than 12 months). Trial registers http://www.ClinicalTrials.gov and http://www.who.int/trialsearch/ will also be searched to identify on-going or unpublished trials. Experts in the field will be contacted to further identify unpublished or ongoing trials. An information specialist was consulted to build the search strategy using medical subject headings (MeSH). The Ovid MEDLINE search strategy can be found in Additional file 1.
All titles and abstracts will be screened by JW and a second researcher. Full paper review to determine inclusion will be conducted independently by JW and PF. Cohen’s Kappa will be calculated to determine agreement in selecting studies in accordance with the exclusion / inclusion criteria. Any discrepancies will be resolved by discussion and, if consensus cannot be reached, a third member of the research team will make the final decision.
Data extraction will be conducted by JW and a researcher not associated with the research team. Discrepancies will be discussed and if consensus is not reached discussion will be held with PF. A data extraction form specifically for this review has been developed upon guidance from the CRD .
To meet the second objective of the review there will also be a specific focus on extracting information relating to intervention components and patient characteristics in addition to the standard extraction of information (for example, identification features, study characteristics, primary outcome measurements, statistical approaches and primary results). Intervention components extracted from the data are partially based upon those used in a previous review examining intervention components associated with increased effectiveness in diet and physical activity interventions . Specifically the following will be extracted: (1) theoretical framework (for example, cognitive therapy, behaviour therapy, interpersonal therapy, psychodynamic therapy); (2) behaviour change techniques (for example, problem solving, goal setting, relapse prevention) based on a taxonomy of 137 behaviour change techniques ; (3) mode of delivery (for example, individual face-to-face, telephone, email, group, unsupported self-help); (4) group size for group-based interventions; (5) clinician delivering treatment (for example, nurse, general practitioners, clinical psychologist); (6) training received by the clinicians delivering the treatment; (7) treatment intensity (for example, duration of treatment, number of sessions, length of sessions); (8) whether the treatment is manualised (yes or no); (9) measurement of treatment integrity (yes or no); and (10) treatment setting (for example, primary care, secondary care). In addition, specific characteristics will be extracted for both the carer (for example, age, ethnicity, severity of depression or anxiety at baseline, length of time caring, relationship to person cared for and receipt of formal care in the home) and the adult with the chronic physical health condition (for example, age, chronic physical health condition, severity of chronic physical health condition and mental health and other chronic physical health co-morbidities). The data extraction form can be found in Additional file 2.
Intervention components will be extracted from published papers however all authors will also be contacted to obtain trial protocols and treatment manuals associated with the delivery of the intervention to enable more detailed coding to take place. Interventions will be coded by JW and PF independently and discrepancies will be resolved through discussion and if required a third researcher will be consulted.
The Cochrane Collaboration’s Risk of Bias tool  will be adopted to appraise the methodological quality of the included studies. This will be undertaken independently by JW and a reviewer not associated with the research team. Ratings will be compared and any discrepancies discussed, and if consensus is not reached, further discussion will be held with PF. The tool will examine risk of selection, performance, attrition and reporting bias. To detect reporting bias attempts will be made to obtain study protocols for all included studies either via published protocols, trial databases or emailing the study authors. Comparisons will be made with the outcome measurements reported in the protocol and the paper. In addition, outcomes reported in the methods section will be compared with outcomes reported in the results section. In the event of discrepancies study authors will be contacted to identify potential reasons, such as changes to the study protocol, or to request missing data. In addition, the quality of primary outcome measures and whether a power calculation was conducted will be assessed. The quality of outcome measurements used will be examined in terms of reliability through internal consistency and test-retest reliability . Only studies using outcome measurements of at least acceptable internal consistency and test-retest reliability (Cronbach’s alpha ≥0.70) will be included . All findings will be summarised within a table to allow easy comparison across studies.
Data synthesis and analysis
Effect size estimates
If possible with available data, a meta-analysis will be conducted using Comprehensive Meta-Analysis Version 2.0 . Post-treatment between group standardised mean difference effect size will be calculated using Hedges’ g from the outcomes relating to depression, anxiety, quality of life and caregiver burden separately. Where multiple time points are reported the longest follow-up time point will be taken ≤6 months. Means and standard deviations of post-outcome measurement scores will be requested from authors if not reported within the paper. Heterogeneity is expected and therefore a random-effect model will be used. In the event that there is no evidence of heterogeneity between studies a fixed-effect model will be selected. The presence of statistically significant heterogeneity will be examined using Cochrane’s test of heterogeneity (Q statistic) and the I2 statistic will also be reported to quantify the degree of heterogeneity [42, 43]. I2 values of heterogeneity will be considered low, moderate or high using cutoffs of 25%, 50% and 75%, respectively . If intention-to-treat data are available these will be used to calculate effect sizes, with completer used when intention-to-treat data are unavailable. With studies that compare two treatment conditions that are eligible for inclusion, comparisons will be analysed separately with the sample size within the control condition halved. Comparisons will be analysed separately with the sample size within the intervention arm halved when two control conditions are included.
Egger’s Test of the Intercept  will be used to examine funnel plot asymmetry to investigate possible publication bias and other potential sources of asymmetry (for example, language bias, potential inclusion of small studies with poor methodological rigour, heterogeneity) . Egger’s Test of the Intercept will only be conducted if a minimum of 10 studies are included within the meta-analysis . The trim and fill procedure  will be used to calculate an effect size taking into account potential publication bias.
Sensitivity analyses will be undertaken to examine the extent to which results obtained may be influenced by the selective reporting of outcomes. The maximum bias bound approach [47–50] will be adopted with new treatment effect and confidence intervals calculated by adding the bias bound value to the original pooled effect estimate to examine the robustness of findings . Further sensitivity analysis will also be conducted by temporarily dropping from the analysis: small studies (n ≤20); unpublished studies; studies with high attrition (≥30%); and studies where outcome measurements of depression and anxiety are reported as primary or secondary outcome measurements to examine whether results remain consistent.
When number of studies addressing particular moderators permit, moderator analysis will be undertaken to examine intervention components, methodological and participant characteristics of studies associated with effectiveness. Specifically the following moderators will be examined: (1) chronic physical health condition of the care recipient; (2) theoretical framework (for example, cognitive therapy, behaviour therapy); (3) behaviour change techniques used (for example, problem solving, goal setting, relapse prevention); (4) mode of delivery (for example, individual face-to-face, telephone, group); (5) duration of treatment; (6) number of treatment sessions; (7) baseline severity of depression or anxiety; (8) diagnosis of depression or anxiety (yes or no); (9) recruitment setting. Moderators will be examined through subgroup analysis with standardised mean difference effect sizes calculated using Hedges’ g statistic using a random-effects model. Q and I2 statistics will also be reported as a measure of heterogeneity. Consistent with other meta-analyses [51, 52] subgroup analyses will be considered statistically significant if a P value of ≤0.10 is obtained. In the event that there is not enough information in relation to components of interventions to support a meta-analysis  a narrative synthesis will be undertaken to summarise these findings.
This review will examine the effectiveness of psychological interventions for informal carers of people with chronic physical health conditions experiencing depression or anxiety. Currently there is no comprehensive review of psychological interventions for informal cares that also systematically examines both the quality of available evidence and intervention components associated with effectiveness. Thereby this review seeks to both examine gaps in the evidence base for future research and also to map intervention components associated with effectiveness. The identification of specific intervention components associated with effectiveness will aid the translation of the existing evidence to the development of new interventions optimising these components. Thus, the mapping of such components is a first step towards developing a psychological treatment for informal carers that maximises the use of behavioural change techniques and delivery factors associated with effectiveness in order to meet objectives within Phase I of the MRC’s guidance [32, 33] for developing complex interventions.
Applied Social Sciences Index and Abstracts
Cognitive behavioural therapy
Cochrane Central Register of Controlled Trials
Cumulative Index to Nursing and Allied Health Literature
Centre for Reviews and Dissemination
Excerpta Medica DataBase
Medical Subject Headings
Medical Research Council
International prospective resister of systematic reviews.
Christensen K, Doblhammer G, Rau R, Vaupel JW: Ageing populations: the challenges ahead. Lancet. 2009, 374: 1196-1208. 10.1016/S0140-6736(09)61460-4.
Office of National Statistics: An Executive summary, 2010-based NPP Reference Volume. 2012, London: The Stationery Office
Lubitz J, Cai L, Kramarow E, Lentzner H: Health, life expectancy, and health care spending among the elderly. New Engl J Med. 2003, 349: 1048-1055. 10.1056/NEJMsa020614.
Wakefield BJ, Hayes J, Boren SA, Pak Y, Davis JW: Strain and satisfaction in caregivers of veterans with chronic illness. Res Nurs Health. 2012, 35: 55-69. 10.1002/nur.21456.
NHS Information Centre: Survey of Carers in households in England 2009/10. 2010, Leeds: The NHS Information Centre for Health and Social Care
Van Houtven CH, Norton EC: Informal care and health care use of older adults. J Health Econ. 2004, 23: 1159-1180. 10.1016/j.jhealeco.2004.04.008.
Pinquart M, Sörensen S: Differences between caregivers and noncaregivers in psychological health and physical health: a meta-analysis. Psychol Aging. 2003, 18: 250-267.
Coe NB, van Houtven CH: Caring for mom and neglecting yourself? The health effects of caring for an elderly parent. Health Econ. 2009, 18: 991-1010. 10.1002/hec.1512.
Shaw WS, Patterson TL, Semple SJ, Ho S, Irwin MR, Hauger RL, Grant I: Longitudinal analysis of multiple indicators of health decline among spousal caregivers. Ann Behav Med. 1997, 19: 101-109. 10.1007/BF02883326.
Canniscio CC, Jones C, Kawachi I, Colditz GA, Berkman L, Rimm E: Reverberations of family illness: a longitudinal assessment of informal caregiving and mental health status in the Nurses’ Health Study. Am J Public Health. 2002, 92: 1305-1311. 10.2105/AJPH.92.8.1305.
Salva J, Almeida DM, Davey A, Zarit SH: Routine assistance to parents: effects on daily mood and other stressors. J Gerontol B Psychol Sci Soc Sci. 2008, 63: S154-S161. 10.1093/geronb/63.3.S154.
Phillips AC, Gallager S, Hunt K, Der G, Carroll D: Symptoms of depression in non-routine caregivers: the role of caregiver strain and burden. Br J Clin Psychol. 2009, 48: 335-346. 10.1348/014466508X397142.
Perrin PB, Heesacker M, Stidham BS, Rittman MR, Gonzalez-Rothi LJ: Structural equation modeling of the relationship between caregiver psychosocial variables and functioning of individuals with stroke. Rehabil Psychol. 2008, 53: 54-62.
Murray J, Young J, Forster A, Ashworth R: Developing a primary care-based stroke model: the prevalence of longer-term problems experienced by patients and carers. Br J Gen Pract. 2003, 53: 803-807.
Simon C, Kumar S, Kendrick T: Formal support of stroke survivors and their informal carers in the community: a cohort study. Health Soc Care Community. 2008, 16: 582-592. 10.1111/j.1365-2524.2008.00782.x.
Simon C, Kumar S, Kendrick T: Cohort study of informal carers of first-time stroke survivors: profile of health and social changes in the first year of caregiving. Soc Sci Med. 2009, 699: 404-410.
Wilkinson AM, Lynn J: Caregiving for advanced chronic illness patients. Tech Reg Anesth Pain Manag. 2005, 9: 122-132.
Arksey H, Hirst M: Unpaid carers’ access to and use of primary care services. Prim Health Care Res Dev. 2005, 6: 101-116. 10.1191/1463423605pc230oa.
Lundh U: Family carers, 4: Designing services to support family carers in Sweden. Br J Nurs. 1999, 8: 787-790.
Pinquart M, Sörensen S: Associations of stressors and uplifts of caregiving with caregiver burden and depressive mood: a meta-analysis. J Gerontol B Psychol Sci Soc Sci. 2003, 58: 112-128. 10.1093/geronb/58.2.P112.
Vernooij-Dassen M, Draskovic I, McCleery J, Downs M: Cognitive reframing for carers of people with dementia. Cochrane Database Syst Rev. 2011, 11: CD005318-
Rosland AM, Piette JD: Emerging models for mobilizing family support for chronic disease management: a structured review. Chronic Illn. 2010, 6: 7-21. 10.1177/1742395309352254.
Brodaty H, Green A, Koschera A: Meta-analysis of psychosocial interventions for caregivers of people with dementia. J Am Geriatr Soc. 2003, 51: 657-664. 10.1034/j.1600-0579.2003.00210.x.
Sörensen S, Pinquart M, Duberstein P: How effective are interventions with caregivers? An updated meta-analysis. Gerontologist. 2002, 42: 356-372. 10.1093/geront/42.3.356.
Legg LA, Quinn TJ, Mahmood F, Weir CJ, Tierney J, Stott DJ, Smith LN, Langhorne P: Non-pharmacological interventions for caregivers of stroke survivors (review). Cochrane Database Syst Rev. 2011, 10: CD008179-
Hopkinson JB, Brown JC, Okamoto I, Addington-Hall JM: The effectiveness of patient-family carer (couple) interventions for the management of symptoms and other health-related problems in people affected by cancer: a systematic literature search and narrative review. J Pain Symptom Manage. 2012, 43: 111-142. 10.1016/j.jpainsymman.2011.03.013.
Van Mierlo LD, Meiland FJ, Van der Roest HS, Dröes RM: Personalised caregiver support: effectiveness of psychosocial interventions in subgroups of caregivers of people with dementia. Int J Geriatr Psychiatry. 2012, 27: 1-14. 10.1002/gps.2694.
Pinquart M, Sörensen S: Helping caregivers of persons with dementia: which interventions work and how large are their effects?. Int Psychogeriatr. 2006, 18: 577-595. 10.1017/S1041610206003462.
Cane J, O’Connor D, Michie S: Validation of the theoretical domains framework for use in behaviour change and implantation research. Implement Sci. 2012, 7: 37-10.1186/1748-5908-7-37.
Lorencatto F, West R, Michie S: Specifying evidence-based behavior change techniques to aid smoking cessation in pregnancy. Nicotine Tob Res. 2012, 14: 1019-1026. 10.1093/ntr/ntr324.
Greaves CJ, Sheppard KE, Abraham C, Hardeman W, Roden M, Evans PH, Schwarz P, IMAGE Study Group: Systematic review of reviews of intervention components association with increased effectiveness in dietary and physical activity interventions. BMC Public Health. 2011, 11: 119-10.1186/1471-2458-11-119.
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhater D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Pettcrew M: Development and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.
Centre for Reviews and Dissemination (CRD): Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2009, York: University of York, 3
Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group: Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.
Singleton N, Aye Maung N, Cowie A, Sparks J, Bumpstead R, Meltzer H: Mental health of carers. 2002, London: The Stationery Office
Szinovacz ME, Davey A: Changes in adult child caregiver networks. Gerontologist. 2007, 47: 280-295. 10.1093/geront/47.3.280.
Higgins J, Altman DG: Assessing risk of bias in included studies. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JP, Green S. 2008, Chichester: John Wiley & Sons, 187-241.
Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behavioural change techniques. Appl Psychol. 2008, 57: 660-680. 10.1111/j.1464-0597.2008.00341.x.
Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. HTA. 1998, 2: 14-
Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-analysis Version 2. 2005, Englewood, NJ: Biostat
Higgins JP, Thompson SG: Quantifying heterogeneity in meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.
Higgins JP, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.
Egger M, Davey Smith G, Schneider M, Minder C: Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997, 315: 629-634. 10.1136/bmj.315.7109.629.
Sterne JAC, Gavaghan D, Egger M: Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000, 53: 1119-1129. 10.1016/S0895-4356(00)00242-0.
Duval S, Tweedie R: Trim and fill: A simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56: 455-463. 10.1111/j.0006-341X.2000.00455.x.
Copas J, Jackson D: A bound for publication bias based on the fraction of unpublished studies. Biometrics. 2004, 60: 146-153. 10.1111/j.0006-341X.2004.00161.x.
Williamson PR, Gamble C: Application and investigation of a bound for outcome reporting bias. Trials. 2007, 8: 9-10.1186/1745-6215-8-9.
Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, Williamson PR: The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010, 40: c365-
Dwan K, Gamble C, Kolamunnage-Dona R, Mohammed S, Powell C, Williamson PR: Assessing the potential for outcome reporting bias in a review: a tutorial. Trials. 2010, 11: 52-10.1186/1745-6215-11-52.
Hesser H, Weise C, Zetterqvist Westin V, Andersson G: A systematic review and meta-analysis of randomized controlled trials of cognitive-behavioral therapy for tinnitus distress. J Clin Psychol. 2011, 31: 545-553.
Farrand P, Woodford J: Impact of support on effectiveness of written behavioural self-help: A systematic review and meta-analysis of randomised controlled trials. J Clin Psychol. 2013, 33: 182-195.
This paper is supported by the Dunhill Medical Trust in the form of a doctoral research training fellowship awarded to the first author (JW). The Dunhill Medical Trust is a member of the Association of Medical Research Charities AMRC and a National Institute for Health Research (NIHR) recognised non-commercial partner.
The authors declare that they have no competing interests.
JW conceived and designed the study protocol and wrote the manuscript. PF contributed to the conception, design and had substantial involvement in the drafting of the manuscript. DR and DL made contributions to the design, critical evaluation of intellectual content and assisted with drafting the manuscript. All authors have approved the final manuscript.