- Open Access
- Open Peer Review
Screening for depression in women during pregnancy or the first year postpartum and in the general adult population: a protocol for two systematic reviews to update a guideline of the Canadian Task Force on Preventive Health Care
Systematic Reviewsvolume 8, Article number: 27 (2019)
In 2018, the World Health Organization reported that depression is the most common cause of disability worldwide, with over 300 million people currently living with depression. Depression affects an individual’s physical health and well-being, impacts psychosocial functioning, and has specific negative short- and long-term effects on maternal health, child health, developmental trajectories, and family health. The aim of these reviews is to identify evidence on the benefits and harms of screening for depression in the general adult population and in pregnant and postpartum women.
Search strategies were developed and tested through an iterative process by an experienced medical information specialist in consultation with the review team. We will search MEDLINE, Embase, PsycINFO, CINAHL, and the Cochrane Library, and a randomized controlled trial filter will be used. The general adult review will be an update of a systematic review previously used by the Canadian Task Force on Preventive Health Care for their 2013 guideline recommendation. The search strategy will be updated and will start from the last search date of the previous review (May 2012). The pregnant and postpartum review will be a de novo review with no date restriction. For both reviews, we will search for unpublished documents following the CADTH Grey Matters checklist and relevant websites. Titles and abstracts will be screened using the liberal accelerated method. Two reviewers will independently screen full-text articles for relevance using pre-specified eligibility criteria and assess the risk of bias of included studies using the Cochrane Risk of Bias tool. Outcomes of interest for the general adult population review include symptoms of depression or diagnosis of major depressive disorder, health-related quality of life, day-to-day functionality, lost time at work/school, impact on lifestyle behaviour, suicidality, false-positive result, labelling/stigma, overdiagnosis or overtreatment, and harms of treatment. Outcomes of interest for the pregnant and postpartum review include mental health outcomes (e.g. diagnosis of major depressive disorder), parenting outcomes (e.g. mother-child interactions), and infant outcomes (e.g. infant health and development).
These two systematic reviews will offer informative evaluations of depression screening. The findings will be used by the Task Force to help develop guideline recommendations on depression screening in the general adult population and in pregnant and postpartum women in Canada.
Systematic review registration
PROSPERO (CRD42018099689, CRD42018099690)
Depression is a mood disorder characterized by states of sadness and feelings of worthlessness or emptiness and accompanied by physical symptoms such as decreased activity, poor appetite, and poor sleep serious enough to impair functioning in social, occupational, educational, or other situations . The current definition of a major depressive episode (MDE) is based on one of two classifications : DSM-5  and ICD-10 . The DSM-5 includes additional criteria to define major depressive disorder (MDD) (see Additional file 1). The DSM-5 allows for a specifier for depressive episodes that have their onset in pregnancy or within 4 weeks postpartum, collectively termed major depressive episodes, with peripartum onset. Of note, a woman can still meet criteria for depression in pregnancy or postpartum even if the onset did not occur within the “peripartum onset” time frame. In clinical practice and research, depression occurring up to 1 year postpartum is generally considered “postpartum depression” .
General adult population
Depression is the most common cause of disability worldwide, with over 300 million people now living with depression, an increase of more than 18% between 2005 and 2015 . Estimates of prevalence for depression vary by characteristics such as age and sex. For example, women are more likely to suffer from major depressive disorders than men [7, 8]. Many studies report depression rates based on results from self-reported screening questionnaires, rather than validated diagnostic interviews, but this is known to exaggerate rates substantially and to blur distinctions between low- and high-prevalence groups . The 2012 Canadian Community Health Survey-Mental Health used the diagnostic interview technique among 25,113 individuals and reported annual prevalence for major depressive disorder (MDD) of 3.9% (95% CI 3.5–4.2%) and lifetime prevalence of 9.9% (95% CI 9.3–10.5%) . It also reported an annual and lifetime prevalence of MDE among Canadians at 4.7% and 11.3%, respectively . Another 2012 Canadian national health survey reported the highest rate of a MDE was among 15–24-year-olds, with 7% having had depression in the past year, compared to 5% in people aged 25–64 years, and 2% in those 65 years and older .
There are several risk factors that have been associated with depression in adults. Socio-demographic risk factors include sex, age, marital status, low socioeconomic status, and low education level [8, 12,13,14]. In Canada, the largest difference between sexes is in the 15–24 age range, with the difference diminishing and nearly disappearing at more advanced ages . Additionally, married and never-married individuals experience less depression than those who are separated, divorced, and widowed . Other factors such as trauma early in life (e.g. neglect or sexual abuse), chronic disease (e.g. cancer, cardiovascular disease), previous history of depression, and a family history of depression have also been linked to depression [8, 16, 17].
Consequence of depression
Depression affects a person’s physical health and well-being and impacts psychosocial functioning (e.g. personal relationships, employment). A review by Evans et al.  conclude that there may be a bidirectional link between depression and disease, as depression might be an etiologic factor for new disease (e.g. stroke) and also might affect the course of existing chronic diseases such as diabetes mellitus. Depression can affect work performance through absenteeism and presenteeism (decreased work productivity while at work), which is a large cost to employers in terms of productivity . In addition, many depressed individuals are unable to enter the workforce. On a population level, it also has a large societal impact through increased health service utilization, decreased work productivity, increased burden on family members, and increased resource costs related to disability . In the 2003 Canadian Community Health Survey, the total economic burden of mental illness (including health service utilization, long- and short-term work loss, and health-related quality of life) was said to be $51 billion dollars . More recently, direct healthcare costs associated with MDD were determined using a population-based cohort study in Ontario, Canada. The age- and sex-adjusted annual per-capita cost among those with MDD was higher than the comparison group (those without MDD or psychological distress) [$3914 (95%CI $2943–4888) vs $3206 (95%CI $2820–3591)], and the population-wide excess cost for those with MDD was $256 million (prices converted to CDN $ from reported USD) .
Although effective interventions to reduce the effects of depression exist, individuals need to be identified to benefit from these interventions. The Mental Health Commission of Canada reports that almost half of those who feel they have suffered from depression or anxiety have not seen a doctor about this problem . In addition, among those who have been diagnosed accurately, many do not receive minimally adequate treatment [21, 22].
In 2013, the Canadian Task Force on Preventive Health Care (CTFPHC) recommended to not routinely screen for depression (this was based on very-low-quality evidence; see Additional file 2). There is disagreement in recommendations between Canada, the USA, and the UK. Neither the CTFPHC nor the United Kingdom National Screening Committee (UKNSC) recommended screening, whereas the US Preventive Services Task Force (USPFTF) recommended screening based on prioritization of linked evidence of effective follow-up and treatment of screen-identified individuals. Additional file 2 provides additional on how the USPSTF recommendation differs from Canada and the UK, followed by some speculation as to why .
Pregnant and postpartum population
Although estimates of the prevalence of major depression should be based on validated diagnostic interviews, many studies report depression rates based on results from self-reported symptom questionnaires and other non-valid methods . An Agency for Healthcare Research and Quality SR reported that the period prevalence of major depression during pregnancy (conception to birth) was 12.7% (95%CI 7.1–20.4%) . However, this is based on one primary study. The period prevalence from birth to 3 months postpartum was 7.1% (4.1–11.7%) . A recent US study in which women were interviewed, and diagnosis made using the DSM-IV criteria, found the 12-month period prevalence of MDD to be 8.4% among women who were currently pregnant or had been pregnant in the past 12 months, 9.3% among postpartum women, and 8.1% among non-pregnant women . It should be noted that the prevalence for postpartum women could include time in which they were pregnant, as it covers the previous 12 months.
There are many risk factors for depression during pregnancy, including younger age, a history of depression, exposure to domestic violence, increased life stressors, a lack of social support, unintended pregnancy, lower income, lower education, smoking, single status, and poor relationship quality [26, 27]. Prior depression is the greatest risk factor for postpartum depression. Nevertheless, for women who experience postpartum depression, it is a first episode among 40% . Other postpartum risk factors include untreated depression or anxiety during pregnancy, experiencing a stressful life event during pregnancy, having a traumatic birth experience, preterm birth or infant admission to neonatal intensive care, low levels of social or partner support, experiencing domestic violence, low socioeconomic status, obstetric complications, low birth weight, and breastfeeding problems .
Consequence of pregnancy and/or postpartum depression
While the prevalence of depression in women during pregnancy and the first year postpartum may be similar to that for other women , depression has specific negative short- and long-term effects on maternal health, child health and development, and on the overall health of families . Depression during pregnancy is associated with unhealthy behaviours including poor self-care, poor nutrition, increased use of tobacco and alcohol, lower prenatal care seeking, and poorer maternal-fetal bonding [30, 31]. Postpartum depression may lead to difficulties with infant care, a decrease in breastfeeding initiation, and poor-quality mother-child interactions including mutual touching, smiling, and vocalizations, and compromised mother-child bonding [30, 32, 33]. Negative outcomes for infants in mothers with prenatal and postpartum depression may also include preterm delivery, lower birth weight, cognitive, emotional, social, neural functioning or developmental delay [34,35,36,37].
Almost half of Canadians with depression have not seen a primary care provider about their depression ; for depression in pregnancy and postpartum, the number may be even higher . Screening for depression, if effective, would allow for treatment among women who would not otherwise be identified and possibly lessen the negative impacts to the mother, fetus/infant, and family. Several treatment options exist, including psychosocial strategies (e.g. peer support, non-directive counselling and self-care such as exercise), psychological therapies, and antidepressant medications [36, 37]. The last poses the additional challenge of considering the safety of exposure to psychotropic medications to the baby in utero and through breast milk .
Current practice and recommendations
Across Canada, there is a lack of consensus on how and when prenatal and postpartum depression screening should occur with different provinces and territories having different approaches. Additional file 2 provides examples on how the provinces of Ontario, British Columbia, Alberta, Nova Scotia, and the territory of Nunavut screen women during pregnancy and postpartum. There is discordance in recommendations between Canada, the USA, and the UK. Neither the CTFPHC or UKNSC recommended screening in contrast to the USPFTF recommendation for screening on results that combined screening with treatment. Additional file 2 provides additional details on why the USPSTF recommendation may differ from Canada and the UK .
Definition of a controlled trial of screening intervention
The intent of a screening programme for depression would be to identify symptomatic disease that would not otherwise be identified or reported (i.e., by spontaneous patient self-report or clinical inquiry). Current approaches for depression screening are based on the use of questionnaires (e.g. Edinburgh Postnatal Depression Scale (EPDS), Patient Health Questionnaire (PHQ-9), Beck Depression Inventory) to identify people who may have undetected depression. If effective, screening for depression could reduce the health burden in those who otherwise would not be identified .
The following three eligibility criteria have been used when considering depression screening trials : (i) the patient population must be clearly defined and participants randomized prior to administering the screening test; (ii) patients who are known to have a current episode of depression or are already being treated for depression close to the time of eligibility assessment are excluded, as screening is intended to identify undetected cases and those who are known to have depression would not be screened in actual clinical practice; and (iii) similar depression management and treatment resources must be provided to patients in the screening arm of the trial and patients in the non-screening arm of the trial who are identified as depressed via other methods (e.g. unaided clinician diagnosis, patient report).
The CTFPHC is undertaking a systematic evaluation of the evidence to inform its guideline recommendations for depression screening during pregnancy and up to 1 year postpartum in primary health care settings in Canada and to provide an updated recommendation for the general adult population. This protocol outlines the methodological process for performing these two systematic reviews (SR) of the evidence on the benefits and harms of screening for depression. This protocol updates the 2013 McMaster Evidence Review and Synthesis Centre (ERSC) SR previously used by the CTFPHC  for their guideline recommendation on depression screening in adults , where the pregnant and postpartum population was considered as a subgroup of the general adult population. The scope of the forthcoming guideline has been revised to more formally consider women during pregnancy and postpartum. The analytic framework depicts the structure used to address the key questions for evaluating the benefits and harms of depression screening (see Figs. 1 and 2). We will use the following key questions to guide the SRs.
General adult population
Key question 1
What are the benefits and harms of screening versus no screening for depression in the general adult population in primary care or other non-mental health clinic settings?
Key question 1a
What are the benefits and harms of screening versus no screening for depression in the general adult population in primary care or other non-mental health clinic settings for patients targeted because they have characteristics that may suggest an elevated risk of depression? (characteristics as defined in primary studies, not including exclusion criteria).
Pregnant and postpartum population
Key question 1
What are the benefits and harms of screening versus no screening for depression during pregnancy and up to 1 year postpartum in primary care or other non-mental health clinic settings?
Key question 1a
What are the benefits and harms of screening versus no screening for depression during pregnancy and up to 1 year postpartum in primary care or other non-mental health clinic settings for patients targeted because they have characteristics that may suggest an elevated risk of depression? (characteristics as defined in primary studies, not including exclusion criteria (e.g. previous depression in pregnancy or postpartum)).
This systematic review is being conducted to inform a guideline on screening for depression. We will conduct a separate systematic review on additional key questions about patient values and preferences should the working group decide it is needed to inform the guideline. For each population, after reviewing the evidence from KQ1 and KQ1a, if the working group believes that SR information on patient values and preferences would potentially change recommendations beyond what is learned about values and preferences identified from focus groups conducted by the Knowledge Translation Team of St. Michaels Hospital in Toronto, Ontario , supporting the development of recommendations for this guideline, then we will move forward with this additional review(s). The potential key questions are:
Key question 2
How do patients value outcomes that may occur from screening for depression in the general adult population and how do these values influence decisions about being screened?
Key question 2a
How do patients with characteristics that may suggest an elevated risk of depression value outcomes that may occur from screening for depression in the general adult population and how do these values influence decisions about being screened? (characteristics as defined in primary studies, not including exclusion criteria).
The same key questions on patient values and preferences may be addressed in the pregnant and postpartum population. The decision to proceed or not proceed in one population does not determine whether patient values and preferences will be undertaken for the other population. If we do pursue a SR on KQ2 and KQ2a, a separate protocol will be developed at that time. This would include topic refinement and all relevant Population, Intervention, Comparator, Outcome (PICO) criteria and methods.
These SRs will be developed, conducted, and prepared according to the CTFPHC Procedure Manual . The manual is a living document and if any changes to the current methods occur, they will be reported in the full review. A Depression Working Group of CTFPHC members was formed for the development of the topic, refinement of the key questions and scope, and rating of outcomes considered most important for creating a recommendation; this working group also sought input from external clinical and content experts. For more information on the selection of working group members and clinical experts, please refer to the CTFPHC Procedure Manual (https://canadiantaskforce.ca/methods/). We have invited patients to partner with the team to gain from their perspectives and learn from their knowledge regarding the prioritization of the outcomes. The general adult review is an update of a SR  previously used by the CTFPHC for their 2013 guideline recommendation on depression screening in adults . Phrasing of the key questions and the eligibility criteria (i.e., PICOS) were also reviewed, re-evaluated, and modified where required (e.g. outcomes). The Depression Working Group has developed the list of outcomes that were rated according to the GRADE methodology . Through consensus, outcomes rated as critical for decision-making (rated 7 to 9 out of 9) and important (rated 4 to 6 out of 9) are included. In addition, these outcomes were rated by patients as well as other outcomes deemed important to patients identified through the patient engagement activities conducted by the Knowledge Translation Program at St. Michael’s Hospital in Toronto, Ontario. Patients rated all patient-important outcomes as critical (7 to 9 out of 9) or important (4 to 6 out of 9) for decision-making. The list of outcomes was finalized after the input from patients.
This SR protocol was prepared in accordance with the PRISMA-P guidelines  (see Additional file 3) and registered with the International Prospective Registry of Systematic Reviews (PROSPERO) database (for the pregnancy and postpartum women - CRD42018099689; for the general adult population - CRD42018099690). The reviews will be reported according to the PRISMA statement  and will include a PRISMA flow diagram. We will also use the conduct reported in a Measurement Tool to Assess the Methodological Quality of Systematic Reviews (AMSTAR 2)  tool for additional quality control. Any amendments made to this protocol when conducting the reviews will be outlined in the related review’s manuscript.
Data sources and search for studies
Search strategies for each population have been developed using a resource librarian and tested through an iterative process by an experienced medical information specialist in consultation with the review team. Using the OVID platform, we will search Ovid MEDLINE®, Ovid MEDLINE® Epub Ahead of Print, In-Process & Other Non-Indexed Citations, Embase Classic + Embase, PsycINFO, and CINAHL. We will also search the Cochrane Library on Wiley. When possible, animal-only and opinion pieces will be removed from the results. There will be no language restriction in either search. A randomized controlled trial (RCT) filter based on the Cochrane Highly Sensitive Search Strategy, sensitivity- and precision-maximizing version (2008 revision), will be used. Vocabulary and syntax will be adjusted across databases. The final searches have been peer-reviewed using the PRESS 2015 guideline .
General adult review
The general adult review will update the SR used by the CTFPHC for their previous guideline recommendation [41, 42]. A comprehensive search strategy was developed using the previous SR search strategy as guidance. The search will start from the last search date of the previous review (May 2012). Strategies will utilize a combination of controlled vocabulary (e.g. “Depressive Disorder”, “Mass Screening”, “Adult”) and keywords (e.g. “depression”, “screening”, “adults”) (see Additional file 4 for the OVID multifile search).
Pregnant and postpartum review
There will be no date restriction in the search. Strategies use a combination of controlled vocabulary (e.g. “Depressive Disorder”, “Mass Screening”, “Pregnancy Complications”) and keywords (e.g. “depression”, “screening”, “pregnancy”) (see Additional file 5 for the OVID multifile search).
For both SRs, we will search the grey literature for unpublished documents (e.g. reports, theses, governmental publications) following the Canadian Agency for Drugs and Technologies in Health (CADTH) Grey Matters checklist. The CADTH checklist includes national and international health technology assessment agencies, clinical practice guideline organizations, clinical trials registries, Canadian health prevalence and incidence databases, statistics, search engines, and additional databases. The clinical trial registries listed within the checklist include ClinicalTrials.gov, WHO International Clinical Trials Registry Platform, ISRCTN Registry, CenterWatch, and Clinical Trials Registry India. We will supplement the CADTH checklist by searching the websites of the following organizations: the College of Family Physicians, the American College of Physicians, the American Academy of Family Physicians, the Canadian Nurses Association, the American Nurses Association, the Canadian Psychiatric Association, the Centre for Addiction and Mental Health, the Anxiety and Depression Association of America, and the American Psychological Association. Additionally, for the pregnant and postpartum review, we will search the following websites: the Society of Obstetricians and Gynaecologists of Canada, the American College of Obstetricians and Gynecologists, the Royal College of Obstetricians and Gynaecologists, and the Royal Australian and New Zealand College of Obstetricians and Gynaecologists, and the Canadian Association of Midwives.
Grey literature searching will be confined to what can be accomplished within 1 week of searching by one person, for pragmatism, and will be restricted to English and French language documents.
Screening and data extraction
Search strategies will be run separately for each population. Within each population, duplicates across searches will be identified and removed using Reference Manager . The remaining unique articles will be uploaded into an online SR managing software (DistillerSR©)  in two separate projects. For each population, screening will be done in two stages. The first stage is a broad screening of the titles and abstracts. For those deemed potentially relevant based on title and abstract, a more focused screening of the full texts will be evaluated against the population, intervention, and comparison of interest. Draft screening forms can be found in Additional file 6. Title and abstract screening will consist of two reviewers screening for relevance. We will use a liberal accelerated method in which a second reviewer will verify those records deemed not relevant by the first reviewer . As these are done concurrently and randomly, each reviewer will not necessarily know if the reference has already been considered irrelevant by the other reviewer. Conflict resolution will not be done at this stage. At the full-text reviewing stage, two reviewers will independently assess the article for relevancy based on all eligibility criteria. Conflicts will be resolved by consensus or a third team member. Reports that are co-publications or multiple reports of the same study will be identified at full-text review and labelled as such. Only English and French articles will be included at the full-text stage; all other languages will be excluded and labelled as “other language”. A pilot-testing phase among reviewers will be implemented on a sample of articles prior to commencement of full screening at both title and abstract level (50 records) and full-text level (25 records). Articles not available electronically will be ordered via interlibrary loan. If the article is not received within 30 days, it will be excluded and the reason for exclusion will be labelled as “full-text not available”.
For feasibility, conference abstracts have been removed from the search results in Embase and Cochrane, a feature only available in these two databases. If abstracts remain from other databases, reports in abstract form will be noted as such and excluded. A list of potentially relevant studies available only in abstract form will be made available as part of the list of excluded studies. A list of grey literature sources, including registries for on-going or completed studies, will be provided for each question. Working group members and clinical experts will be contacted and invited to submit research reports for consideration. We will consult with the working group members and clinical experts for missing studies. In the cases where a relevant secondary evidence report (e.g. evidence-based clinical practice guidelines, SRs, and meta-analyses) is found, the reference list will be reviewed. Using Robinson et al.  as guidance, a SR would need to meet the following criteria to be considered systematic; otherwise, it would be considered a narrative review: (i) at least one database was searched; (ii) it reports selection criteria; (iii) quality appraisal of included studies is reported; and (iv) it provides a list and synthesis of included studies. For full-text screening, where study eligibility is unclear, authors will be contacted by email twice, 2 weeks apart, for additional information. If no response is received, the article will be excluded and will be included in the list of excluded studies as “unclear” for the related question.
Standardized data extraction forms will be developed a priori in DistillerSR and pilot tested, independently in duplicate, on a sample of studies, with this number dependent on the number of included studies (typically 5). Draft items for data extraction are available in Additional file 7. Full data abstraction will be completed by one reviewer and verified by a second reviewer. Disagreements will be resolved by consensus or third-party adjudication if consensus cannot be reached. To facilitate consistent presentation and synthesis of the results across studies, we will convert data (e.g. standard error to standard deviation or 95% confidence intervals). All formats of continuous outcome data will be extracted whether reported as post-intervention or change from baseline. As done previously , where needed, a conservative value for a correlation coefficient of 0.25 will be used to impute standard deviations for means used in change from baseline calculations. Authors will be contacted by email twice over 2 weeks, if any information is missing, or unclear. If no response is received, the outcome will not be included in the synthesis, but will be discussed in the corresponding outcome results section.
Risk of bias assessment
We will use the Cochrane risk of bias (ROB) tool to assess the ROB of included trials . This will be performed by one reviewer with verification completed by a second reviewer. Disagreements will be resolved by consensus or third-party adjudication. Some domains in the Cochrane ROB are outcome-specific (e.g. blinding of outcome assessors) and will be assessed at the outcome level. The overall ROB for the body of evidence will involve a judgement of the relative importance of domains, guided by known empirical evidence of bias, the likely direction of bias, and the likely magnitude of bias . We will follow the GRADE guidance for determining the extent of the ROB for the body of evidence . For outcome and analysis reporting bias, we will use the methods outlined in the Agency for Healthcare Research and Quality guidance to determine ROB for that domain . When assessing cluster randomized trials, we will assess for the possibility of recruitment bias in the “other bias” domain of the Cochrane ROB .
Data synthesis and statistical analysis
Study characteristics, including country of conduct, author(s), date of publication, number of included participants in each group, location of intervention (e.g. general physicians clinic), and funding, will be summarized narratively and presented in summary tables. Where possible, relative and absolute effects with 95% confidence intervals will be calculated to facilitate presentation of outcome data according to the GRADE summary of findings and evidence profile tables adopted by the CTFPHC. For example, risk ratios and risk differences will be ideally used to report effects for binary data. GRADE guidance will be used for presenting continuous data . Where possible, the number needed to treat/harm will be calculated.
We will determine whether clinical and methodological heterogeneity exists among studies, prior to performing a meta-analysis. If it is determined to be appropriate, based on clinical similarity between studies and that the body of evidence is not at high risk of bias, data will be meta-analysed using random effects models for effect measures such as risk ratios and risk differences. If it is determined that meta-analysis is not appropriate, the range of effects will be presented. For time-to-event data, the hazard ratio will be pooled using the generic inverse variance method.
Unit of analysis errors can occur in studies that employ a cluster design (e.g. a clinical practice) and yet are analysed at the individual level (e.g. patients), potentially leading to artificially precise results and contributing more weight than would be appropriate in a meta-analysis . If empirically derived intra-cluster correlation coefficients are available, we will adjust the analysis to address these errors . For multiple events that may occur in one person (e.g. suicide attempt), we will assume each event represents a unique individual, unless data are presented as events per individual. If we were to encounter a study where there is reason for concern that many events are recorded in a small percentage of research participants, the impact of this study could be evaluated in a sensitivity analysis.
Sparse binary data and studies with zero events
When studies report rare events, a synthesis will be done narratively. For those outcomes (e.g. suicide completion) where at least one intervention group contains zero events, only the risk difference (RD) will be used. For calculating the RD, we will use the median baseline risk for the control group in the included studies, although we may additionally perform sensitivity analyses using differing baseline risks if thought suitable.
The Cochran’s Q and I2 statistic will be used to assess the statistical heterogeneity of effect estimates among included studies. For the interpretation of I2, a rough guide of low (0–25%), moderate (25–50%), substantial (50–75%), and considerable (≥ 75%) will be used [62, 63]. Should considerable statistical heterogeneity exist, we will present all studies in a forest plot, but will not provide the pooled estimate. When the body of evidence is statistically heterogeneous, we will conduct subgroup, sensitivity analysis, and/or meta-regression analyses, where the optimal approach for each variable will be determined once we see how data are reported in studies. We will follow previously published guidance for meta-regression . Meta-regression will be based on random effects models to allow for residual unexplained heterogeneity. In consideration of the low power of the Q statistic, when the number of studies is small and the possibility of detecting unimportant heterogeneity when the number of studies is large, a p value < 0.10 will characterize statistical significance . When the sizes of the included studies are moderate or large, there should be at least 10 studies for a continuous study-level variable. For a categorical subgroup variable, each subgroup should have a minimum of four studies. These numbers serve as the lower bounds for considering meta-regression . When included studies are mostly small in size, univariate meta-regression will be used when an insufficient number of studies are available to conduct multivariable analyses. We will not pool outcomes if there is an I2 of > 75%. We will use the p value from the chi-square test as support to interpret the strength of evidence for heterogeneity.
The following subgroup analyses are planned in Table 3.
Sensitivity analyses may be undertaken to restrict analyses to those studies assessed as being of low ROB, based on the overall judgement, and may also be performed to address any decisions made regarding handling of data or to explore statistical heterogeneity. A sensitivity analysis may also be performed on the timing of publication, based on cut-offs as determined by literature and any other design-specific issues we may come across.
Small study effects
If there is a minimum of 10 studies in any meta-analysis, we will assess for small study effects using a combination of graphical aids (e.g. funnel plot) and/or statistical tests (e.g. Egger regression test, Hedges-Olkin) . Funnel plot asymmetry can be used to identify potential bias, as well as signal exaggeration of treatment effects in small studies .
The Cochrane Review Manager software version 5.3 will be used to calculate effect estimates and conduct meta-analyses . For all analyses not possible in RevMan v5.3, we will use Comprehensive Meta-Analysis v3.
Grading the quality of evidence and interpretation
We will assess the quality of evidence for individual comparisons and outcomes using the GRADE approach. GRADE tables will be prepared for each of the critical and important outcomes using the GRADE framework to assess each domain (i.e., risk of bias, imprecision, inconsistency, indirectness, and publication bias) [44, 45]. This will be performed by one reviewer. Verification will be completed by a second reviewer. Disagreements will be resolved by consensus or third-party adjudication.
We will publish the results of these reviews in the ‘Canadian Task Force on Preventive Health Care Evidence Reviews’ series. The findings from both reviews will build the foundation for future research and highlight the implications for primary care practice, and the results will be used by the CTFPHC to help develop their guideline recommendations on depression screening in Canada.
- AMSTAR 2:
Assess the Methodological Quality of Systematic Reviews
Canadian Agency for Drugs and Technologies in Health
Canadian Network for Mood and Anxiety Treatments
Cumulative Index to Nursing and Allied Health Literature
Canadian Task Force on Preventive Health Care
Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
Edinburgh Perinatal/Postpartum Depression Scale
Evidence Review and Synthesis Centre
Grading of Recommendations Assessment, Development and Evaluation
International Classification of Diseases, 10th Revision
International Standard Randomised Controlled Trial Number
Major depressive disorder
Major depressive episode
Public Health Agency of Canada
Population, Intervention, Comparator, Outcome
Peer Review of Electronic Search Strategies
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols
International Prospective Registry of Systematic Reviews
Randomized controlled trial
Risk of bias
United Kingdom National Screening Committee
US Preventive Services Task Force
Public Health Agency of Canada (PHAC), “ARCHIVED: chapter 2: a report on mental illnesses in Canada – mood disorders,” 2002. [Online]. Available: https://www.canada.ca/en/public-health/services/reports-publications/report-on-mental-illnesses-canada/mood-disorders.html. [Accessed: 08-Feb-2018].
Lam RW, et al. Canadian Network for Mood and Anxiety Treatments (CANMAT) 2016 clinical guidelines for the management of adults with major depressive disorder. Can J Psychiatr. 2016;61(9):510–23.
American Psychiatric Assoication. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Publishing; 2013.
World Health Organization. The ICD-10 classification of mental and behavioural disorders. Geneva: Diagnostic criteria for research; 1992.
Stewart DE, Vigod S. Postpartum depression. N. Engl. J. Med. 2016;375(22):2177–86.
“WHO | Depression,” WHO. [Online]. Available: http://www.who.int/mental_health/management/depression/en. Accessed 8 Feb 2018.
Ferrari AJ, et al. Global variation in the prevalence and incidence of major depressive disorder: a systematic review of the epidemiological literature. Psychol Med. 2013;43(3):471–81.
Hirschfeld RM, Weissman M. “Risk factor for major depression and bipolar disorder,” in neuropsychopharmacology: the fifth generation of progress. p. 1017–25.
Thombs BD, Kwakkenbos L, Levis AW, Benedetti A. Addressing overestimation of the prevalence of depression based on self-report screening questionnaires. CMAJ. 2018;190(2):E44–9.
Patten SB, Williams JVA, Lavorato DH, Wang JL, McDonald K, Bulloch AGM. Descriptive epidemiology of major depressive disorder in Canada in 2012. Can J Psychiatr. 2015;60(1):23–30.
L. Findlay, “Health reports: depression and suicidal ideation among Canadians aged 15 to 24,” 2017. [Online]. Available: http://www.statcan.gc.ca/pub/82-003-x/2017001/article/14697-eng.htm. [Accessed: 08-Mar-2018].
“Depression and other common mental disorders: global health estimates.,” World Health Organization, Geneva: World Health Organization. License: CC BY-NC-SA 3.0 IGO, 2017.
Freeman A, et al. The role of socio-economic status in depression: results from the COURAGE (aging survey in Europe). BMC Public Health. 2016;16:1098.
Wang JL, Schmitz N, Dewa CS. Socioeconomic status and the risk of major depression: the Canadian National Population Health Survey. J Epidemiol Community Health. 2010;64(5):447–52.
Patten SB, Williams JVA, Lavorato DH, Wang JL, Bulloch AGM, Sajobi T. The association between major depression prevalence and sex becomes weaker with age. Soc Psychiatry Psychiatr Epidemiol. 2016;51(2):203–10.
Cohen BE, Edmondson D, Kronish IM. State of the art review: depression, stress, anxiety, and cardiovascular disease. Am J Hypertens. 2015;28(11):1295–302.
DeJean D, Giacomini M, Vanstone M, Brundisini F. Patient experiences of depression and anxiety with chronic disease: a systematic review and qualitative meta-synthesis. Ont Health Technol Assess Ser. 2013;13(16):1–33.
Evans DL, et al. Mood disorders in the medically ill: scientific review and recommendations. Biol Psychiatry. 2005;58(3):175–89.
Lim K-L, Ohinmaa A, Schopflocher D, Dewa C. A new population-based measure of the economic burden of mental illness in Canada. Chronic Dis Can. 2008;28(3):92–8.
Chiu M, Lebenbaum M, Cheng J, de Oliveira C, Kurdyak P. The direct healthcare costs associated with psychological distress and major depression: a population-based cohort study in Ontario, Canada. PLoS One. 2017;12(9):e0184268.
Puyat JH, Kazanjian A, Goldner EM, Wong H. How often do individuals with major depression receive minimally adequate treatment? A population-based, data linkage study. Can J Psychiatry. 2016;61(7):394–404.
Thornicroft G, et al. Undertreatment of people with major depressive disorder in 21 countries. Br J Psychiatry. 2017;210(2):119–24.
Thombs BD, et al. Consistency and sources of divergence in recommendations on screening with questionnaires for presently experienced health problems or symptoms: a comparison of recommendations from the Canadian Task Force on Preventive Health Care, UK National Screening Committee, and US Preventive Services Task Force. BMC Med. 2017;15(1):150.
Gavin NI, Gaynes BN, Lohr KN, Meltzer-Brody S, Gartlehner G, Swinson T. Perinatal depression: a systematic review of prevalence and incidence. Obstet Gynecol. 2005;106(5 Pt 1):1071–83.
Vesga-López O, Blanco C, Keyes K, Olfson M, Grant BF, Hasin DS. Psychiatric disorders in pregnant and postpartum women in the United States. Arch Gen Psychiatry. 2008;65(7):805–15.
Lancaster CA, Gold KJ, Flynn HA, Yoo H, Marcus SM, Davis MM. Risk factors for depressive symptoms during pregnancy: a systematic review. Am J Obstet Gynecol. 2010;202(1):5–14.
Howard LM, Molyneaux E, Dennis C-L, Rochat T, Stein A, Milgrom J. Non-psychotic mental disorders in the perinatal period. Lancet. 2014;384(9956):1775–88.
Wisner KL, et al. Onset timing, thoughts of self-harm, and diagnoses in postpartum women with screen-positive depression findings. JAMA Psychiatry. 2013;70(5):490.
Stuart-Parrigon K, Stuart S. Perinatal depression: an update and overview. Curr Psychiatry Rep. 2014;16(9):468.
Stewart DE. Clinical practice. Depression during pregnancy. N Engl J Med. 2011;365(17):1605–11.
Dubber S, Reck C, Müller M, Gawlik S. Postpartum bonding: the role of perinatal depression, anxiety and maternal–fetal bonding during pregnancy. Arch Womens Ment Health. 2015;18(2):187–95.
Grigoriadis S, et al. The impact of maternal depression during pregnancy on perinatal outcomes: a systematic review and meta-analysis. J Clin Psychiatry. 2013;74(4):e321–41.
Barrett J, Fleming AS. Annual research review: all mothers are not created equal: neural and psychobiological perspectives on mothering and the importance of individual differences. J Child Psychol Psychiatry. 2011;52(4):368–97.
Feldman R, Granat A, Pariente C, Kanety H, Kuint J, Gilboa-Schechtman E. Maternal depression and anxiety across the postpartum year and infant social engagement, fear regulation, and stress reactivity. J Am Acad Child Adolesc Psychiatry. 2009;48(9):919–27.
Byatt N, Xiao RS, Dinh KH, Waring ME. Mental health care use in relation to depressive symptoms among pregnant women in the USA. Arch Womens Ment Health. 2016;19(1):187–91.
Deligiannidis KM, Freeman MP. Complementary and alternative medicine therapies for perinatal depression. Best Pract Res Clin Obstet Gynaecol. 2014;28(1):85–95.
Fitelson E, Kim S, Baker AS, Leight K. Treatment of postpartum depression: clinical, psychological and pharmacological options. Int J Womens Health. 2010;3:1–14.
Mental Health Commission of Canada, “Making the case for investing in mental health” 2013.
Thomson M, Sharma V. Between a rock-a-bye and a hard place: mood disorders during the peripartum period. CNS Spectr. 2017;22(S1):49–64.
Thombs BD, et al. Depression screening and patient outcomes in pregnancy or postpartum: a systematic review. J Psychosom Res. 2014;76(6):433–46.
Keshavarz H, et al. Screening for depression: a systematic review and meta-analysis. CMAJ Open. 2013;1(4):E159–67.
Canadian Task Force on Preventive Health Care, et al. Recommendations on screening for depression in adults. CMAJ. 2013;185(9):775–82.
CTFPHC, “Patient engagement protocol.” 2017.
Canadian Task for on Preventive Health Care Procedure Manual. 2014.
Atkins D, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490.
Moher D, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9 W64.
Shea BJ, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008.
McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40–6.
Reference Manager 12. New York: Thomson Reuters, 2011.
DistillerSR. Ottawa, ON, Canada: Evidence Partners, 2011.
Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1:10.
Robinson KA, et al. Integration of existing systematic reviews into new reviews: identification of guidance needs. Systematic Reviews. 2014;3:60.
Hong CJ, Tsang AC, Quinn JG, Bonaparte JP, Stevens A, Kilty SJ. Anti-IgE monoclonal antibody therapy for the treatment of chronic rhinosinusitis: a systematic review. Syst Rev. 2015;4:166.
J. Higgins and S. Green, Cochrane handbook for systematic reviews of interventions. Wiley Online Library, 2008.
Balshem H, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401–6.
Balshem H, et al. Finding grey literature evidence and assessing for outcome and analysis reporting biases when comparing medical interventions: AHRQ and the effective health care program, in Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Rockville (MD): Agency for Healthcare Research and Quality (US); 2013.
Higgins J, Green S. Chapter 16: special topics in statistics. In: The Cochrane Collaboration. Cochrane Handbook for Systematic Reviews of Interventions, vol. 5.1.0; 2011.
Guyatt GH, et al. GRADE guidelines: 13. Preparing summary of findings tables and evidence profiles-continuous outcomes. J Clin Epidemiol. 2013;66(2):173–83.
Whiting-O’Keefe QE, Henke C, Simborg DW. Choosing the correct unit of analysis in medical care experiments. Med Care. 1984;22(12):1101–14.
Killip S, Mahfoud Z, Pearce K. What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med. 2004;2(3):204–8.
Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60.
Sterne JAC, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002.
Fu R, et al. Conducting quantitative synthesis when comparing medical interventions: AHRQ and the effective health care program. J Clin Epidemiol. 2011;64(11):1187–97.
Sterne JAC, Egger M, Smith GD. Investigating and dealing with publication and other biases in meta-analysis. BMJ. 2001;323(7304):101–5.
Review Manager (RevMan). Copenhagen, Norway: the Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
Other members of the Canadian Task Force on Preventive Health Care: Roland Grad, Stéphane Groulx, Michael Kidd, Scott Klarenbach, Eddy Lang, Nav Persaud, Donna L. Reynolds, Guylène Thériault, Brenda J. Wilson. Detailed descriptions at https://canadiantaskforce.ca.
Funding for this protocol and systematic reviews is provided by the Public Health Agency of Canada. This funding will support the collection of the data, data management, analyses, and writing of the protocol and the upcoming systematic review evidence report and manuscript. The funder will have opportunity to comment on the draft protocol, but final decisions will be made by the review team. In addition, the funder will not be involved in study selection, data extraction, or analysis.
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
Written informed consent to publish was obtained from the stakeholders who provided feedback on the protocol. A copy of the written consent is available for review by the Editors-in-Chief of this journal. The stakeholder feedback has been anonymized and included as Additional file 8.
DM is co-editor-in-chief, Systematic Reviews. BH has received consultancy fees from Cornerstone Research Group for methodologic advice related to systematic reviews and meta-analysis and is a member of the Editorial team for Systematic Reviews. SG has received personal fees from UpToDate, personal fees from Eli Lilly, personal fees from Psychotherapy to go, personal fees from Compendium of pharmaceuticals over the last year, outside the submitted work. SP was a co-investigator on a grant supported jointly by the University of Calgary Hotchkiss Brain Institute and Pfizer. BT has received funding from the Canadian Institutes of Health Research to conduct systematic reviews and meta-analyses on the effectiveness of depression screening and the accuracy of depression screening tools. The remaining authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
DSM-5 and ICD-10 definition of major depressive episode. (DOCX 14 kb)
Current recommendations from guideline organizations. (DOCX 33 kb)
PRISMA-P 2015 checklist. (DOCX 18 kb)
Search strategy for general adult population. (DOCX 18 kb)
Search strategy for pregnant and postpartum women. (DOCX 18 kb)
Draft screening forms. (DOCX 14 kb)
Draft items for data extraction. (DOCX 14 kb)
Stakeholder review and feedback. (DOCX 38 kb)