- Open Access
- Open Peer Review
A protocol for an updated and expanded systematic mixed studies review of fear of cancer recurrence in families and caregivers of adults diagnosed with cancer
Systematic Reviewsvolume 7, Article number: 134 (2018)
Fear of cancer recurrence (FCR) is reportedly common, persistent, associated with significant morbidity and often higher in cancer caregivers than cancer patients. This review will summarise empirical research on FCR to understand its prevalence, severity, correlates, course and impact in families and caregivers of adults diagnosed with cancer, and identify tested interventions that reduce its effects.
This review will include peer-reviewed, empirical, qualitative and/or quantitative studies on fear, worry or concern of patients’ cancer returning or progressing among adult family members or caregivers of the cancer patient. It will exclude records reporting no original empirical research on FCR. We will search CINAHL, Embase, PubMed, PsycINFO, ProQuest Dissertations and Theses GLOBAL from 1997 onwards. Pairs of reviewers will conduct independent screening, data extraction and risk of bias assessment. Risk of bias will be assessed with the Cochrane Risk of Bias tool for randomised studies, the Risk of Bias Assessment tool for Nonrandomized Studies and the questions for qualitative studies in the mixed methods appraisal tool. We will conduct a narrative synthesis of quantitative studies and a thematic synthesis of qualitative studies.
This review will provide further clarity on the prevalence and severity of FCR in families and caregivers and differences by caregiver and care recipient demographic and medical characteristics. Any intervention studies located may indicate therapies or treatments that could reduce FCR in families and caregivers. Findings are expected to provide guidance for individuals and organisations working to manage FCR in families and caregivers of those with cancer.
Systematic review registration
This protocol will be registered with PROSPERO after peer-review.
Fear of cancer recurrence (FCR) is fear, worry or concern about cancer returning or progressing . FCR has been associated with existence and severity of physical symptoms and psychological distress , lower psychosocial wellbeing  and lower quality of life (QoL) [2, 3] in patients. It is one of the most frequently reported problems and unmet needs for both cancer survivors and their carers . In patients, there is strong evidence of a positive association between FCR and distress, depression, anxiety and avoidance/intrusion and strong evidence of a negative association between FCR and QoL or functioning .
Caregivers have reported higher FCR than survivors’ FCR in all four studies that have made these comparisons [4,5,6,7]. In caregivers, FCR is negatively associated with QoL and positively associated with psychological distress . FCR in family members is associated with family QoL 1 to 5 years after cancer treatment ends, contributing significantly to explaining variance in QoL when patient FCR did not . FCR was one of the two most strongly associated variables with family caregivers’ QoL in a multivariable model, while cancer survivors’ FCR did not uniquely explain family caregivers’ QoL . Associations between FCR and psychological distress are also higher over time in caregivers than the cancer patients they care for . While substantially fewer studies assess FCR in caregivers compared to cancer patients, caregivers’ FCR remains important for short- and long-term adjustment to the illness, psychological and social functioning and overall QoL. There are also no known interventions to reduce FCR conducted with caregivers of cancer patients.
This review is needed as the previous systematic review  of FCR in adult cancer survivors, and their caregivers did not identify why caregivers’ FCR was significantly higher than survivors’ FCR in all four studies making these comparisons. New studies testing mediators and predictors may provide insights into why caregivers report more FCR. Including qualitative studies may provide a deeper, richer understanding of caregivers’ interpretations and experiences of FCR that complements and corroborates quantitative findings. We will include qualitative studies as caregiver samples are excluded  from the ongoing qualitative meta-synthesis of FCR .
In terms of interventions, strategies to assist caregivers with high FCR was identified as a priority area in the previous review  and a recently published proposal for a comprehensive FCR research program . However, the ongoing review of psychological interventions for FCR in cancer patients  excludes caregiver samples , so we will include experimental studies in our review.
Lastly, we evaluated if the previous review  needed updating according to criteria for updating systematic reviews in a recently published consensus and checklist . An updated review seems necessary because it still addresses a topical research question, there was significant interest in the original review, there have been advances in systematic review methodology since the previous review and there are new studies that might change or strengthen the original review’s findings. Including qualitative findings, new quantitative studies and using different review methodology may change or extend the earlier findings.
This review is expected to provide a better understanding of the prevalence and severity of FCR in caregivers and interventions that might reduce it. This will reduce uncertainty in clinical and support service practice and inform policy development in both settings. It will help clinicians to stay abreast of this literature and summarise research for cancer survivors, their families and caregivers. For researchers, this review will guide future research efforts to address identified gaps; develop, try, and evaluate new interventions and translate effective interventions into practice.
The primary audiences for the review are clinicians, researchers and support staff and services who support families and caregivers of people with cancer. This review has the perspective of clinical and support-service decision-making around managing FCR in families and caregivers.
This systematic review will summarise what is known from existing research on FCR in adult families and caregivers of adults with cancer. There are five main review questions, all concerning families and caregivers:
What is the prevalence and severity of FCR among family members and caregivers?
What variables correlate with family members’ and caregivers’ FCR (i.e. antecedents, mediators, moderators and outcomes)?
What is the course of family members’ and caregivers’ FCR over time?
How does FCR impact families’ and caregivers’ outcomes and adjustment to illness?
What impact do interventions have on reducing FCR and its outcomes?
We developed this review methodology according to Cochrane Collaboration (CC)  and Centre for Reviews and Dissemination (CRD) guidance . We report this protocol according to the preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) elaboration and explanation paper  (see Additional files 1 and 2; populated PRISMA-P and PRISMA Abstract checklists respectively).
Empirical studies presenting original data will be eligible. We will exclude commentaries, debates, editorials, guidelines, letters, opinions, responses and reviews, except when they report original and empirical data . While not including them, we will examine conference abstracts to locate corresponding journal articles. Records must be peer-reviewed and published in writing, either internally or externally to authors’ institutions.
Studies will need to sample adult (i.e. aged ≥ 18) family members or adult caregivers of adults with cancer. We have excluded families and caregivers of children or adolescents with cancer, as they are a developmentally distinct group and the caregiver-care recipient relationship is likely to be very different.
Eligible studies will need to report results relating to FCR, excluding studies focusing solely on general or specific mental health symptoms or disorders unrelated to FCR. There are no restrictions on types of interventions, comparisons, contexts, settings, duration of studies or outcomes, so long as they co-occur with FCR assessment.
We will exclude studies in languages other than English or French, but list potentially relevant records in other languages in the appendix. Although the searches of the previous review occurred in December 2011 , the current review has wider scope by including qualitative studies and using additional search terms and strategies, so will overlap with the search period of the previous review by considering records published from 1997 onwards. This period is selected as the early seminal work on FCR which  was published in 1997.
This review will include both observational and experimental designs that collect quantitative or qualitative data or a mixture of both. There are no restrictions on study design, as we expect limited literature.
Information sources and search strategy
Stuart Leske (SLe) will develop, pilot and will carry out the search strategy based on previous experience designing and revising search terms and strategies in four systematic reviews and CC  and CRD  guidance. SLe will refine the search strategies before piloting with all other authors who are content experts in FCR and an academic services librarian for medicine.
The review will search for records indexed in CINAHL, Embase, PubMed and PsycINFO. Table 1 lists the keywords that we will use to search these databases. Keywords refer to information about the population (e.g. famil* and caregiver*), combined with FCR terms (e.g. fear* and worr*), recurrence terms (e.g. recur* and reoccur*) and cancer terms (e.g. cancer* and neoplasm*).
One author will search for grey literature (see Table 2) through Google (restricted to pdfs and word documents), Open Grey and WorldCat. One author will retrieve clinical trial protocols from 17 registries on the World Health Organization (WHO) International Clinical Trials Registry Platform. We will review conference abstracts from six major psycho-oncology conferences to cross-check for studies not have been located in other searches.
One author will examine the reference lists of included studies or relevant reviews identified from the searches. Authors of included studies will be emailed to enquire about unpublished research. After screening concludes, a bibliography of included records will be circulated to the systematic review team and the Fear of Cancer Recurrence Special Interest Group of the International Psycho-Oncology Society for review to identify any studies that have been missed. This search has time and financial constraints, resource constraints as librarians have limited scope to be involved, and language constraints.
We will export study records from the databases into the Systematic Review Assistant-Deduplication Module (SRA-DM)  developed by the Centre for Research in Evidence-Based Practice at Bond University. The SRA-DM had superior sensitivity (84%) and specificity (100%) to EndNote’s deduplication function (sensitivity 51%, specificity 99.8%) in a recent deduplication of 1988 citations .
We will then export records to Covidence systematic review software  to enable screening of titles and abstracts and then full-text records by pairs of reviewers. The research team will develop and test screening questions based on eligibility criteria in Covidence, then conduct a calibration exercise on a random sample of 20 records to pilot and refine the questions before formal screening begins.
Full-text records will be retrieved and uploaded to the associated citations in Covidence. To avoid double-counting multiple reports from the same study as multiple studies, data extractors will compare author names, measurement of FCR and other outcomes, sample sizes and study settings. Where inconsistencies in multiple reports from the same study are apparent and unresolved among the research team, a review author will contact study authors to clarify information. Allan ‘Ben’ Smith (ABS) will have overall responsibility for data management.
Pairs of reviewers will independently screen titles and abstracts and then full-text records of records reaching the second stage of screening. We will be over-inclusive at the first stage and include all reports appearing to meet the inclusion criteria or those where eligibility is uncertain. We will seek further information from study authors if necessary to confirm eligibility at the second stage of screening. Reasons for exclusion will be recorded only at the second stage of screening. Pairs will resolve discrepancies via consensus and discuss unresolved discrepancies with a third researcher. Reviewers will not be blinded to the study authors, institutions or journals of the records they screen. We will calculate inter-rater reliability (Cohen’s kappa) for each screening stage and report this in the full review.
Data collection process
We will pilot a data extraction form with detailed instructions in Microsoft Word on a subsample of included papers to assess the efficiency of the form and the accuracy and consistency of extractors. The draft forms for experimental and observational studies are attached as Additional files 3 and 4 respectively.
The form is based on the Cochrane Handbook’s Checklist of items to consider in data collection or data extraction (Table 7.3.a in Version 5.1.0 of the Cochrane Handbook) and the Example information requirements for data extraction, Box 1.4, in the Centre for Reviews and Dissemination’s guidance for undertaking reviews in healthcare . Data items added or removed after protocol development and review initiation will be documented in amendments and the completed review per the process described in the discussion section.
Reasonable assumptions made when extracting data (e.g. ‘adults’ mostly refers to individuals aged ≥ 18) will be mentioned in the full review. One reviewer will contact study authors via email (with a maximum of three email attempts) to obtain and confirm missing or unclear information, if needed. We will note this data as sought and/or received in the data extraction tables. Where authors are uncontactable and apparent discrepancies between reports exist, we will use the report with better methodological quality.
For source identification, we will assign study, report and extractor identification details to each record. We will also include the type of publication (e.g. journal article and conference abstract) and the country of origin.
For methodology, we will note theories underpinning studies. For methods, we will include the study design, assessment/follow-up details (length, number and time points) where applicable and study setting (e.g. hospital and supportive care institution). In all studies, we will note the sampling strategy and data collection method (e.g. survey and interview).
For participant characteristics, we will record the sample subgroups as defined by study authors, total number of families and/or caregivers, their relationship to the patient and caregiving status (e.g. primary, secondary, sole and dual), inclusion and exclusion criteria in studies if any, and their age, sex, co-morbidities, socio-demographics and ethnicity. We will also note the type and stage of the care recipient’s cancer.
For intervention characteristics, we will record the total number of intervention groups, the specific type and sub-type of intervention, intervention components, any reported integrity or fidelity of the intervention, co-interventions, the intervention setting and delivery agent. We will also record the dose, method of administration, duration and number and frequency of intervention sessions, noting if the detail provided is sufficient for replication.
For comparator characteristics in observational studies, we will describe the characteristics serving as a reference point in a manner consistent with the ‘participant section’ above. In experimental studies, we will record the control condition characteristics according to the intervention characteristics described above.
For outcome characteristics, we will record the measure used, means, standard deviations, range, effect sizes and clinically significant cut-offs of FCR and the relationship of all secondary outcomes to FCR using statistics appropriate to the hypothesised relationship.
For experimental results, we will describe the type of analysis used (e.g. intention-to-treat and per protocol); the number of participants eligible, allocated to each intervention group, and analysed; the sample size, missing participants and summary data for each intervention group and the reported estimates of effect, confidence limits and significance values. For qualitative studies, we will report on the type of data analysis (e.g. grounded theory and thematic analysis) and analytic strategy used (e.g. constant comparative method). In a miscellaneous section, we will note funding sources and conflicts of interest.
Outcomes and prioritisation
FCR will be prioritised as the primary outcome. Secondary outcomes include all variables assessed alongside FCR in empirical studies that have been modelled as either predictor, associated (i.e. correlated) or outcome variables relative to FCR. We are interested in all outcomes to identify if intervention is possible before or after FCR development to prevent it from occurring or reduce its effects. These secondary outcomes may be physical or psychological symptoms or conditions, health care factors, coping strategies, QoL-related or health behaviours.
Risk of bias of individual studies
Two reviewers will independently assess risk of bias at the study (e.g. adequate sequence generation) and outcome (e.g. blinding) level. Reviewers will not be blinded to the authors, institutions or journals of included studies. A pre-designed Microsoft Word template will be used to conduct these assessments. Appraising reviewers will resolve disagreements about risk of bias by discussion, involving another reviewer where necessary. We will calculate and report inter-rater agreement (Cohen’s kappa) in the full review.
We will assess risk of bias in RCTs with the Cochrane Risk of Bias tool  and in non-randomised studies with the Risk of Bias Assessment Tool for Nonrandomized Studies (RoBANS) . Both tools have six domains. Readers are referred to these documents for the names and definitions of the constructs assessed.
Assessments of overall risk of bias will consider empirical evidence of bias and its likely direction and magnitude, and assessments will be summarised for individual outcomes within a study (across domains), in accordance with recommendations from section 8.7 of the Cochrane Handbook . Overall assessments will be a ‘high risk’ of bias, ‘low risk’ of bias or ‘unclear risk’ of bias. Individual studies will be ‘high risk’ overall if there is a high risk of bias for one or more key domains . Low risk of bias will be assigned when the study has a low risk of bias for all key domains, and unclear risk of bias will be used when risk of bias is unclear for one or more key domains . To minimise unclear risk, we will contact study authors for more information.
We will draw attention to the methodological quality of studies during stage two of the narrative synthesis, where we will explore reasons for heterogeneous findings within and across studies. We will retain all studies in narrative and thematic syntheses but cite any external empirical evidence of bias for the domains in question and discuss the potential effect this has on the direction and magnitude of estimates (quantitative studies) or findings (qualitative studies).
We chose the Cochrane Risk of Bias tool, as it assesses trial conduct and not reporting; it was developed based on wide consultation, empirical and theoretical evidence and it places an emphasis on transparency . It is being evaluated and updated, which will likely consider new empirical evidence and the existing weaknesses identified with the tool . More empirical evidence of bias and discussion about bias it does not cover (e.g. sponsorship bias) has recently (June 2017) been added to the Cochrane Handbook.
We chose RoBANS, as it is suitable for all study designs except RCTs, and it has moderate reliability, feasibility and validity . Furthermore, it is designed to be consistent in length and focus with the Cochrane Risk of Bias tool, enabling consistent evaluation of bias across diverse study designs.
For qualitative or mixed-methods studies, we will use the relevant sections of the mixed-methods appraisal tool (MMAT) . The current (2011) version of the MMAT includes two screening questions for all study types, four questions for qualitative studies and three questions for mixed-methods studies. These domains have been content-validated by developing the items from the literature and through consultations and workshops with experts [26,27,28]. The MMAT is feasible (i.e. short to administer [27, 29]). Items assessing qualitative studies have lower kappa [27, 29] so we will pilot the appraisal form on a subset of studies to ensure appraisers have a common understanding of these criteria before starting the quality assessment .
Clinical, methodological and statistical heterogeneity will likely preclude meta-analysis. We will aggregate data and use a sequential explanatory synthesis. In this synthesis, the quantitative synthesis precedes and informs the qualitative synthesis, and the qualitative synthesis helps to explain some findings from the quantitative synthesis . The quantitative synthesis will be narrative (descriptive), informed by guidance from the United Kingdom’s Economic and Social Research Council’s Methods Programme [31,32,33,34]. We will use this guidance to develop a preliminary synthesis of the results, explore relationships within and between studies and assess the robustness of the synthesis. Developing a preliminary synthesis will involve organising findings from included studies to describe patterns across the studies in the prevalence and severity of FCR or relationship of FCR to other variables. We will explore relationships within and between studies that might explain any heterogeneity in their findings, drawing on the risk of bias assessments. Sources of potential heterogeneity may arise from study designs, populations, interventions, comparators, outcomes, contexts and/or settings. Assessing the robustness of the synthesis will involve appraising the quality and relevance of evidence from high quality studies (i.e. those without high risk of bias) for each of our research questions using the weight of evidence framework described by Gough [35, 36]. This final stage will assess the coherence and integrity of research evidence (weight of evidence A), the appropriateness of individual study designs for answering each research question (weight of evidence B), the relevance of the focus of the evidence for each research question (weight of evidence C) and an overall assessment of the extent to which an individual study contributes towards answering a research question (weight of evidence D) [35, 36]. These justifications will be documented and thus transparent in the full review.
The qualitative synthesis will be a thematic analysis, informed by guidance from Thomas and Harden . This will be a three-stage process, starting with line-by-line coding of the meaning and content of findings from primary studies, then organising coding hierarchically in a tree structure into related areas to develop ‘descriptive’ themes and lastly, creating ‘analytical’ themes . Pairs of reviewers will independently review the findings of included studies to develop coding structures. Similar to Thomas and Harden, we define findings as the complete text classified as ‘results’ or ‘findings’ in reports of studies, including in the abstracts. We will create analytical themes that make inferences and go beyond the original data by using the descriptive themes to answer the research questions we initially posed. Pairs of reviewers will independently generate analytic themes and then meet to discuss any inconsistencies. We will make inferences informed by the findings of the quantitative synthesis, but the qualitative synthesis may produce additional insights that explain the quantitative findings or are distinct from them. We will structure both syntheses to answer the five review questions we posed, giving equal priority to discussing research with families and/or caregivers. The text will seek to explore important differences between and within studies based on study designs and information from the data extraction and quality appraisal. In each section, we will report quantitative then qualitative studies. Tables will be used to summarise the characteristics of studies, findings and outcomes, and the text will describe these findings in aggregate form and note important differences.
The review methods differ from and expand upon the review it partially updates  in several ways. We will examine FCR in families and caregivers only, which was a component of the previous review.
We will not search the Allied and Complementary Medicine Database or Web of Science, but will instead search Embase to retrieve records of studies on mainstream medicines not captured by PubMed. We will also include any records subjected to any peer-reviewed process, such as theses and grey literature. We will search multiple databases and registries to capture clinical trials, student theses and dissertations and other grey literature. The search terms in this review will be different, as there are family- and caregiver-specific search terms, five more keywords, ten more wildcard symbols and indexing terms used in all databases. This review will include only English- and French-language records, whereas the previous review also included records published in German or Turkish . However, all 130 records included in the previous review had English titles, indicating that they were likely all English-language records.
During study selection, pairs of reviewers will independently examine all records for inclusion, meeting to resolve discrepancies and involving a third reviewer where necessary. For risk of bias, we will assess and comment on the methodological quality of studies using domain-based evaluation tools appropriate for the study design.
Procedure for protocol amendments
Following the Agency for Healthcare Research and Quality’s Effective Health Care Program process for handling protocol amendments , we will record the date of each amendment, the location of the change in the protocol, a description of the language in the original protocol, a description of the change in the protocol and a rationale that specifies why the change will improve the report, why the change does not introduce bias (if necessary) and the expected outcomes of the change. Amendments will be made in PROSPERO and the full review, but not as an erratum to the protocol paper. AG will have final responsibility for approving the amendments and ABS will date, document and implement amendments.
We acknowledge that there are numerous measures of FCR available (for a review see ), and no clear consensus about which measure is best, particularly for identifying likely instances of clinically significant FCR. This makes synthesising FCR results difficult, particularly those relating to the prevalence of FCR. Due to the heterogeneity in FCR measures, we will undertake a narrative synthesis, rather than meta-analysis of quantitative results.
We expect to present findings orally and in writing to stakeholders in the care and support of cancer survivors and their families and caregivers. This may include survivors, families, caregivers, researchers and clinicians at our research group, institute, university, state and federal government cancer departments and non-government organisations. We intend to publish the findings in a peer-reviewed journal (open-access if possible) and upload the manuscript accepted for publication to our university’s institutional repository.
Cumulative Index to Nursing and Allied Health Literature
Centre for Oncology Education and Research Translation
Centre for Reviews and Dissemination
Excerpta Medica dataBASE
Fear of cancer recurrence
Grading of Recommendations Assessment, Development and Evaluation
New South Wales
Preferred reporting items for systematic review and meta-analysis protocols
International prospective register of systematic reviews
Quality of Life
Randomised controlled trials
Risk of Bias Assessment tool for Nonrandomized Studies
Systematic Review Assistant-Deduplication Module
World Health Organization
Lebel S, Ozakinci G, Humphris G, Mutsaers B, Thewes B, Prins J, Dinkel A, Butow P. From normal response to clinical problem: definition and clinical features of fear of cancer recurrence. Support Care Cancer. 2016;24:3265–8.
Simard S, Thewes B, Humphris G, Dixon M, Hayden C, Mireskandari S, Ozakinci G. Fear of cancer recurrence in adult cancer survivors: a systematic review of quantitative studies. J Cancer Surviv. 2013;7:300–22.
Koch L, Jansen L, Brenner H, Arndt V. Fear of recurrence and disease progression in long-term (>/= 5 years) cancer survivors--a systematic review of quantitative studies. Psycho-Oncology. 2013;22:1–11.
Hodges LJ, Humphris GM. Fear of recurrence and psychological distress in head and neck cancer patients and their carers. Psycho-Oncology. 2009;18:841–8.
Mellon S, Kershaw TS, Northouse LL, Freeman-Gibb L. A family-based model to predict fear of recurrence for cancer survivors and their caregivers. Psycho-Oncology. 2007;16:214–23.
Mellon S, Northouse LL, Weiss LK. A population-based study of the quality of life of cancer survivors and their family caregivers. Cancer Nurs. 2006;29:120–31. quiz 132-123
Matthews BA. Role and gender differences in cancer-related distress: a comparison of survivor and caregiver self-reports. Oncol Nurs Forum. 2003;30:493–9.
Mellon S, Northouse LL. Family survivorship and quality of life following a cancer diagnosis. Res Nurs Health. 2001;24:446–59.
Almeida S: Re: Your review registered on PROSPERO. (Leske S ed.; September 15, 2017.
Almeida S, Sales C, Silva E, Elliott R: “Fear of the cancer coming back”: a systematic literature review and meta-synthesis of cancer patients’ experience of fear of recurrence. PROSPERO 2016:CRD42016036688. 2016.
Lebel S, Ozakinci G, Humphris G, Thewes B, Prins J, Dinkel A, Butow P. Current state and future prospects of research on fear of cancer recurrence. Psycho-Oncology. 2017;26:424–7.
Randell K, Gillanders D: Psychological interventions targeting fears of cancer recurrence among cancer survivors: a systematic review. PROSPERO 2017:CRD42017057998. 2017.
Randell K: Re: Your systematic review of interventions for FCR. 21 August, 2017.
Garner P, Hopewell S, Chandler J, MacLehose H, Akl EA, Beyene J, Chang S, Churchill R, Dearness K, Guyatt G, et al. When and how to update systematic reviews: consensus and checklist. BMJ. 2016;354:i3507.
Higgins JPT, Green S (editors). Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]. The Cochrane Collaboration; 2011. Available from http://handbook.cochrane.org.
Centre for Reviews and Dissemination. Systematic Reviews: CRD’s guidance for undertaking reviews in health care. York: University of York; 2008.
Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.
Deeks JJ, Altman DG. Inadequate reporting of controlled trials as short reports. Lancet. 1998;352:1908.
Lee-Jones C, Humphris G, Dixon R, Hatcher MB. Fear of cancer recurrence--a literature review and proposed cognitive formulation to explain exacerbation of recurrence fears. Psychooncology. 1997;6:95–105.
Rathbone J, Carter M, Hoffmann T, Glasziou P. Better duplicate detection for systematic reviewers: evaluation of systematic review assistant-deduplication module. Syst Rev. 2015;4:6.
Veritas Health Innovation. Covidence systematic review software [http://www.covidence.org].
Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JAC. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.
Kim SY, Park JE, Lee YJ, Seo HJ, Sheen SS, Hahn S, Jang BH, Son HJ. Testing a tool for assessing the risk of bias for nonrandomized studies showed moderate reliability and promising validity. J Clin Epidemiol. 2013;66:408–14.
Higgins JPT, Altman DG, Sterne JAC. Chapter 8: Assessing risk of bias in included studies. In: Higgins J, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions: The Cochrane Collaboration. Available from http://www.handbook.cochrane.org; Version 5.1.0, updated March 2011.
Jørgensen L, Paludan-Müller AS, Laursen DRT, Savović J, Boutron I, Sterne JAC, Higgins JPT, Hróbjartsson A. Evaluation of the Cochrane tool for assessing risk of bias in randomized clinical trials: overview of published comments and analysis of user practice in Cochrane and non-Cochrane reviews. Syst Rev. 2016;5:80.
Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int J Nurs Stud. 2009;46:529–46.
Pace R, Pluye P, Bartlett G, Macaulay AC, Salsberg J, Jagosh J, Seller R. Testing the reliability and efficiency of the pilot mixed methods appraisal tool (MMAT) for systematic mixed studies review. Int J Nurs Stud. 2012;49:47–53.
Proposal: A mixed methods appraisal tool for systematic mixed studies reviews [http://mixedmethodsappraisaltoolpublic.pbworks.com].
Souto RQ, Khanassov V, Hong QN, Bush PL, Vedel I, Pluye P. Systematic mixed studies reviews: updating results on the reliability and efficiency of the mixed methods appraisal tool. Int J Nurs Stud. 52:500–1.
Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health. 2014;35:29–45.
Arai L, Britten N, Popay J, Roberts H, Petticrew M, Rodgers M, Sowden A. Testing methodological developments in the conduct of narrative synthesis: a demonstration review of research on the implementation of smoke alarm interventions. Evid Policy J Res Debate Pract. 2007;3:361–83.
Popay J, Roberts H, Sowden A, Petticrew M, Britten N, Arai L, Roen K, Rodgers M. Developing guidance on the conduct of narrative synthesis in systematic reviews. J Epidemiol Community Health. 2005;59(Suppl 1):A7.
Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, Britten N, Roen K, Duffy S. Guidance on the conduct of narrative synthesis in systematic reviews. ESRC Research Methods Programme: Lancaster University, UK; 2006.
Rodgers M, Sowden A, Petticrew M, Arai L, Roberts H, Britten N, Popay J. Testing methodological guidance on the conduct of narrative synthesis in systematic reviews. Evaluation. 2009;15:49–73.
Gough D. Systematic research synthesis. In: Thomas G, Pring R, editors. Evidence-based practice in education. Buckingham: Open University Press; 2004. p. 44–62.
Gough D. Weight of evidence: a framework for the appraisal of the quality and relevance of evidence. Res Pap Educ. 2007;22:213–28.
Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45.
Thewes B, Butow P, Zachariae R, Christensen S, Simard S, Gotay C. Fear of cancer recurrence: a systematic literature review of self-report measures. Psycho-Oncology. 2012;21:571–87.
We acknowledge Cheng Siu for providing feedback on the search in her role as librarian.
This research will be undertaken with funding for people support from the Cancer Institute New South Wales (NSW). ABS and AG are supported by Cancer Institute NSW grants. CONCERT is funded by Cancer Institute NSW with contributions from University of New South Wales, Western Sydney University, University of Wollongong, Illawarra and Shoalhaven Local Health Districts and the Ingham Institute for Applied Medical Research. We also acknowledge facility, information technology and library support from our affiliated institutions. These bodies and institutions had no role in study design, protocol development or manuscript preparation, and will have no role in review conduct, including the collection, analysis or interpretation of data or review conclusions and dissemination of findings. AG will make the final decision on these elements if all four study authors cannot agree. There are no restrictions on disseminating the final report of the review.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.