- Open Access
- Open Peer Review
Eliciting women’s cervical screening preferences: a mixed methods systematic review protocol
Systematic Reviewsvolume 5, Article number: 136 (2016)
With the accumulation of evidence regarding potential harms of cancer screening in recent years, researchers, policy-makers, and the public are becoming more critical of population-based cancer screening. Consequently, a high-quality cancer screening program should consider individuals’ values and preferences when determining recommendations. In cervical cancer screening, offering women autonomy is considered a “person-centered” approach to health care services; however, it may impact the effectiveness of the program should women choose to not participate. As part of a larger project to investigate women’s cervical screening preferences and correlates of these preferences, this systematic review will capture quantitative and qualitative investigations of women’s cervical screening preferences and the methods used to elicit them.
Design and methods
This mixed methods synthesis will use a thematic analysis approach to synthesize qualitative, quantitative, and mixed methods evidence. This protocol describes the methods that will be used in this investigation. A search strategy has been developed with a health librarian and peer reviewed using PRESS. Based on this strategy, five databases and the gray literature will be searched for studies that meet the inclusion criteria. The quality of the included individual studies will be examined using the Mixed Methods Appraisal Tool. Three reviewers will extract data from the primary studies on the tools or instruments used to elicit women’s preferences regarding cervical cancer screening, theoretical frameworks used, outcomes measured, the outstanding themes from quantitative and qualitative evidence, and the identified preferences for cervical cancer screening. We will describe the relationships between study results and the study population, “intervention” (e.g., tool or instrument), and context. We will follow the PRISMA reporting guideline. We will compare findings across studies and between study methods (e.g., qualitative versus quantitative study designs). The strength of the synthesized findings will be assessed using the validated GRADE and CERQual tool.
This review will inform the development of a tool to elicit women’s cervical screening preferences. Understanding the methods used to elicit women’s preferences and what is known about women’s cervical screening preferences will be useful for guideline developers who wish to incorporate a woman-centered approach specifically for cervical screening guidelines.
Systematic review registration
Health care providers and public health organizations have enthusiastically promoted the importance of cancer screening for several years as some cancer screening programs have been found to reduce mortality from the disease [1, 2]. However, debates about the risks and benefits of cancer screening are occurring in the academic and the public domains [3–5]. For example, several organizations do not recommend population-based prostate-specific antigen testing because the harms outweigh the benefits [6–8], and recent publications question the optimal age range for mammography screening [9, 10]. In some jurisdictions, people are offered choices about what method of colorectal cancer screening they would prefer, though access to these options may be variable [11–14]. While most health professionals agree that personalized cancer screening would benefit their patients, the decision-making process is usually left to clinicians. Often, patients are not presented with a decision between screening options for pragmatic reasons: health systems are organized to evaluate and reimburse clinicians based on specific guideline adherence (which may not include a personalized pathway), clinicians may disagree with personalized recommendations, or certain options may require extra resources . Additionally, health professionals have expressed concern that options may deter individuals from pursuing cancer screening, which could affect cancer rates among the population, although there appears to be no evidence to substantiate this [13, 15, 16] The benefits of early cancer detection and potential treatment must be weighed against harms such as complications from the screening process (e.g., perforation from colonoscopy), potential for false positives and false negatives, anxiety resulting from receiving abnormal results, and treatment of conditions that may not have developed into a problem, which can vary widely based on a patient’s age and health status .
Cervical cancer screening has avoided some of the media controversy that has affected breast, prostate, and recently colorectal screening programs because the Papanicolaou (Pap) test has successfully reduced the incidence of invasive cervical cancer and associated mortality [17–19]. In Ontario, Canada, the provincial cancer agency now recommends a new method of screening—human papillomavirus (HPV) testing—because of its increased sensitivity for detecting cervical abnormalities and high negative predictive value for high-grade cervical intra-epithelial neoplasia, compared with Pap testing . Such a change in screening test would require cervical screening stakeholders to make decisions about the age range during which screening should be offered, options for sample collection methods, options for the laboratory testing, screening frequency, and recommended follow-up algorithm. In particular, HPV testing has the option for self-collection, which would allow women to take their own samples without the supervision of a health care professional, though possibly at a cost of slightly decreased diagnostic performance [21, 22]. This strategy could have implications for access to screening, screening frequency, follow-up algorithms, and how screening results are communicated to women. As for most other health care decisions, women and health care professionals would be expected to make cervical screening choices that maximize the potential for early detection of a disease and minimize harm . Population-level benefits and harms are balanced on a broader scale, looking at reduced disease-specific morbidity and mortality compared to overly intensive screening strategies . Cancer screening decisions such as this one are inherently preference sensitive at both the individual level and program level, as decision-makers are required to understand how they value the benefits and harms for the different elements of the decision [25–27]. Therefore, individuals can identify their preferred choice by considering how they value each option’s benefits and risks.
According to the Ottawa Decision Support Framework (ODSF), preference refers to the most appealing option of a decision for an individual, which is identified through values clarification [28, 29]. Values clarification is a process in which individuals identify the characteristics that matter most to them for a specific health decision. In cancer screening, individuals would compare and contrast what the tests measure, their diagnostic performance, how the tests are performed, follow-up procedures, and the potential consequences of participating in screening, and, subsequently, identify a plan to act on these preferences . In the ODSF, values clarification and preference elicitation are part of shared decision-making processes, in which individuals are supported in these exercises by a decision support person . Llewellyn-Thomas and Crump identified interactive and non-interactive, fine-grained, and coarse-grained approaches to values clarification and preference elicitation for health care decision-making in their 2013 review . As the authors note, there are conceptual and methodological issues between the different values clarification/preference eliciting approaches, and further research is required to determine the appropriate approach based on different subgroups of patients. Considering the evolving and complex evidence in cervical cancer screening, it is imperative that women are supported in these preference-sensitive health care decisions, for individual-level decision-making and through policies that reflect women’s preferences.
Systematic reviews have shown that more women may participate in cervical screening if they can self-collect their samples [31, 32]. Other reviews have indicated that women tend to prefer active follow-up of abnormal screening results, predominantly referral to colposcopy, to observation, and predominantly repeated Pap tests . In studies investigating women’s views on HPV testing as part of cervical cancer screening , some respondents had trouble interpreting information about cervical cancer screening . This was related to psychosocial burden of positive results, acceptability of the testing process, and women’s informational needs . There is weak evidence that women’s participation in cancer screening is related to the presentation of the screening information as well as emotional and cognitive responses to the invitation to be screened . While there is a growing body of evidence focusing on women’s attitudes and beliefs in cervical screening, it is unclear whether these studies consider women’s preferences in terms of making informed decisions, which undermines the potential for improved screening for women. To the best of our knowledge, no systematic review has described or compared methods for eliciting women’s cervical screening preferences and the outcomes of these approaches. The proposed review will contribute to an assessment of women’s needs in making decisions about primary cervical cancer screening and inform policy-makers and guideline developers about these needs. These findings will be used in an investigation of women’s cervical screening preferences in Ontario, Canada.
The objectives of this systematic review are
to synthesize and describe what is known about methods used to elicit women’s preferences in primary cervical cancer screening;
to summarize the evidence on women’s preferences for cervical cancer screening.
This protocol has been prepared following Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines for systematic review protocols . The PRISMA-P checklist is included as Additional file 1. The review protocol has been registered with PROSPERO (CRD42016035737).
This systematic review is part of an assessment of women’s needs in identifying their preferences and making decisions about cervical cancer screening, taking into account issues laid out in the ODSF [28, 37]. We will apply this framework to conduct a thematic analysis of the synthesis results, looking at determinants of preferences and decision-making, methods used to support decision-making or elicit preferences, and short- and long-term outcomes [28, 29, 37]. In addition to summarizing different techniques of eliciting preferences, we will compare theoretical frameworks used to elicit preferences, processes used to design these techniques, outcomes including construct validity, clinical outcomes, and decision quality, the identified preferences for cervical cancer screening, and how these preferences are influenced by context.
We will evaluate qualitative and quantitative studies that describe and/or examine methods used to elicit women’s cervical screening preferences. These studies will involve women being presented with multiple options for primary cervical cancer screening and identifying the most favored option . We will include studies of women who are presented with options at the point of decision-making, as well as women presented with a hypothetical decision. The criteria for inclusion in this review are summarized in Table 1. For all study designs, we will examine studies in which women are 18 years of age or older and are eligible for cervical cancer screening. We will include articles that are based on direct enquiry with eligible women with no restriction on publication dates or publication status. For articles not published in English that the study team is unable to translate, we will attempt to contact the study authors to see if there are any English translations available. All study designs will be included. Mixed methods studies that satisfy corresponding inclusion and exclusion criteria will also be included (eligibility will be determined separately for the quantitative and qualitative components). We will examine each of the primary studies from any systematic review or meta-analysis for individual inclusion into the review. Opinion pieces will not be included.
We will search MEDLINE, Embase, PsycINFO, CINAHL, and Cochrane Library databases, for English articles from inception to March 2016. The gray literature will be searched by scanning ProQuest Dissertations and Theses, relevant Canadian health research/policy databases, Canadian health information networks, and known relevant Canadian conference proceedings. Our gray literature search is limited to Canadian resources as the findings from this review will inform an investigation of cervical screening preferences in the Canadian context. A search strategy and its translations to other databases were developed in collaboration with a health sciences librarian at the University of Ottawa and peer reviewed using PRESS . These strategies combined free-text words and subject headings, derived from the following broad topic areas: cervical cancer, early detection of cervical cancer, and patient preferences. The MEDLINE search strategy is appended (Additional file 2). We will search citations of the included studies using SCOPUS to supplement our search of the main bibliographic databases. Reference lists of articles that were selected for full-text review will be scanned for additional relevant material. Subject matter specialists on the review team will be asked to identify further resources for inclusion.
Study identification and data extraction
Two of three reviewers will independently review the studies in three stages: (i) title and abstract screening for inclusion; (ii) full-text screening for inclusion; and (iii) data extraction for eligible studies. All studies which initially appear to meet the inclusion criteria but on inspection of the full-text paper are not eligible will be detailed in a table. We will identify single studies that are reported in multiple publications by juxtaposing the author lists and comparing sample size and setting characteristics. Multiple reports of the same study will be considered for inclusion, but the data will be extracted for single studies from the report deemed the most relevant by the two reviewers. Variation in results reported in multiple publications will be noted as limitations in the appraisal of each study. Characteristics of excluded studies’ together with reasons for their exclusion will be recorded. Disagreements regarding eligibility of studies will be resolved by the third reviewer.
Data will be extracted independently by two of the three reviewers, according to the list in Table 2. Mendeley (www.mendeley.com) and Covidence (www.covidence.org) will be used for citation management, screening, and data extraction. Data will be extracted to preserve the context of the findings, as described by Sandelowski et al.  using pre-defined data extraction forms. Descriptive themes of preference eliciting methods and preferred cervical screening options will be developed for each primary study based on the text-in-context results . Differences will be resolved through discussion between the two reviewers, and if necessary, through final consensus with a third reviewer. Customized data extraction sheets will be pilot tested by all reviewers prior to the data extraction phase.
Objective 1: The first objective is to synthesize what is known about methods used to elicit women’s preferences in primary cervical cancer screening, including
Approaches used to elicit women’s preferences for screening technologies (e.g., interactive versus non-interactive, coarse-grained versus fine-grained, other);
Methods used to evaluate the appropriateness of women’s preferences (e.g., strength of preferred option, change in decisional conflict, acceptability of option’s characteristics, change in knowledge, attitudes, or behavior);
Reported indicators of effectiveness of methods to elicit preferences (e.g., observed strengths of preferences, observed changes in decisional conflict, observed acceptability of options, observed changes in knowledge, attitudes, or behavior);
Advantages and disadvantages of the different methods to elicit preferences.
Objective 2: The second objective is to summarize the evidence on women’s preferences for cervical cancer screening, including
List of options in cervical screening decisions for women;
Women’s preferences for cervical screening (by proportions), by jurisdiction;
Description of important values for making cervical screening decisions.
Quality assessment/risk of bias
The Mixed Methods Appraisal Tool (MMAT) [40, 41] will be used to appraise the qualitative, quantitative, and mixed methods studies for this review. Two reviewers will independently appraise relevant studies, and disagreement will be resolved through consensus, in discussion with a third reviewer. Studies will be included in the final review if they score 50 % or greater, according to the scoring scheme .
The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) guidelines will be used to present a summary of findings and to qualify the strength of individual findings for the quantitative and qualitative syntheses separately, using GRADE profiler and the Confidence in the Evidence from Reviews of Qualitative Evidence (CERQual) tool, respectively [42–45].
The quantitative and qualitative evidence will be analyzed separately and then combined in the final stage of analysis, similar to Goldsmith’s integrated methodology . We expect considerable heterogeneity between studies and therefore that a statistical meta-analysis would not be appropriate. A tabular summary will be created to describe all of the characteristics of the included studies, as well as key preference eliciting methodologies , the advantages and disadvantages of their approaches, and their conclusions regarding women’s preferences based on the text-in-context analysis.
Objective 1: We will produce a quantitative evidence table that describes the main types of preference eliciting methods identified in the quantitative body of literature and may also contain relevant evaluative measurements of the different techniques. Methods will be categorized using themes from a textual analysis technique when reviewing the qualitative literature, using the classification as outlined by Llewellyn-Thomas and Crump  as an initial reference. A similar evidence summary table of the included qualitative studies will be developed, conveying study characteristics, context, and outstanding themes. In both of these summary thematic tables, we will also include a column that indicates if and how the themes map onto the ODSF concepts.
Objective 2: Women’s preferences will be organized into themes using the text-in-context analysis and presented in a table, alongside the options available and values that women identified as important for their decision-making. Quantitative evidence will be synthesized and presented separately from the qualitative evidence.
For both objectives, summary of findings tables will be developed according to the GRADE guidelines (i.e., GRADE and CERQual) for syntheses of the quantitative and qualitative evidence separately. Evidence profiles  will be created for each finding to determine recommendations for eliciting women’s cervical screening preferences, for each objective. These profiles will be presented in a table that denotes which studies contribute evidence toward a particular theme, the associated type of evidence (i.e., qualitative or quantitative), related quality appraisal scores from the MMAT, the consistency of the finding across the studies (e.g., noting any contradictions or missingness), the applicability of the evidence to the Ontario/Canadian population, and any other factors that might influence the usability of the evidence. Each evidence profile will include overall assessments from the GRADE and CERQual summary of findings tables. Using the categories defined by Goldsmith et al. , analytic themes will be graded as “definite” or “suggestive,” based on the GRADE and CERQual assessments. Items which were classified as “high” or “moderate” according to GRADE or CERQual will be given a “definite” recommendation, and items classified as “low” and/or “very low” will be denoted “suggestive.” This method of synthesis will clarify the important dimensions of eliciting women’s preferences for cervical screening, giving equal value to quantitative and qualitative evidence. “Definite” recommendations from the evidence profile will be used to develop a tool to elicit women’s screening preferences in practice. “Suggestive” recommendations will be discussed with local stakeholders to determine their relevance for this particular project and can be used to guide further research on women’s screening preferences.
This study will be the first systematic review synthesizing methods used to elicit preferences for cervical cancer screening. This review constitutes the first part of a needs assessment for the development of a tool to elicit women’s preferences for different cervical cancer screening options. The findings of this review will inform a qualitative investigation of women’s cervical screening decision-making in Canada.
Strengths and limitations
Recommendations for mixed methods systematic reviews were developed only recently [46, 48–50], and therefore, best practices have not yet been fully established. While this study will use some validated approaches to synthesizing quantitative and qualitative evidence, it may be challenging to apply the results of this synthesis because of the heterogeneity of the evidence. This mixed methods approach values quantitative and qualitative evidence equally, offering a more complex understanding of how women make decisions about cervical cancer screening.
As with any knowledge synthesis, this review will be subject to particular biases, including publication bias and language bias. This review will be examining the gray literature to attempt to find relevant unpublished work. If there are relevant articles identified that are not published in English, the authors will seek to translate the document internally or will attempt to retrieve a translation by contacting the author. We expect that the heterogeneity in definitions of “preference” and potential reporting biases may complicate the synthesis of across a diverse body of literature. This review will contribute to improved understanding of how best to elicit cancer screening preferences from women, which women, health care providers, and policy-makers may value. A thematic synthesis may not provide the same certainty as a meta-analysis, though an evidence table with descriptive themes is important for comparing quantitative and qualitative evidence and will be useful for generating recommendations from the final aggregation.
This knowledge synthesis will summarize and compare the content and methodologies used to elicit women’s preferences of cervical screening. A pooled synthesis will highlight what is known about methods used to elicit women’s preferences in cervical screening and their identified preferences across a diverse body of evidence. This information will contribute to the design of a tool to elicit women’s preferences for cervical screening for potential use by health professionals in developing woman-centered cervical screening recommendations. These findings will also suggest gaps in the knowledge of women’s cervical screening preferences that can be addressed in future research.
CERQual, Confidence in the Evidence from Reviews of Qualitative Evidence; GRADE, Grading of Recommendations, Assessment, Development and Evaluation; HPV, human papillomavirus; MMAT, mixed methods appraisal tool; ODSF, Ottawa Decision Support Framework; Pap, Papanicolaou
Sense about science, making sense of screening: a guide to weighing up the benefits and harms of health screening programmes, London, 2015.
World Health Organization. Early detection (module 3 of 6). 2007. p. 50.
Schwartz LM, Woloshin S, Fowler FJ, Welch HG. Enthusiasm for cancer screening in the United States. JAMA. 2004;291:71–8. doi:10.1001/jama.291.1.71.
Stefanek ME. Uninformed compliance or informed choice? A needed shift in our approach to cancer screening. J Natl Cancer Inst. 2011;103:1821–6. doi:10.1093/jnci/djr474.
Woolf SH, Harris R. The harms of screening: new attention to an old concern. JAMA. 2012;307:565–6. doi:10.1001/jama.2012.100.
Bell N, Connor Gorber S, Shane A, Joffres M, Singh H, Dickinson J, et al. Recommendations on screening for prostate cancer with the prostate-specific antigen test. CMAJ. 2014;186:1225–34. doi:10.1503/cmaj.140703.
Ministry of Health and Long Term Care. Government of Ontario, Ontario Prostate Specific Antigen (PSA) Clinical Guidelines—Summary of the Recommendations. (2012). http://www.health.gov.on.ca/english/providers/pub/cancer/psa/psa_summary/summary.html. Accessed 5 Aug 2015.
Qaseem A, Barry MJ, Denberg TD, Owens DK, Shekelle P. Screening for prostate cancer: a guidance statement from the Clinical Guidelines Committee of the American College of Physicians. Ann Intern Med. 2013;158:761–9. doi:10.7326/0003-4819-158-10-201305210-00633.
Myers ER, Moorman P, Gierisch JM, Havrilesky LJ, Grimm LJ, Ghate S, et al. Benefits and harms of breast cancer screening. JAMA. 2015;314:1615. doi:10.1001/jama.2015.13183.
Onega T, Beaber EF, Sprague BL, Barlow WE, Haas JS, Tosteson ANA, et al. Breast cancer screening in an era of personalized regimens: a conceptual model and National Cancer Institute initiative for risk-based and preference-based approaches at a population level. Cancer. 2014;120:2955–64. doi:10.1002/cncr.28771.
Brett AS. Flexible sigmoidoscopy for colorectal cancer screening: more evidence, persistent ironies. JAMA. 2014;312:601–2. doi:10.1001/jama.2014.8613.
C.B. Steele, S.H. Rim, D.A. Joseph, J.B. King, L.C. Seeff, Colorectal cancer incidence and screening—United States, 2008 and 2010, MMWR. Suppl. November 22, 2013, 62 (2013) 53–60.
van Dam L, Kuipers EJ, Steyerberg EW, van Leerdam ME, de Beaufort ID. The price of autonomy: should we offer individuals a choice of colorectal cancer screening strategies? Lancet Oncol. 2013;14:e38–46. doi:10.1016/S1470-2045(12)70455-2.
Wackerbarth SB, Tarasenko YN, Joyce JM, Haist SA. Physician colorectal cancer screening recommendations: an examination based on informed decision making. Patient Educ Couns. 2007;66:43–50. doi:10.1016/j.pec.2006.10.003.
Saini SD, van Hees F, Vijan S. Smarter screening for cancer: possibilities and challenges of personalization. JAMA. 2014;312:2211–2. doi:10.1001/jama.2014.13933.
Jepson RG, Hewison J, Thompson AGH, Weller D. How should we measure informed choice? The case of cancer screening. J Med Ethics. 2005;31:192–6. doi:10.1136/jme.2003.005793.
International Agency for Research on Cancer, Cervix Cancer Screening, Lyon, France, 2005.
World Health Organization. Comprehensive cervical cancer prevention and control : a healthier future for girls and women. 2013.
Ustun C, Ceber E. Ethical issues for cancer screenings. Five countries—four types of cancer. Prev Med. 2004;39:223–9.
Murphy J, Kennedy EB, Dunn S, McLachlin CM, Fung Kee Fung M, Gzik D, et al. HPV testing in primary cervical screening: a systematic review and meta-analysis. J Obstet Gynaecol Can. 2012;34:443–52.
Arbyn M, Verdoodt F, Snijders PJF, Verhoef VMJ, Suonio E, Dillner L, et al. Accuracy of human papillomavirus testing on self-collected versus clinician-collected samples: a meta-analysis. Lancet Oncol. 2014;15:172–83. doi:10.1016/S1470-2045(13)70570-9.
Rozemeijer K, de Kok IMCM, Naber SK, van Kemenade FJ, Penning C, van Rosmalen J, et al. Offering self-sampling to non-attendees of organized primary HPV screening: when do harms outweigh the benefits? Cancer Epidemiol Biomarkers Prev. 2015;24:773–82. doi:10.1158/1055-9965.EPI-14-0998.
Sawaya GF, Kuppermann M. Identifying a “range of reasonable options” for cervical cancer screening. Obstet Gynecol. 2015;125:308–10. doi:10.1097/AOG.0000000000000670.
Wilt TJ, Harris RP, Qaseem A. Screening for cancer: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162:718–25. doi:10.7326/M14-2326.
Barratt A, Trevena L, Davey HM, McCaffery K. Use of decision aids to support informed choices about screening. BMJ. 2004;329:507–10. doi:10.1136/bmj.329.7464.507.
Trevena L. Cancer screening—pros, cons, choice, and the patient. Aust Fam Physician. 2009;38:188–92.
Irwig L, McCaffery K, Salkeld G, Bossuyt P. Informed choice for screening: implications for evaluation. BMJ. 2006;332:1148–50. doi:10.1136/bmj.332.7550.1148.
O’Connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, McPherson R, Bunn H, Graham I, Drake E. A decision aid for women considering hormone therapy after menopause: decision support framework and evaluation. Patient Educ Couns. 1998;33:267–79.
Llewellyn-Thomas HA, Crump RT. Decision support for patients: values clarification and preference elicitation. Med Care Res Rev. 2013;70:50S–79S. doi:10.1177/1077558712461182.
Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A, et al. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333:417. doi:10.1136/bmj.38926.629329.AE.
Racey CS, Withrow DR, Gesink D. Self-collected HPV testing improves participation in cervical cancer screening: a systematic review and meta-analysis. Can J Public Health. 2013;104:e159–66.
Verdoodt F, Jentschke M, Hillemanns P, Racey CS, Snijders PJF, Arbyn M. Reaching women who do not participate in the regular cervical cancer screening programme by offering self-sampling kits: a systematic review and meta-analysis of randomised trials. Eur J Cancer. 2015;51:2375–85. doi:10.1016/j.ejca.2015.07.006.
Frederiksen M, Lynge E, Rebolj M. What women want. Women’s preferences for the management of low-grade abnormal cervical screening tests: a systematic review. BJOG An Int J Obstet Gynaecol. 2012;119:7–19. doi:10.1111/j.1471-0528.2011.03130.x.
Hendry M, Pasterfield D, Lewis R, Clements A, Damery S, Neal RD, et al. Are women ready for the new cervical screening protocol in England? A systematic review and qualitative synthesis of views about human papillomavirus testing. Br J Cancer. 2012;107:243–54. doi:10.1038/bjc.2012.256.
Ackerson K, Preston SD. A decision theory perspective on why women do or do not decide to have cancer screening: systematic review. J Adv Nurs. 2009;65:1130–40.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1. doi:10.1186/2046-4053-4-1.
O’Connor AM, Jacobsen MJ, Stacey D. An evidence-based approach to managing women’s decisional conflict. J Obstet Gynecol Neonatal Nurs. 2002;31:570–81. doi:10.1111/j.1552-6909.2002.tb00083.x.
McGowan J, Sampson M, Lefebvre C. An evidence based checklist for the Peer Review of Electronic Search Strategies (PRESS EBC). Evid Based Libr Inf Pract. 2010;5:149–54.
Sandelowski M, Leeman J, Knafl K, Crandell JL. Text-in-context: a method for extracting findings in mixed-methods mixed research synthesis studies. J Adv Nurs. 2013;69:1428–37. doi:10.1111/jan.12000.
Pluye P, Gagnon M-P, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int J Nurs Stud. 2009;46:529–46. doi:10.1016/j.ijnurstu.2009.01.009.
Pace R, Pluye P, Bartlett G, Macaulay AC, Salsberg J, Jagosh J, et al. Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. Int J Nurs Stud. 2012;49:47–53. doi:10.1016/j.ijnurstu.2011.07.002.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–6. doi:10.1136/bmj.39489.470347.AD.
Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ. What is “quality of evidence” and why is it important to clinicians? BMJ. 2008;336:995–8. doi:10.1136/bmj.39490.551019.BE.
Guyatt GH, Oxman AD, Kunz R, Jaeschke R, Helfand M, Liberati A, et al. Incorporating considerations of resources use into grading recommendations. BMJ. 2008;336:1170–3. doi:10.1136/bmj.39504.506319.80.
Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gülmezoglu M, et al. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLOS Med. 2015;12:e1001895. doi:10.1371/journal.pmed.1001895.
Goldsmith MR, Bankhead CR, Austoker J. Synthesising quantitative and qualitative research in evidence-based patient information. J Epidemiol Community Health. 2007;61:262–70. doi:10.1136/jech.2006.046110.
Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45. doi:10.1186/1471-2288-8-45.
The Joanna Briggs Institute, Joanna Briggs Institute Reviewers’ Manual: 2014 edition/Supplement, in: The Joanna Briggs Institute, 2014: pp. 1–24.
Sandelowski M, Voils CI, Barroso J. Defining and designing mixed research synthesis studies. Res Sch. 2006;13:29.
Kavanagh J, Campbell F, Harden A, Thomas J. Mixed methods synthesis: a worked example. In: Hannes K, Lockwood C, editors. Synthesizing qualitative research: choosing the right approach. Ltd, Chichester, UK: John Wiley & Sons; 2011. p. 113–36. doi:10.1002/9781119959847.Ch6.
Vergnes J-N, Marchal-Sixou C, Nabet C, Maret D, Hamel O. Ethics in systematic reviews. J Med Ethics. 2010;36:771–4. doi:10.1136/jme.2010.039941.
We would like to acknowledge Mish Boutet at the University of Ottawa for providing useful guidance in developing a final search strategy. We would also like to acknowledge Jesse Elliott—who recently joined the team as a reviewer—for her systematic review expertise.
This research is part of BW’s PhD dissertation, supported by a Mitacs Accelerate grant and a University of Ottawa graduate admissions scholarship. The funders did not play a role in the design or reporting of this research.
Availability of data and materials
BW conceived the study design and methodology, helped to devise a search strategy, and wrote the first draft of the manuscript. SRVK contributed to the study methodology, helped to construct a data extraction template, helped write the first draft of the manuscript, and revised the later versions. ZEK contributed to the study methodology and helped revise the manuscript. SM contributed to the study design and helped revise the manuscript. MT contributed to the study methodology and helped revise the manuscript. EW led the development of the search strategy, searched the translations, helped to execute the search, and helped revise the manuscript. IDG helped conceive and design this study and helped revise the manuscript. JL helped conceive and design this study and helped revise the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Ethics approval and consent to participate
There are ethical considerations to consider in the synthesis of primary research studies ; however, approval was not required for this analysis. No individual-level data will be presented, and we will exclude studies that do not reflect sufficient ethical conduct.