Protocol | Open | Open Peer Review | Published:
How best to structure interdisciplinary primary care teams: the study protocol for a systematic review with narrative framework synthesis
Systematic Reviewsvolume 5, Article number: 170 (2016)
Western publicly funded health care systems increasingly rely on interdisciplinary teams to support primary care delivery and management of chronic conditions. This knowledge synthesis focuses on what is known in the academic and grey literature about optimal structural characteristics of teams. Its goal is to assess which factors contribute to the effective functioning of interdisciplinary primary care teams and improved health system outcomes, with specific focus on (i) team structure contribution to team process, (ii) team process contribution to primary care goals, and (iii) team structure contribution to primary care goals.
Methods and design
The systematic search of academic literature focuses on four chronic conditions and co-morbidities. Within this scope, qualitative and quantitative studies that assess the effects of team characteristics (funding, governance, organization) on care process and patient outcomes will be searched. Electronic databases (Ovid MEDLINE, Embase, CINAHL, PAIS, Web of Science) will be searched systematically. Online web-based searches will be supported by the Grey Matters Tool. Studies will be included, if they report on interdisciplinary primary care in publicly funded Western health systems, and address the relationships between team structure, process, and/or patient outcomes. Studies will be selected in a three-stage screening process (title/abstract/full text) by two independent reviewers in each stage. Study quality will be assessed using the Mixed Methods Assessment Tool. An a priori framework will be applied to data extraction, and a narrative framework approach is used for the synthesis.
Using an integrated knowledge translation approach, an electronic decision support tool will be developed for decision makers. It will be searchable along two axes of inquiry: (i) what primary care goals are supported by specific team characteristics and (ii) how should teams be structured to support specific primary care goals? The results of this evidence review will contribute directly to the design of interdisciplinary primary care teams. The optimized design will support the goals of primary care, contributing to the improved health of populations.
Systematic review registration
Mature health systems are placing increased emphasis on interdisciplinary teams to deliver primary care [1, 2]. Interdisciplinary primary care (IDPC) teams consist of healthcare providers from different disciplines working together toward common goals . This approach is perceived as appropriate to address health needs of populations through the creation of comprehensive care options, increased continuity, and coordination of care [3–7].
The policy maker perspective is captured in Hutchison et al. . Provinces in Canada have been implementing IDPC teams and “this is an opportune time for within and cross-jurisdictional comparisons” and to “understand the complicating effects of physician remuneration and the variety of organizational forms” (p. 281). Now more than ever do we need a synthesis of the evidence, both to guide future implementations and to improve existing teams .
In addition to decision makers, providers crave evidence. Providers may be reluctant to organize into new teams without evidentiary support . For example, physicians in Ontario have been seeking evidence regarding the lessons learned and best practices of Ontario’s Family Health Teams . The Knowledge User Advisory Group associated with this project has identified the question of how best to structure and support IDPC teams as being of utmost importance. This is consistent with findings from a Research Roundtable that was held in October 2014 as a part of a qualitative study of the funding and remuneration structures of IDPC teams in Canada .
The ongoing request for more evidence makes this synthesis of such evidence across Canada and similar health systems timely. Previous evidence syntheses about IDPC teams have looked at specific clinical treatments [12–14] or isolated particular variables with respect to team functioning [15–17]. These reviews have been driven by the quantitative method, which tend to ignore the complexity of context. Their results are of limited usefulness to decision makers. Our study will improve upon existing literature via its comprehensive focus and rigorous inclusion and evaluation of qualitative alongside quantitative evidence . Our results will explicate what is known about the implications of varied choices in varied contexts.
This knowledge synthesis will deliver a decision support tool to knowledge users, some of whom are members of the Knowledge User Advisory Group working with this research team. The question of how best to structure IDPC teams has been at the forefront of their policy agenda. They have committed to using this tool in policy and planning discussions. The tool will support evidence-based policy development and implementation strategies in the organization of primary care. Well-organized teams improve primary care delivery [8, 19], and an improved primary care system is shown to positively contribute to improved population health .
This knowledge synthesis builds on three prior projects: (i) a preliminary scoping of relevant literature , (ii) a qualitative study of IDPC teams in Canada , and (iii) a systematic review with narrative synthesis focused on the impact of funding and remuneration on team process. The focused review allowed us to pilot the search and selection approach. The qualitative study and scoping review allowed us to identify relevant team characteristics, categorize them (financial, governance, management), identify measures of team process, and identify relevant health system outcomes [3–7, 23–34].
The goal of this evidence synthesis is to review the relevant published literature to identify factors that contribute to the effective functioning of IDPC teams and improved health system outcomes. Specific objectives are as follows:
To assess the extent to which team structure contributes to team processes
To assess the extent to which team processes contribute to primary care goals
To assess the extent to which team structure contributes to primary care goals
We will undertake a synthesis of the research evidence to help answer decision makers’ question: “Given my goal and context, how best to structure IDPC teams?”
Based on a scoping review and a qualitative study of IDPC teams in Canada (under review), we define the following indicators to measure the relevant factors:
Team structure: We categorize factors related to team structure into financial structure (funding method for team, remuneration method for providers), governance structure (lines of accountability, type of governance), and management structure (team composition, management of patient acuity, management of team, location, patient rostering, and list size).
Primary care goals: These are relevant health system outcomes including patient health or process outcomes specific to selected chronic conditions (described below) and primary care delivery process indicators including access, comprehensiveness, and continuity, or broader measures, such as the primary care assessment tool .
Systematic literature search
Following the PRISMA reporting guidelines  and the Cochrane Handbook  in a context that is not strictly clinical , this review will follow six key steps: (1) defining the review question, (2) identifying studies, (3) selecting studies, (4) critical appraisal of studies, (5) collecting data, and (6) synthesizing and interpreting results. We also add (7) knowledge translation. A PRISMA-P checklist is included in the Additional file 1.
Defining the review questions
Our research question, refined with input from the Knowledge User Advisory Group, is Which factors (team structure; team process) positively contribute to the functioning of interdisciplinary primary care teams and support primary care goals?
Identifying studies for review
We will search for and synthesize two types of evidence:
Peer-reviewed academic literature as found through a systematic search, including reference searches
Grey literature, including non-peer-reviewed studies and online reports found through a structured online web search
Systematic search of academic literature
A comprehensive electronic search will be conducted with the help of a library scientist (RP) using indexed and free text words, with no date limitations, in the following databases: Ovid MEDLINE, Embase, CINAHL, and PAIS. Our search strategy will include the following key terms (and synonyms): primary care, interdisciplinary teams, interprofessional practice, organization, structure, composition, team size, providers, patient list size, physician leadership, fee-for-service, colocation, team process, team climate inventory, and team effectiveness. Consult Additional file 2 for the comprehensive search strategy in MEDLINE.
The primary search of academic databases is focused on four specific conditions: diabetes, asthma, ischemic heart disease, and hypertension, as well as general chronic disease management.
Structured search of non-academic documents
The grey literature search will be guided by the Grey Matters search tool produced by the Canadian Agency for Drugs and Technologies in Health (CADTH). The tool provides a list of websites as related to specific subject areas and a system for tracking the searches. We modify the list of websites, because the Grey Matters is focused on clinical interventions rather than health services research. Additional file 3 includes the full list of websites to be searched. All searches will be tracked using the Grey Matters system. Key terms will be adapted from the academic literature search.
Selecting studies for inclusion
Studies will be selected for inclusion using a three-phase process of title screening, title/abstract screening, and full text screening/review. Inclusion is generous in terms of methodology. Our scoping review revealed that most studies are qualitative, and many of the quantitative studies have a non-experimental research design. We will include studies assessed as having strong and weak evidence (ranked using the Mixed Methods Assessment Tool, MMAT, described below). The purpose of the review is to support decision-making, which includes a clear identification of those parts of policy discussions for which evidence is weak, in addition to the identification of strong evidence.
Inclusion and exclusion criteria
Inclusion criteria were developed on the basis of a scoping review, a qualitative study, and consultations with the Knowledge User Advisory Group and the research team. To be included, studies must report data on interdisciplinary primary care in publicly funded systems in Western health systems. They must address the relationships between team structure and team process, or between team structure and health system outcomes, or between team process and health system outcome. Studies focused on four key areas of primary care will be included: asthma, diabetes, hypertension, and ischemic heart disease. Only primary studies will be included. Opinions, editorials, and other studies with no primary data will be excluded. Our focus is on studies in the English language. French language articles discussing Western health systems will be assessed, as we have working knowledge of the French language.
Two researchers will independently review the titles of all articles with the purpose of discarding obviously irrelevant titles (i.e., those not related to primary care teams). In case of any ambiguity, including disagreement between reviewers, the study will advance to the next screening level.
Two researchers will independently review the titles/abstracts advanced from the previous stage. Abstracts for which there is disagreement between the two initial reviewers will be reviewed by a third researcher (the principal investigator) with discussion to reach consensus. Studies will advance, if they appear potentially relevant but the abstract is not sufficiently detailed (e.g., how is the structure of the team captured).
Full article screening/review
Two researchers will independently review full text articles to assess all inclusion criteria. Discrepancies will be discussed. Remaining discrepancies will be reviewed by a third researcher (the principal investigator) with the pivotal vote. The final step in the study selection is also the first step of the qualitative analysis.
Data extraction and analysis of studies
Based on the preliminary scoping of the literature, we expect to find primarily qualitative studies and a smaller number of quantitative studies. This calls for a mixed studies review . We will take an integrated approach, where quantitative studies are qualified, then all studies are subjected to qualitative synthesis [18, 40, 41], also referred to as a convergent design . This is appropriate given the diverse nature of the quantitative studies (variety of contexts, team characteristics, outcome measures) .
Data extraction facilitates the analysis (decomposition into parts) of included studies. Given that the purpose of our synthesis is to provide evidence for decision support , analysis will be conducted using a framework approach, which offers a structured approach to organizing and analyzing large volumes of information resulting from qualitative research [44, 45]. The approach facilitates the handling of large volumes of information from qualitative research by using an a priori framework informed by background research and research team discussions. The framework is also used to develop the decision-support tool (Additional file 4: Table S1).
We will extract information on the characteristics of included studies, such as care setting (e.g., region, rural or urban, general or focused care), patient population (general or specialized), research question, study design, type of data, analysis, results, and conclusions . We will extract information about the structural characteristic described (policies and procedures, team composition, provider remuneration, team funding, team governance) and the care process or outcome to which it is linked (team process, health services process, diabetes care, hypertension care, asthma care, ischemic heart disease care, or other chronic disease management outcomes). In line with the integrated approach to mixed studies reviews, we will qualify quantitative studies [42, 43, 47, 48]. This is one type of what is also referred to as Bayesian conversion and specifically means that all quantitative data are thematically synthesized and codified according to the strength of the effect . Data will be extracted by two researchers independently, and discrepancies will be resolved as described under “full title screening.”
Our analytical framework is presented in tabular format (Additional file 4: Table S1). It is also the structure of the online decision aid tool. The framework will be populated by the description of existing evidence, the quality rating of the evidence (see below), and the absence of evidence. For example, the shaded cell in the table will contain information about what is known about the relationships between team size and comprehensiveness of care. The framework will be modified to accommodate emergent categories, as needed.
Critical appraisal of studies
All studies will be critically assessed for quality using the Mixed Methods Appraisal Tool which allows to rate each qualitative and quantitative study along a four-point scale [49, 50] by two independent reviewers. In case of disagreement between reviewers, consensus will be reached via discussion and consultation with a third reviewer. The reviewers will not be blinded to authors, institution, or journal of publication due to feasibility .
The Mixed Methods Appraisal Tool (MMAT) is specifically designed for the appraisal stage of complex systematic literature reviews that include qualitative, quantitative, and mixed methods studies (mixed studies reviews). The MMAT was designed based on the examination of existing reviews, and the literature speaking to criteria for planning, designing, and reporting mixed methods research. [50, 51]
The MMAT permits to concomitantly appraise, describe, and score the methodological quality for three methodological domains: mixed, qualitative, and quantitative (subdivided into randomized controlled, non-randomized, and descriptive). For each relevant study selected, the methodological quality can then be described using the corresponding criteria. For each study, an overall quality score is calculated along a four-point scale (* one criterion met to **** all criteria met). Mixed methods studies are ranked by their weakest component.
In the case of poor reporting, study authors will be contacted for additional information, and/or corresponding publications will be consulted. This is considered standard practice when reviewing qualitative studies. [50, 52]
Synthesis and interpretation of results
Ecological triangulation allows identifying the interconnected relationships between the elements of the framework beyond the two-dimensional [44, 55]. The approach will highlight mutually interdependent relationships between team structure, team process, health outcomes, and environments. This approach also allows incorporating a discussion of the type of evidence (qualitative or quantitative) and the possible discrepancies in conclusions. Our Knowledge User Advisory Group has identified the resultant types of statements as most useful. An ecological statement might take the form: “In this rural area, where the majority of the population has chronic care needs, a salaried team led by a nurse practitioner best supports access to comprehensive care.”
The analytical framework described under “data extraction and analysis” will be relied upon in the creation of the decision support tool (Additional file 4: Table S1). The tool will report on the content of the evidence, and in addition, rate the evidential support of associations between particular team structure characteristics, and team processes or health system outcomes. The evidence rating is as follows:
Strong evidence of effect—more than one study with a MMAT rating of ****
Moderate evidence of effect—one or more studies with a MMAT rating of ***
Limited evidence of effect—one of more studies with a MMAT rating of ** or less
Conflicting evidence—inconsistent finding across studies, with MMAT ratings of *** or more
No evidence—no studies, or conflicting findings with MMAT ratings of **or less
The ecological triangulation approach also allows for the discussion of the quality of the evidence on the basis of which specific conclusions drawn. For example, the above statement can be supplemented with “There is strong evidence to support this claim as per MMAT rating, and the majority of supporting studies are qualitative.”
Our project team takes an integrated knowledge translation approach. Our Knowledge User Advisory Group has been and will be involved directly in the development of the research objectives, the selection of inclusion/exclusion criteria, the discussion of the a priori framework for analysis, and the building of the reference guide and report. The Group has been consulted on the development and refinement of inclusion and exclusion criteria. The integrated knowledge translation approach allows for ongoing formative evaluation of the project, where knowledge users have the opportunity to monitor the process and ensure the usability of the resultant outcomes.
In addition to standard academic dissemination channels, the following outputs are proposed for dissemination to the knowledge user audiences.
An electronic decision support tool for decision makers at the policy and managerial levels based on the framework analysis. The tool will be a web-based database that serves as a quick reference guide (see Additional file 4: Table S1 for draft template).
A report for policy decision makers that identifies contextualized evidence behind optimal team design and the extent to which the evidence can be trusted, based on ecological triangulation.
A webinar for policy makers and managers to demonstrate the content and the use of the electronic reference guide.
A summary of the report on our website: http://www.primaryhealthcareteams.ca/
The decision support tool will be hosted on Dalhousie University servers, and the report along with a link to the database will be posted on our website (www.primaryhealthcareteams.ca). The knowledge users on our team will distribute the link to their networks. We will offer a webinar to demonstrate the use of the reference guide.
Potential challenges and solutions
We anticipate and respond to three challenges in the proposed review. First is the challenge related to the reporting of qualitative research. Due to conventional space constraints imposed by journals, coupled with the lack of standardized reporting requirements, published qualitative studies are often not reported with sufficient breath and detail . This limits our ability to judge the study’s quality. We will respond to this challenge by contacting study authors where necessary, to retrieve more complete reports on methods used in the qualitative studies.
Second, our proposed study is atypically broad. The breadth is dictated by the needs identified by the Knowledge User Advisory Group. We respond to this challenge by proposing a structured and well-matched process for retrieval, analysis, and synthesis developed specifically to address the diverse nature of research in this area.
Third, the explication of the search process for online non-academic studies presents a challenge. The online environment is less controlled than the academic library database system. We respond to this by creating an audit trail using the customized Grey Matters Tool and creating a tracking system for any digressions.
The resultant synthesis will be packaged into a web-based decision support tool. The integrated knowledge translation approach in the development of the decision tool will ensure its usability from the point of view of decision makers. We anticipate that the decision tool will be used in public payer health policy discussions focused on the design of policy-controlled elements of IDPC teams.
Canadian Agency for Drugs and Technologies in Health
Interdisciplinary primary care
Mixed Methods Appraisal Tool
World Health Organization. 2008. Primary health care: now more than ever. World Health Report 2008. http://www.who.int/whr/2008/whr08_en.pdf
Virani T. 2012. Interprofessional Collaborative Teams. Canadian Health Services Research Foundation. http://www.cfhi-fcass.ca/Libraries/Commissioned_Research_Reports/Virani-Interprofessional-EN.sflb.ashx
Khan S, McIntosh C, Sanmartin C, Watson D, Leeb K. Primary health care teams and their impact on processes and outcomes of care. Statistics Canada; 2008. http://publications.gc.ca/collections/collection_2008/statcan/82-622-X/82-622-XIE2008002.pdf.
Lowe F, O'hara S. Multi-disciplinary team working in practice: managing the transition. J Interprof Care. 2000;14(3):269–79.
Pearson A, Porritt KA, Doran D, Vincent L, Craig D, Tucker D, Long L, Henstidge V. A comprehensive systematic review of evidence on the structure, process and characteristics and composition of nursing teams that foster a healthy work environment. Int J Evid Based Healthcare. 2006;4:118–59.
Rodriguez HP, Rogers WH, Marshall RE, Safran DG. Multidisciplinary primary care teams: effects on the quality of the clinician-patient interactions and organizational features of care. Med Care. 2007;45(1):19–27.
Schuetz B, Mann E, Everett W. Educating health professionals collaboratively for team-based primary care. Health Aff (Millwood). 2010;29(8):1476–80.
Hutchison B, Levesque J, Strumpf E, Coyle N. Primary health care in Canada: systems in motion. Milbank Q. 2011;89(2):256–88.
Maldoon L, Rowan MS, Geneau R, Hogg W, Coulson D. Models of primary care service delivery in Ontario: why such diversity? Healthc Manage Forum. 2006;19(4):18-23.
Ragaz N, Berk A, Ford D, Morgan M. Strategies for family health team leadership: lessons learned by successful teams. Healthc Q. 2010;13(3):39–43.
Interdisciplinary Primary Health Care Teams. http://primaryhealthcareteams.ca/. Accessed on My 12, 2016
Bowman BT, Kleiner A, Bolton WK. Comanagement of diabetic kidney disease by the primary care provider and nephrologist. Med Clin North Am. 2013;97(1):157–73.
Carter BL, Bosworth HB, Green BB. The hypertension team: the role of the pharmacist, nurse, and teamwork in hypertension therapy. J Clin Hypertens. 2012;14(1):51–65.
Faulk JS. Diabetes control and education in transplant care improves outcomes. Nephrol News Issues. 2006;20(10):36. 39-41.
Fogarty CT, Schultz S. Teachers: team huddles: the role of the primary care educator. Clin Teach. 2010;7(3):157–60.
Gupta R, Davis E, Horton C. Interval examination: building primary care teams in an urban academic teaching clinic. J Gen Intern Med. 2013;28(11):1517–21.
McKinlay E, Pullon S. Interprofessional learning—the solution to collaborative practice in primary care. Nurs N Z. 2007;13(10):16–8.
The Joanna Briggs Institute. Joanna Briggs Institute Reviewers’ Manual: 2014 edition / Supplement. 2014. http://joannabriggs.org/assets/docs/sumari/reviewersmanual-2014.pdf.
Health Canada. Primary Health Care Transition Fund: interim report, April 2005; Available at: http://www.hc-sc.gc.ca/hcs- sss/alt_formats/hpb-dgps/pdf/phctf-fassp-interm-pro visoire-eng.pdf. Accessed November 12, 2014.
Macinko J, Starfield B, Shi L. The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970–1998. Health Serv Res. 2003;38(3):831–65.
Wranik D, Hanrahan K, Tarrant F. Contractual arrangements and remuneration methods for interdisciplinary teams in primary care in public payer systems: A framework; 2012. http://primaryhealthcareteams.ca/wp-content/uploads/2016/07/Report-1-Inventory-of-PHC-Team-Compensation-Models-copy.pdf.
Wranik D, Korchagina M, Edwards J, Bower I, Levy A, Katz A. How best to pay interdisciplinary primary care teams? Funding and remuneration, a framework and typology; 2015. http://primaryhealthcareteams.ca/wp-content/uploads/2013/10/HRPA-Final-Report.pdf.
Beckhard R. Organizational issues in the team delivery of comprehensive health care. Milbank Mem Fund Q. 1972;50(3):287–316.
Bower P, Campbell S, Bojke C, Sibbald B. Team structure, team climate and the quality of care in primary care: an observational study. Qual Saf Health Care. 2003;12(4):273–9.
Drew P, Jones B, Norton D. Team effectiveness in primary care networks in Alberta. Healthc Q. 2010;13(3):33–8.
Farris KB, Cote I, Feeny D, Johnson JA, Tsuyuki RT, Brilliant S, et al. Enhancing primary care for complex patients. Demonstration project using multidisciplinary teams. Can Fam Physician. 2004;50:998–1003.
Ferrante JM, Balasubramanian BA, Hudson SV, Crabtree BF. Principles of the patient-centered medical home and preventive services delivery. Ann Fam Med. 2010;8(2):108–16.
Hogg W, Lemelin J, Dahrouge S, Liddy C, Armstrong CD, Legault F, et al. Randomized controlled trial of anticipatory and preventive multidisciplinary team care: for complex patients in a community-based primary care setting. Can Fam Physician. 2009;55(12):e76–85.
Nutting PA, Miller WL, Crabtree BF, Jaen CR, Stewart EE, Stange KC. Initial lessons from the first national demonstration project on practice transformation to a patient-centered medical home. Ann Fam Med. 2009;7(3):254–60.
Proudfoot JG, Bubner T, Amoroso C, Swan E, Holton C, Winstanley J, et al. Chronic Care Team Profile: a brief tool to measure the structure and function of chronic care teams in general practice. J Eval Clin Pract. 2009;15(4):692–8.
Shaw A, de Lusignan S, Rowlands G. Do primary care professionals work as a team: a qualitative study. J Interprof Care. 2005;19(4):396–405.
Solheim K, McElmurry BJ, Kim MJ. Multidisciplinary teamwork in US primary health care. Soc Sci Med. 2007;65(3):622–34.
Wagner EH. The role of patient care teams in chronic disease management. BMJ. 2000;320(7234):569–72.
Willens D, Cripps R, Wilson A, Wolff K, Rothman R. Interdisciplinary team care for diabetic patients by primary care physicians, advanced practice nurses, and clinical pharmacists. Clin Diabetes. 2011;29(2):60–8.
Bosch M, Dijkstra R, Wensing M, van der Weijden T, Grol R. Organizational culture, team climate and diabetes care in small office-based practices. BMC Health Serv Res. 2008;8(1):180.
Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, et al. Practice features associated with patient-reported accessibility, continuity, and coordination of primary health care. Ann Fam Med. 2008;6(2):116–23.
PRISMA. Available at: http://www.prisma-statement.org/. Accessed November 14, 2014.
Higgins J, Green S editors. Cochrane Handbook for Systematic Reviews of Interventions. Updated March 2011 ed.; 2011. http://training.cochrane.org/handbook.
Harden A, Garcia J, Oliver S, Rees R, Shepherd J, Brunton G, et al. Applying systematic review methods to studies of people’s views: an example from public health research. J Epidemiol Community Health. 2004;58(9):794–800.
Stevenson K, Baker R, Farooqi A, Sorrie R, Khunti K. Features of primary health care teams associated with successful quality improvement of diabetes care: a qualitative study. Fam Pract. 2001;18(1):21–6.
Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Public Health. 2014;35(1):29.
Pope C, Mays N, Popay J. How can we synthesize qualitative and quantitative evidence for healthcare policy-makers and managers? Healthcare Manage Forum. 2006;19(1):27–31.
Sandelowski M, Voils CI, Barroso J. Defining and designing mixed research synthesis studies. Res Sch. 2006;13(1):29.
Kastner M, Tricco AC, Soobiah C, Lillie E, Perrier L, Horsley T, et al. What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review. BMC Med Res Methodol. 2012;12:114. 2288-12-114.
Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. BMJ. 2000;320(7227):114–6.
Petticrew, Mark, Roberts, Helen. Systematic reviews in the social sciences: a practical guide. Malden, MA; Oxford: Blackwell Pub; 2006.
Sandelowski M, Leeman J, Knafl K, Crandell JL. Text-in-context: a method for extracting findings in mixed-methods mixed research synthesis studies. J Adv Nurs. 2013;69(6):1428–37.
Grimshaw J. A guide to knowledge synthesis. 2010; Available at: http://www.cihr-irsc.gc.ca/e/41382.html. Accessed November 3, 2014
Souto RQ, Khanassov V, Hong QN, Bush PL, Vedel I, Pluye P. Systematic mixed studies reviews: updating results on the reliability and efficiency of the mixed methods appraisal tool. Int J Nurs Stud. 2015;52(1):500–1.
Pluye P. Mixed kinds of evidence: synthesis designs and critical appraisal for systematic mixed studies reviews including qualitative, quantitative and mixed methods studies. Evid Based Med. 2015;20(2):79–2014. 110158. Epub 2015 Jan 29.
Pluye P, Robert E, Cargo M, Bartlett G, O’Cathain A, Griffiths F, et al. Proposal: A mixed methods appraisal tool for systematic mixed studies reviews. 2011; Available at: http://mixedmethodsappraisaltoolpublic.pbworks.com/w/file/fetch/84371689/MMAT 2011 criteria and tutorial 2011-06-29updated2014.08.21.pdf. Accessed May 13, 2015
Daly J, Willis K, Small R, Green J, Welch N, Kealy M, et al. A hierarchy of evidence for assessing qualitative health research. J Clin Epidemiol. 2007;60(1):43–9.
Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme.Lancaster: Institute of Health Research 2006. http://www.lancaster.ac.uk/shm/research/nssr/research/dissemination/publications.php.
Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45. 2288-8-45.
Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9:59. 2288-9-59.
Long AF, Godfrey M. An evaluation tool to assess the quality of qualitative research studies. Int J Soc Res Methodol. 2004;7(2):181–96.
We wish to acknowledge the contributions of Maryna Korchagina, formerly Executive Director with Alberta Health, and Ian Bower, formerly Executive Director with the Nova Scotia Department of Health and Wellness. They had participated as knowledge user partners at the onset of the development of this protocol but have since changed positions.
The study is funded by the Canadian Institutes for Health Research. The funder had no role in the design of the study protocol. The external reviewers’ comments facilitated by the funder during the funding competition process were incorporated into the protocol as appropriate.
Availability of data and material
This is a study protocol. All literature cited in the protocol is available through the Dalhousie University libraries system and cited in the bibliography.
DW leads the study and was responsible for the development of all components of the protocol. JH is the systematic review expert and primary care researcher. She contributed to the development of the methodology. SP is a researcher and health practitioner with experience in systematic reviews and matters of interdisciplinary practice. She contributed to the development of the methodology. RP is a librarian scientist. She has developed the initial library database searches as reported in the protocol. SH is a qualitative researcher with focus on interdisciplinary primary care teams. She contributed to the development of the background section. JE is a knowledge user co-author. She contributed to the refinement of the study question and expected deliverables. ES is a knowledge user co-author. She contributed to the refinement of the study question and expected deliverables. AK is an academic research leader and a primary care physician. He contributed to defining the concepts of primary care, interdisciplinarity, primary care goals, and processes for purposes of this study protocol. LG is a qualitative researcher with expertise in text-based analysis and synthesis. She contributed to the development of the analysis/synthesis sections. AL provided general direction and guidance in consultations. All authors read and approved the final manuscript.
No authors have competing interests in this study protocol. The resultant study will be useful in the conduct of the professional responsibilities of the knowledge user authors (JE, ES).
Consent for publication
Ethics approval and consent to participate
PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist: recommended items to address in a systematic review protocol*. (DOC 84 kb)
Comprehensive Medline Strategy. (DOC 75 kb)
Structured search of non-academic literature. (DOC 69 kb)
Draft template for a decision support tool. (DOC 48 kb)