- Open Access
- Open Peer Review
Professional learning and development of postdoctoral scholars: a scoping review protocol
© The Author(s). 2018
- Received: 6 November 2017
- Accepted: 22 November 2018
- Published: 5 December 2018
A growing number of postdoctoral scholars are following diverse career paths that require broad skill sets to ensure success. Yet, most postdoctoral professional learning and development initiatives are intended for academic careers and seldom include professional skills needed to succeed in non-academic settings. Given that fewer than 20% of postdoctoral scholars will obtain tenure-track academic positions, there is a great need for postdoctoral scholars to prepare for a range of future careers. Creating professional learning and development strategies to address these concerns requires an understanding of current approaches, yet there is a distinct lack of literature exploring and synthesizing sources of evidence on the professional learning and development of postdoctoral scholars. The purpose of this scoping review is to examine, synthesize, and map the sources of evidence on professional learning and development pertaining to postdoctoral scholars.
We will perform a scoping review to identify sources of evidence around professional learning and development of postdoctoral scholars. Our search strategy, limited to English language, will include searching relevant disciplinary and interdisciplinary databases with no limitation on date of publication. We will conduct forward and backward citation chasing of included articles. Gray literature will be searched in electronic databases and websites of national postdoctoral associations. Search strategies will be developed using controlled vocabulary and keyword terms related to postdoctoral scholars and professional development. Two reviewers will independently screen titles and abstracts for inclusion, and two reviewers will independently screen full text to determine final inclusion. These data will be summarized quantitatively (using a simple numerical count) and qualitatively using thematic analysis methods. Through this process, we will summarize the current state of evidence around professional development and learning of postdoctoral scholars and identify current gaps in the literature, as well as the research areas requiring systematic reviews and/or primary research.
Despite the growing numbers of postdoctoral scholars, there has been no synthesis of the sources of evidence of postdoctoral scholars’ professional learning and development. In reviewing a wide range of evidence and integrating it into a manageable and meaningful whole, this scoping review will be a critical first step in understanding the professional learning and development of postdoctoral scholars. Our results will help inform future research and the development of a framework for postdoctoral scholar’s professional learning and development.
- Scoping review
- Postdoctoral scholar
- Postdoctoral fellow
- Professional development
- Professional learning
Postdoctoral scholars hold doctoral degrees and are engaged in mentorship opportunities to develop their scientific independence, academic merit, and entrepreneurial research skills . They are central to the advancement of scientific inquiry, improvement of teaching practices in higher education, studying relevant problems, addressing important societal issues, and informing future policy [2, 3]. Postdoctoral scholars are significant members of the research community, making important contributions to research productivity [4, 5], contributing to knowledge translation, and strengthening collaborative research networks .
Postdoctoral fellowships are traditionally short-term positions (1–5 years) intended to bridge the gap between PhD completion and a tenure-track faculty position [2, 3]. However, the increasing number of postdoctoral scholars has far outpaced universities’ needs for new academic faculty [2, 3, 6, 7] and fewer than 20% of current postdoctoral scholars are likely to obtain tenure-track positions . As a result of this trend, today’s postdoctoral scholars are following more diverse career paths and increasingly pursuing careers in industry, government, and beyond, or leaving research altogether .
As increasing number of postdoctoral scholars pursue careers outside of academia, the need to develop a broad skill set to succeed in their various roles also increases. Worldwide, educators, business leaders, and politicians have developed lists and models of twenty-first century skills that professionals need both today and in the future [9, 10]. Recent studies from different fields indicates that the skills professionals need are not only field-specific skills but also include broad skills, such as social skills, organizing skills, skills for knowledge acquisition, and problem-solving skills [11–13]. Success in many careers also requires interpersonal communication, presentation, leadership, management, networking, and teaching skills . Despite these findings, traditional emphasis has been placed on developing research skills and scientific knowledge, resulting in insufficient resources being dedicated to the broader professional learning and development of postdoctoral scholars.
We purposefully use the term “professional learning and development” within the context of our work to ensure a broad focus on the experience and continuous nature of professional learning and professional development, by engaged individuals capable of self-directed learning [15, 16]. Professional learning and development is situated, social and constructed, and is based on a complex relationship between individuals and their environment [16, 17]. It includes a range of formal and/or informal activities and interactions, as well as contextual learning and reflective practice that may increase postdoctoral scholars’ knowledge, skills, abilities, and growth while improving their performance in present or future positions [16, 18]. Professional learning and development experiences may range from formal structured initiatives (e.g., seminars, workshops, conferences, courses), to embedded professional and self-directed learning activities (e.g., co-teaching, mentorship, group discussions, communities of practice, professional meetings, reading groups), to informal everyday discussions and work-related practices with other researchers, educators, and scholars [16, 17, 19].
Postdoctoral scholars recognize a need for sufficient opportunities to prepare for the various roles and responsibilities of their diverse future positions [1, 20, 21]. Yet, most professional learning and development opportunities for postdoctoral scholars are intended to prepare them for academically focused research careers and rarely include professional skills needed to succeed more broadly in their academic careers or in non-academic settings [2, 3, 7]. Though much importance has been placed on developing professional learning and development programs for graduate student, far fewer programs occur for postdoctoral scholars [21–24]. There is a scarcity of literature exploring and synthesizing sources of evidence on the professional learning and development of postdoctoral scholars. Based on this background, our objective is to conduct a scoping review to examine and synthesize the sources of evidence on professional learning and development of postdoctoral scholars.
Various systematic approaches are available for reviewing published literature. Scoping reviews are a rigorous and methodical approach to examining the extent, range, and nature of research activity in a particular field . We believe a scoping review of published literature is the best method to map the global literature regarding professional learning and development of postdoctoral scholars. Scoping review methodology will guide us to broadly and comprehensively examine and systematically map sources of evidence on professional learning and development of postdoctoral scholars, determine feasibility of conducting subsequent systematic reviews, summarize and disseminate research findings to knowledge users, and identify gaps where further research is required [28, 29]. In designing the protocol for our scoping review, we drew upon Arskey and O’Malley’s  seminal work as well as more recent scoping review publications [29–32]. The review will include the following stages: (1) formulating the research questions; (2) identifying relevant literature; (3) study selection based on clear inclusion and exclusion criteria; (4) charting the data using standardized data extraction tables; (5) collating, summarizing, and reporting the results including an appraisal of the literature; and (6) consultation. In addition, this scoping review will include an evidence map offering a user-friendly format illustrating the evidence and gaps in evidence that exist for professional learning and development of postdoctoral scholars. To ensure the evidence map is useful to stakeholders, we will draw upon Bragge and colleagues framework for global evidence mapping  and more recent evidence map literature [34, 35]. A completed PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) checklist has been submitted as an additional file to this protocol (Additional file 1). This study has not been registered in PROSPERO as scoping reviews are not eligible for inclusion.
Stage 1: Identifying the research questions
In scoping reviews, research questions should be broad with the focus on summarizing the breadth of literature . Our overarching research question is as follows: What is known from existing sources of evidence about the professional learning and development of postdoctoral scholars? Our objectives are the following: first, to describe which professional learning and development opportunities are being reported worldwide; second, to explore how professional learning and development opportunities are being used by postdoctoral scholars; third, to categorize professional learning and development opportunities that are relevant to meeting the needs of postdoctoral scholars; and fourth, to identify optimal strategies for providing professional development to postdoctoral scholars.
Stage 2: Identifying relevant literature
Scoping reviews aim to comprehensively address broad research questions; however, parameters are required to guide the search strategy. Together, our review team deliberated and decided upon the criteria for eligibility and databases to search and formulated a search strategy.
We will include sources of evidence on professional learning and development of postdoctoral scholars including studies, theses/dissertations, and gray literature. For the purpose of this review, postdoctoral scholars are defined as scholars who hold doctoral degrees and are engaged in mentored research and/or scholarly training for the purpose of skills development . Professional learning and development is defined as any activities and interactions that may increase postdoctoral scholars’ knowledge and skills; contribute to their personal, social, and emotional growth as scholars; and improve their performance in present or future roles. These experiences can range from formal structured formats (seminars, workshops, conferences, courses), to embedded professional development (co-teaching, mentorship, group discussions, communities of practice), to informal discussions with other researchers, educators, and scholars.
Information sources and search strategy
Provisional search strategy
exp Staff Development/
(professional adj1 development).mp.
(professional adj1 learning).mp.
(professional adj1 growth).mp.
(career adj1 development).mp.
(career adj1 mentor*).mp.
(career adj1 goal*).mp.
(career adj1 preparation).mp.
(career adj1 navigat*).mp.
(capacity adj1 development).mp.
(postdoc* adj2 train*).mp.
(faculty adj1 development).mp.
(collegial adj1 mentor*).mp.
(peer adj1 coach*).mp.
(faculty adj3 learning communit*).mp.
work life balance.mp.
(talent adj1 management).mp.
(communit* adj1 practice*).mp.
(teaching adj1 development).mp.
(teaching adj1 skill*).mp.
(academic adj1 skill*).mp.
(academic adj1 development).mp.
(skill* adj1 development).mp.
(training adj1 program*).mp.
(talent adj1 development).mp.
(skill* adj1 train*).mp.
(education* adj1 development).mp.
4 and 41
limit 42 to english language
Stage 3: Study selection
The selection of literature will occur in two phases. The first phase will involve screening of titles and abstracts by two reviewers, independently using a structured screening form based on the identified eligibility criteria. To minimize the risk of bias, screening forms will be pilot tested by reviewers on a random selection of 100 titles and abstracts to ensure consistency and reliability. A kappa  of greater than 0.8 will be used to quantify inter-investigator agreement. Disagreements will be resolved to consensus through discussion and passed to a third investigator for final resolution if the issue cannot be resolved. Literature identified as potentially relevant will be passed to the next screening level.
In phase 2, two reviewers will independently review full-text versions of all potentially relevant literature. To minimize the risk of bias, both reviewers will be trained on the phase 2 screening form prior to beginning screening and the forms will be pilot tested by the reviewers on a random selection of 10 full texts to ensure consistency and reliability between the reviewers. A kappa  of greater than 0.8 will be used to quantify inter-investigator agreement, and disagreements will be resolved by discussion. Unresolved disagreements will be referred to a third investigator for review and resolution.
A PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram  will be used to report final numbers once the review is completed. A unique identifier will be assigned to every publication retrieved during data collection to enable tracking of the article throughout the review process. Endnote v8 will be used to manage the results of the searches. The final search results will be exported into an excel workbook to facilitate the screening process with each reviewer documenting the inclusion/exclusion status for each article.
Stage 4: Charting the data
A “descriptive analytical” method will be used to extract contextual information from each included article, involving the synthesis and interpretation of the data by sifting, charting, and sorting material according to key findings and themes . The review team will collectively develop a data extraction form guided by our logic model to determine which variables or themes to extract. This will be an iterative process, and the form will be continually updated as new key findings emerge .
Two reviewers will independently read each included article. One reviewer will extract relevant data using a standardized data extraction tool, and another reviewer will verify the extracted data for consistency and accuracy. The data extracted will include year, authors, publication title, research question or study purpose, study design, context, participants, sample size, theoretical/conceptual framework, interventions, definitions of concepts, data collection methods, and relevant results. Additional categories may be identified through completion of the search and in consultation with the team members. Study quality is generally not conducted during a scoping review [28, 29]; however, we will include a summary of literature limitations identified in articles included in the review.
Stage 5: Collating, summarizing, and reporting the results
The unique purpose of a scoping review is to aggregate the findings and present an overview of the current state of evidence on a topic. The data arising from our data collection process will be summarized quantitatively (using a simple numerical count identifying numbers of studies) and qualitatively using thematic analysis methods . Study findings will be inductively coded , compared between studies, and grouped to generate initial descriptive themes. Analytical themes will be created by exploring how the descriptive themes are linked between the studies. In addition, we will include an evidence map to illustrate the evidence gaps that exist for professional learning and development of postdoctoral scholars. Through this process, we will be able to summarize and critically evaluate the current state of evidence around professional learning and development of postdoctoral scholars and identify current gaps in the literature and professional learning and development programming, as well as the research areas which require systematic reviews or primary research.
Stage 6: Consultation
The consultation phase is optional in the seminal Arskey and O’Malley framework ; however, we have chosen to include this step in our review. Obtaining feedback from relevant stakeholders will help ensure our results are relevant to the target audience . We are using an integrated knowledge translation  approach for this scoping review, and our multidisciplinary team includes knowledge users (postdoctoral program director, postdoctoral scholars, director of educational development), knowledge synthesis methodologists, an information scientist, and experienced researchers. Our team co-developed the review question and protocol and will continue to be involved throughout the entire process, including the development of a knowledge translation strategy to increase the uptake of the findings of the review. The anticipated goal of engaging these individuals is to accelerate spread and use of knowledge and to establish evidence-based decision-making regarding professional development supports for postdoctoral scholars.
As highly trained and experienced early career researchers, postdoctoral scholars play a key role in driving discovery and expanding knowledge [2, 3]. Although there is an increasing interest for postdoctoral scholars to engage in professional learning and development opportunities, to date, there has been no synthesis of evidence to fully understand postdoctoral professional learning and development and strategies implemented to support their growth. The results of this work will be of use to several target audiences, including postdoctoral scholars, institutional decision-makers, and researchers, provincially, nationally, and internationally who have postdoctoral programs.
The main goal of our knowledge translation plan is to disseminate the research findings in formats and through pathways most appropriate for the target audiences. Our approaches to knowledge dissemination will include webinars via the Educational Development Caucus (an affiliate of the Society for Teaching and Learning in Higher Education) and presentations at national and international educational development and higher education conferences (such as the International Society for the Scholarship of Teaching and Learning Conference, and the International Consortium for Educational Development). At the local level, highlights of learnings will be disseminated through our University newsletters, blogs, annual reports, and conferences. A world café [28–30] with a graphic facilitator will be held with postdocs to discuss and build upon key study findings.
The results from this scoping review will help inform efforts to refine existing or develop new approaches to promote professional learning and development amongst postdoctoral scholars. Furthermore, the results will guide future work towards developing professional learning and development evaluation frameworks for postdoctoral scholars. The creation of an evidence-based professional learning and development framework will help advance theoretical understanding of postdoctoral professional learning and development and enhance the transferability of findings to multiple postsecondary contexts.
Lorelli Nowell is funded by an Eyes High Postdoctoral Fellowship at the Taylor Institute for Teaching and Learning at the University of Calgary.
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
LN, KAH, CB, NK, CK, and CE conceived the study; LN developed the study design; LN, CB, NK, and CE contributed key background literature and knowledge on professional development and postdoctoral scholars; KAH created the proposed search strategy; LN drafted the protocol manuscript; LN, KAH, CB, NK, CK, and CE edited the protocol manuscript; and all authors read and approved the final manuscript. LN is the guarantor of this protocol.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Nerad M, Cerny J. Postdoctoral patterns, career advancement, and problems. Science. 1999;285(5433):1533–5.View ArticleGoogle Scholar
- Mitchell J, Walker V, Annan R, Corkery T, Goel N, Harvey L, Kent D, Peters J, Vilches S. The 2013 Canadian postdoc survey: painting a picture of Canadian postdoctoral scholars. In: Canadian Association of Postdoctoral Scholars and Mitacs; 2013.Google Scholar
- Jadavji N, Adi M, Corkery T, Inoue J, Van Benthem K: The 2016 Canadian national postdoctoral survey report. In.; 2016.Google Scholar
- Vogel G. A day in the life of a topflight lab. Science. 1999;285(5433):1531–2.View ArticleGoogle Scholar
- Clotfelter CT. American universities in a global market. Chicago: University of Chicago Press; 2010.Google Scholar
- McKenzie M. Where are the scientists and engineers? Ottawa: Statistics Canada Science, Innovation and Electronic Information Division; 2007. p. 1–47.Google Scholar
- Fuhrmann CN, Halme DG, O’Sullivan PS, Lindstaedt B. Improving graduate education to support a branching career pipeline: recommendations based on a survey of doctoral students in the basic biomedical sciences. CBE-Life Sciences Education. 2011;10(3):239–49.View ArticlePubMed CentralGoogle Scholar
- Edge J, Munro D: Inside and outside the academy: valuing and preparing PhDs for careers. In. Edited by Canada TCBo; 2015.Google Scholar
- Fadel C, Bialik M, Trilling B. Four-dimensional education: the competencies learners need to succeed, vol. null; 2015.Google Scholar
- Gordon J, Halasz G, Krawczyk M, Leney T, Michel A, Pepper D, Putkiewicz E, Wisniewski J: Key competences in Europe: opening doors for lifelong learners across the school curriculum and teacher education, vol. null; 2009.Google Scholar
- Arevalo J, Pitkänen S, Gritten D, Tahvanainen L: International Forest Review 2010, 12(3):200.Google Scholar
- Tynjälä P, Slotte V, Nieminen J, Lonka K, Olkinuora E, Tynjälä P, Välimaa J, Boulton-Lewis G: High Educ and Working life: collaborations, confrontations and challenges, vol. null; 2006.Google Scholar
- Virtanen A, Tynjälä P, Stenström ML, Billett S, Harteis C, Eteläpelto A: Emerging perspectives of workplace learning, vol. null; 2008.Google Scholar
- Smith S, Pedersen-Gallegos L, Riegle-Crumb C. The training, careers, and work of Ph.D. physical scientists: not simply academic. Am J Phys. 2002;70:1081.View ArticleGoogle Scholar
- Caffarella RS, Zinn LF. Professional development for faculty: a conceptual framework of barriers and supports. Innov High Educ. 1999;23(4):241–54.View ArticleGoogle Scholar
- Webster-Wright A. Reframing professional development through understanding authentic professional learning. Rev Educ Res. 2009;79(2):702–39.View ArticleGoogle Scholar
- Knight P, Tait J, Yorke M. The professional learning of teachers in higher education. Stud High Educ. 2006;31(3):319–39.View ArticleGoogle Scholar
- Åkerlind G. Postdoctoral researchers: roles, functions and career prospects. Higher Education Research & Development. 2005;24(1):21–40.View ArticleGoogle Scholar
- Roxå T, Mårtensson K. Significant conversations and significant networks – exploring the backstage of the teaching arena. Stud High Educ. 2009;34(5):547–59.View ArticleGoogle Scholar
- Brownell SE, Tanner KD. Barriers to faculty pedagogical change: lack of training, time, incentives, and…tensions with professional identity? CBE-Life Sciences Education. 2012;11(4):339–46.View ArticlePubMed CentralGoogle Scholar
- Rybarczyk B, Lerea L, Lund PK, Whittington D, Dykstra L. Postdoctoral training aligned with the academic professoriate. BioScience. 2011;61(9):699–705.View ArticleGoogle Scholar
- Kenny N, Watsons G, Watton C. Exploring the context of Canadian graduate student teaching certificates in university teaching. Can J High Educ. 2014;44(3):1–19.Google Scholar
- Rose M. Graduate student professional development: a survey with recommendations. Ottawa: Canadian Association for Graduate Studies; 2012.Google Scholar
- Scaffidi AK, Berman JE. A positive postdoctoral experience is related to quality supervision and career mentoring, collaborations, networking and a nurturing research environment. High Educ. 2011;62(6):685.View ArticleGoogle Scholar
- Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P. Using logic models to capture complexity in systematic reviews. Res Synth Methods. 2011;2(1):33–42.View ArticleGoogle Scholar
- Joffe M, Mindell J. Complex causal process diagrams for analyzing the health impacts of policy interventions. Am J Public Health. 2006;96(3):473–9.View ArticlePubMed CentralGoogle Scholar
- Rohwer A, Pfadenhauer L, Burns J, Brereton L, Gerhardus A, Booth A, Oortwijn W, Rehfuess E. Series: clinical epidemiology in South Africa. Paper 3: logic models help make sense of complexity in systematic reviews and health technology assessments. J Clin Epidemiol. 2017;83:37–47.View ArticleGoogle Scholar
- Arksey H, O’Malley L. Scoping studies towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.View ArticleGoogle Scholar
- Levac D, Colquhoun H, O'Brien K. Scoping studies: advancing the methodology. Implement Sci. 2010;5(69).Google Scholar
- Colquhoun H, Levac D, O'Brien K, Straus S, Tricco A, Perrier L, Kastner M, Moher D. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.View ArticleGoogle Scholar
- Daudt HML, van Mossel C, Scott SJ. Enhancing the scoping study methodology: a large, inter-professional team's experience with Arksey and O’Malley’s framework. BMC Med Res Methodol. 2013;13:48.View ArticlePubMed CentralGoogle Scholar
- Joanna Briggs Institute: The Joanna Briggs Institute reviewers’ manual 2015: Methodology for JBI’s scoping review.; 2015.Google Scholar
- Bragge P, Clavisi O, Turner T, Tavender E, Collie A, Gruen RL. The global evidence mapping initiative: scoping research in broad topic areas. BMC Med Res Methodol. 2011;11(1):92.View ArticlePubMed CentralGoogle Scholar
- Miake-Lye IM, Hempel S, Shanman R, Shekelle PG. What is an evidence map? A systematic review of published evidence maps and their definitions, methods and products. Systematic Reviews. 2016;5(1):28.View ArticlePubMed CentralGoogle Scholar
- Snilstveit B, Vojtkova M, Bhavsar A, Gaarder M. Evidence gap maps—a tool for promoting evidence-informed policy and prioritizing future research; 2013.View ArticleGoogle Scholar
- Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.View ArticleGoogle Scholar
- Liberati A, Altman D, Tetzlaff J, Mulrow C, Gotzsche P, Ioannidis J, Clarke M, Devereaux P, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700.View ArticlePubMed CentralGoogle Scholar
- Harden A, Thomas J. Methodological issues in combining diverse study types in systematic reviews. Int J Soc Res Methodol. 2005;8(3):257–71.View ArticleGoogle Scholar
- Tricco AC, Lillie E, Zarin W, O’Brien K, Colquhoun H, Kastner M, Levac D, Ng C, Sharpe JP, Wilson K, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16(1):15.View ArticlePubMed CentralGoogle Scholar
- Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.View ArticleGoogle Scholar