Factors influencing the implementation, adoption, use, sustainability and scalability of mLearning for medical and nursing education: a systematic review protocol
© The Author(s). 2016
Received: 26 April 2016
Accepted: 29 September 2016
Published: 19 October 2016
mLearning is increasingly presented as an attractive novel educational strategy for medical and nursing education. Yet, evidence base for its effectiveness or factors which influence use, success, implementation or adoption are not clear. We aim to synthesise findings from qualitative studies to provide insight into the factors (barriers and facilitators) influencing adoption, implementation and use of mobile devices for learning in medical and nursing education. The review also aims to identify factors or actions which are considered to optimise the experience and satisfaction of educators and learners in using mobile technologies for medical and nursing education and to identify strategies for improving mLearning interventions for medical and nursing education.
A systematic search will be conducted across a range of databases for studies describing or evaluating the experiences, barriers, facilitators and factors pertaining to the use of mLearning for medical and nursing education. The framework synthesis approach will be used to organise and bring different components of the results together. The confidence in the qualitative review findings will be assessed using the CERQual approach.
This study will contribute to the planning and design of effective mLearning and the development of mLearning guidelines for medical and nursing education.
Systematic review registration
KeywordsMobile learning (mLearning) Medical education Nursing education Systematic Review
In the past five decades, eLearning (electronic learning) has increasingly been used in health professional education, and technological advances have produced various forms of eLearning modalities such as computer-based simulations, virtual patients and internet-based courses and interactive content . Adoption of these educational strategies in health professional education is substantial, fast growing and yet appears to be ahead of establishing a robust evidence base for consideration of multiple dimensions and outcomes [2, 3]. A noteworthy trend within eLearning is mLearning (mobile learning) defined as “any activity that allows individuals to be more productive when consuming, interacting with or creating information, mediated through a compact digital portable device that the individual carries on a regular basis, has reliable connectivity and fits in a pocket or purse” . This is enabled by growth of capabilities in mobile devices (e.g. laptops, smartphones, tablets) and the convenience they offer, such as omnipresent usability and accessibility to the internet, whilst mobile. Approximately one third of the 3.4 billion people living in rural areas  and 73 % of the total world population  are now covered by mobile broadband.
mLearning can provide access to educational content and information in daily clinical practice [7–9]; enable conversations and the sharing of information and knowledge with other learners; and elicit support from peers and instructors regardless of geographic distance [7–9]. Handheld computers can be used to keep track of students’ skill development and progress in assignments ; promote self-directed and self-regulated learning [11, 12]; display audio-visual information relating a specific place, scene or situation; and inform situated learning .
Evaluations of the effects of eLearning more widely and specifically mLearning as a whole raise more questions than they answer. For example, a meta-analysis by Free and colleagues  included seven randomised controlled trials (RCTs) and investigated the educational outcomes associated with the use of personal digital assistants (PDAs) and portable media players in medical and nursing education. These studies looked at the effectiveness of mLearning in improving the knowledge and attitudes; however, the meta-analysis showed no clear evidence of benefit. There are many factors influencing the effectiveness of interventions that warrant closer investigation. For instance, students’ perceived attributes of the intervention, such as attitudes and satisfaction, can contribute to successful implementation .
Some factors influencing implementation and adoption of eLearning interventions include characteristics of the educational intervention, problem addressed by the intervention, features of the health system, the adopting system and other contextual factors . A number of qualitative studies have been conducted to evaluate factors affecting implementation and adoption of mLearning interventions. However, no qualitative review has been done to systematically evaluate the factors influencing the successful implementation and adoption of mLearning interventions for medical and nursing education. Our review considers the broader issues of implementation, adoption, and the educational impact of mLearning. This is important because mLearning is a relatively new area of development compared to other eLearning approaches and having a systematic and in-depth exploration of the range of potential barriers and facilitators to adoption, use, scalability and sustainability of mLearning in health professional education would deepen understanding of the topic and allow insights to be obtained. It is also important to understand mLearning in terms of the underlying assumptions about teaching and learning (pedagogy) of different approaches so as to maximise the potential richness of the learning process and enable teachers to plan for optimal learning .
Systematic methods can be applied to identify, appraise and synthesise the findings of studies designed to gain insights into people’s experiences of and perspectives on different approaches. Such studies can allow us to better understand the nature of material and socio-cultural influences (e.g. cultural norms), effectiveness of interventions and help us better understand causal pathways , or delineate a more complete picture of the phenomenon under study . These studies also take an interpretive approach thus often collect data using flexible methods (e.g. open-ended interviewing and/or observations) and apply qualitative analysis techniques to provide insights into important concepts and to develop theories. The synthesis of such studies tends also to work mainly with qualitative data (from study reports) and configure study findings to produce themes which may be ordered to describe variation within a phenomenon or to be developed into a new theory .
An initial scoping of the literature has identified more than 40 studies of factors (barriers and/or facilitators) that are potentially influencing mLearning in health professional education, which examine a range of different mLearning approaches from various countries and cover undergraduate and post graduate programmes. However, no review has been identified, which systematically evaluates the factors influencing the use of mLearning interventions for health professional education.
Review aims and research questions
The proposed systematic review aims to draw lessons from empirical research that studied the processes involved in the delivery of mLearning in the field of medical and nursing education or has sought the perspectives of learners, educators and others with experience of mLearning in this field. Themes arising from a synthesis of the findings of this research will be used to consider the teaching pedagogies that teachers using mLearning can adopt to optimise knowledge formation and retention, as well as strategies that might ameliorate negative factors and enhance positive factors potentially influencing mLearning for medical and nursing education.
What are the views of educators, learners, and other key actors with experience of mLearning in medical and nursing education, about perceived factors which facilitate/enhance or hinder its implementation, adoption, scalability, sustainability and educational impact?
Given that the extent of the evidence base that addresses the above research question is unknown; this review will have two stages: a systematic ‘mapping’ of research evidence, followed by an in-depth analysis and synthesis. An initial mapping stage, which tends to use wide-ranging searches and broad inclusion criteria, can be used to help review teams identify a wide range of types of study that can then be screened systematically again, once more is known about the nature of the existing evidence base . In the case of this review, the broad inclusion criteria for the map will enable identification of studies regardless of whether they are labelled by their authors as ‘qualitative’. It may then be appropriate to synthesise all of the studies identified by the map or to select a smaller number that meets a tighter set of inclusion criteria, for example, a requirement that studies use both qualitative data collection and qualitative data analysis methods.
Amongst the many conceptual frameworks that could be validly used for synthesis in this review, we considered Laurillard’s comprehensive Conversational Pedagogical Framework. Laurillard’s framework describes interactions between learners, peers and teachers in both formal and informal learning contexts . It provides a detailed description of components affecting the motivation of the learners in collaborative learning environments using a combination of social learning theories, constructionism and instructionism. The model sees each teacher, each student and the other students they work with as being influenced by each other’s presentations of concepts and responses to learning tasks and goals and also attempts to capture ideas about the influence of teachers’ designs for learning environments as well as learners’ and peers’ responses to each other’s practices within these environments. This model, however, does not consider the influence that socio-cultural constructs can play on the mLearning process in the medical education context. It has been advocated that medical education researchers and curriculum developers consider the external, internal, implementation, experience and impact factors when designing technology-based interventions .
Another conceptual model that might inform this review’s analyses is the one developed by Tabak and Nguyen . This integrates three theories from different domains: the technology acceptance model (TAM) , the concept of self-regulation from social cognitive theory  and the five-factor model of personality  to integrate both intrinsic and extrinsic influences on learners within online learning environments. This middle-range theory might help with exploration of the types of situational variables influencing mLearning processes at the individual learner level.
Criteria for considering studies for this review
Inclusion and exclusion criteria will be required for two different purposes. Firstly, the search results will be screened to identify studies to include in an initial systematic map. These studies will be coded (see below) so as to provide an overview of the nature and extent of the literature that addresses the review’s research questions. Following the consideration of the range of study designs seen in the map, the mapped studies may be screened again using a refined set of inclusion criteria so as to identify studies that have applied certain aspects of study design, with only these studies then being described further, being fully appraised for their methodological quality and having their findings extracted for inclusion in a synthesis.
Types of studies
- Have an abstract in English
- Be conducted in any geographical setting (e.g. low, middle and high-income countries), involving all types of healthcare (e.g. primary, secondary, tertiary) and educational setting (e.g. university, laboratory, medical ward, community)
- Be a report that presents findings or analyses of data from a primary research study (Systematic reviews that meet all other criteria will not be used as a source of data but their reference lists will be screened for other suitable studies. Commentaries, letters, editorials and other kinds of literature reviews will be excluded).
- Be a study that examines people’s perspectives on and experiences of mLearning (see intervention below) so as to produce findings about perceived factors which facilitate/enhance or hinder its implementation, adoption, scalability, sustainability and educational impact. For in-depth review and synthesis, depending on the quantity and nature of the research found in the systematic map, it may be helpful to restrict studies to those that meet the inclusion criteria above and below but also:
- Collect and analyse data primarily through the use of qualitative methods.
○ This would include studies underpinned by theoretical frameworks such as phenomenology, ethnography and grounded theory, as well as many forms of action and narrative research and case studies. Qualitative methods for data collection would include focus groups, in-depth individual interviews and observations.
Types of participants
- The studies should include participants who are or have been enrolled in a pre- or post-professional, undergraduate or postgraduate, medical or nursing professional education programme.
Types of interventions
○ Where mLearning is defined as earlier above. This includes interventions which use mobile phones, PDAs, PDA phones, smartphones, pocket computers, handheld and ultra-portable computers such as tablet personal computers (PCs)
○ Where it is clear that reference is being made specifically to mLearning (for example, not solely to a mixture of mLearning and non-mLearning interventions, in which both types of learning components have been received)
Search methods for identification of studies
This study is part of a larger series of evidence synthesis reviews on eLearning for health professional education conducted in collaboration with the World Health Organization, for which a common search strategy has been developed. Hence, the searches for this review will be run as one component of a larger group of related reviews that also examine the effects of eLearning interventions and barriers and facilitators of eLearning of all types within education for health professionals. The searches covered the following bibliographic databases:
• Systematic review registers:
○ The Cochrane Library (Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Methodology Register)
○ Joanna Briggs Institute Database of Systematic Reviews and Implementation Reports
• Education focused databases:
○ Education Resources Information Centre (ERIC)
• Health focused databases
○ Cumulative Index to Nursing and Allied Health Literature (CINAHL)
○ EMBASE (Elsevier)
○ MEDLINE (Ovid)
• Other databases
○ Web of Science Core Collection (Thomson Reuters)
When searching these databases, sets of terms were identified from each database’s controlled classifying terminology for each of the main concepts found within all of the reviews’ research questions (eLearning, education, medical and nursing students and professionals). These sets of terms will then be combined to find only those records that have been classified with a term relating to all of the concepts. Searches using free-text terms will also be run to help identify relevant studies that, for whatever reason, have not been allocated controlled terms. Searches will be limited to items published from 1990 onwards. At the time of submitting this protocol, more than 40 studies had been identified using the methods for the systematic map. The studies are described in Additional file 1: Appendix 1.
Data collection and analysis
All records of studies that are identified by these searches will be uploaded to the specialist systematic review software EPPI-Reviewer 4 , where duplicate studies will be removed, and the remaining studies will be screened. Separate searches for the purposes of this review will then be conducted within EPPI-Reviewer to identify relevant studies. Further sets of terms will be combined, using the software’s search function, which looks for each search term within a record’s title and/or its abstract. Sets of terms will be developed to cover the concepts central to this review (mLearning, perspectives and experiences) and combined, as described above, so as to identify a set of records to screen. The references of included studies will be screened.
Selection of studies
All review authors will initially work together with a sample set of identified studies. These will be used to pilot the inclusion criteria and then to reach a high level of concordance between all review authors in using the criteria to determine a study’s eligibility for inclusion. The titles and abstracts of each report retrieved from the search strategy and the additional sources described will then be screened independently by two review authors, who will discuss all cases where they initially disagree on whether or not a report should be included. Full reports will be obtained for those studies that appear at this point to meet the inclusion criteria for the systematic map. Retrieved reports will then be screened again, also by two review authors, working independently. A third review author will help decide upon inclusion of a report in all cases where the two initial reviewers cannot agree.
Data extraction and management
• Codes to describe the study context and population, including
○ The country setting (e.g. name of country, which will then be classified using the World Bank classification of low-, lower middle-, upper-middle or high-income country)
○ The educational setting (e.g. university/educational institution, healthcare institution/healthcare setting, community/home)
○ Relevant defining features of the sampled population (e.g. gender, age, years of education/training, type/level of training, years of experience, professional group)
• Codes to describe the intervention under study, including
○ Study aims/research questions
○ Learning expectations
○ The mLearning modality (e.g. iPad, iPod, mobile phone, smart phone, tablet, personal computer, PDAs)
○ Learning platform (e.g. chatgroup, e-book, web-based module, mobile application, computer program)
○ Component of intervention (e.g. skills training, education/information/theory, professional training, provision of resources/supplementary information, services)
○ Duration of intervention (e.g. <1 month, 1–6 months, 7–12 months, >12 months)
• Codes to describe the study design, including:
○ The type of data collection method used (e.g. survey with open-ended questions; observational study using case study techniques; in-depth individual interviews; focus groups)
○ Sampling approach (e.g. convenience sampling, random sampling, purposive sampling, snowball sampling, theoretical sampling)
○ The sampling frame (e.g. course enrolment list, directory of doctors/ nurses working in the hospital)
○ The sample size (e.g. <10, 11–20, 21–50, 51–100, >100)
○ The type of analysis (qualitative only or qualitative and quantitative).
○ Type of outcomes (e.g. attitudes, skills, knowledge, experiences, feelings)
Where possible, the mLearning experiences of the students will be compared based on their age, type/level of educational training, professional group, years of education/ training and learning expectations. All studies that are included in the in-depth review will be described further using additional, standard questions, such as those used in previous reviews of intervention processes and stakeholder perspectives (e.g. Rees et al. ; Shepherd et al. ).
Appraisal of study quality and certainty of review findings
The quality of studies included in the in-depth review will be examined using a quality-assessment tool for qualitative studies (a modified version of a Critical Appraisal Skills Program tool . Studies that meet the inclusion criteria will be included in the review regardless of the study quality, and the quality assessment will be used to describe the findings of the study. Each relevant review finding will be assessed using the GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative Research) approach. The purpose of using the CERQual approach is to assess and describe how much confidence can be placed in findings from systematic reviews of qualitative evidence [29, 30]. The term “confidence” refers to the assessment of the extent to which a finding from the review adequately represents the phenomenon of interest, such that the phenomenon of interest does not differ considerably from the research finding. The CERQual approach is still being refined; hence, the version by Lewin et al.  that we will be using will guide assessment of four aspects, namely the methodological limitations of the qualitative studies that contribute to a review finding, the relevance of the studies that inform a review finding, the coherence of the review finding and the adequacy of data supporting a review finding.
Familiarisation—this stage involves the authors being immersed in the data by reading and studying the papers retrieved with the aims and objectives of the review and listing key ideas and recurrent themes.
Identifying a thematic framework—this process involves the identification of key issues, concepts and themes using the a priori issues in the aims, objectives, experiences and perspectives that recur in the data. This stage results in the formulation of a detailed index of the data, in which data is labelled in manageable chunks for subsequent retrieval and exploration. At this stage, we may incorporate into a framework, aspects of Laurillard’s framework  so as to identify the different pedagogic forms of eLearning that have previously been described by teachers as optimising learning and aspects of the meso-level framework developed by Tabak and Nguyen  to allow consideration of a wider range of intrinsic and extrinsic factors influencing the eLearning process.
Indexing—in this stage, the thematic framework is applied by annotating transcripts of findings from included studies with codes from the index and supporting them with short text descriptors to substantiate the index heading. Review authors will independently read and re-read the selected studies and apply the review’s initial framework. The framework can be applied by moving between the data and themes covered by the framework and searching for additional themes until all of the studies have been reviewed, in an iterative manner. At this stage, the definitions and boundaries of each of the emerging themes will be discussed amongst the review authors and revision of the model will be conducted in line with the ideas and categories that emerge from this process.
Charting—the data is then re-arranged according to the relevant part of the thematic framework, and the information is distilled and summarised into charts. The charts will contain distilled summaries of evidence from different perspectives and involve a high level of abstraction and synthesis.
Mapping and interpretation—finally the charts will be used together with the research objectives and themes that have emerged, to define concepts and explain the findings through clarification of the phenomena, creation of typologies and finding associations between themes.
This protocol is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA)-P Statement for reporting systematic review protocols . A completed PRISMA-P is attached in Additional file 2.
An understanding of factors influencing the implementation, adoption, scalability, sustainability and educational attainment via mLearning is key to maximising its potential and ensure the most appropriate use. In addition, we will identify gaps in literature to inform future research and policy development in this promising area of learning innovation.
We gratefully acknowledge support for this work by National Healthcare Group, Singapore, Nanyang Technological University, Singapore, and UCL Institute of Education, University College London.
Availability of data and materials
All materials described in this protocol and the final manuscript will be made freely available to any scientist wishing to use them for non-commercial purposes.
CK collaborated on the design and content of the review, research questions, methods and protocol. OSY collaborated on the design and content of the review and research questions and reviewed and edited the protocol. YY collaborated on the design and content of the review and research questions and reviewed and edited the protocol. IL advised on this collaborative work and approved the final manuscript. RR is a methodological lead for this review, she collaborated on the design and content of the review and research question and in the selection of methods and reviewed and edited the protocol. JC leads the overall eLearning review series and initiated this work. He acted as the review supervisor and advised on the development and edited the protocol. All authors read and approved the final manuscript.
Consent for publication
All authors have consented for publication
Ethics approval and consent to participate
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Triola MM, Huwendiek S, Levinson AJ, Cook DA. New directions in e-learning research in health professions education: report of two symposia. Med Teach. 2012;34:e15–20.View ArticlePubMedGoogle Scholar
- George PP, Papachristou N, Belisario JM, Wang W, Wark PA, Cotic Z, et al. Online eLearning for undergraduates in health professions: a systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health. 2014. doi:https://doi.org/10.7189/jogh.04.010406.Google Scholar
- Rasmussen K, Belisario JM, Wark PA, Molina JA, Loong SL, Cotic Z, et al. Offline eLearning for undergraduates in health professions: a systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health. 2014. doi:https://doi.org/10.7189/jogh.04.010405.Google Scholar
- Chia Y, Tsai FS, Tiong AW, Kanagasabai R. Context-aware mobile learning with a semantic service-oriented infrastructure. 2011. IEEE Workshops of International Conference on Advanced Information Networking and Applications (WAINA). http://ieeexplore.ieee.org/document/5763619/. Accessed 7 Oct 2016.
- International Telecommunications Union, ICT facts and figures—the world in 2015. 2015. https://www.itu.int/net/pressoffice/press_releases/2015/17.aspx. Accessed 10 Dec 2015.
- GSMA. The mobile economy 2015. https://vk.com/doc34562773_437363041?hash=50ba80999ad4c70b6f&dl=707b55b1d5668c9ea9. Accessed 7 Oct 2016.
- Alegría DAH, Boscardin C, Poncelet A, Mayfield C, Wamsley M. Using tablets to support self-regulated learning in a longitudinal integrated clerkship. Med Educ Online. 2014. doi:https://doi.org/10.3402/meo.v19.23638.PubMedPubMed CentralGoogle Scholar
- Doherty I, Sharma N, Harbutt D. Contemporary and future eLearning trends in medical education. Med Teach. 2015;37:1–3.View ArticlePubMedGoogle Scholar
- Hardyman W, Bullock A, Brown A, Carter-Infram S, Stacey M. Mobile technology supporting trainee doctors’ workplace learning and patient care: an evaluation. BMC Med Educ. 2013;13:6.View ArticlePubMedPubMed CentralGoogle Scholar
- Lehman K. Clinical nursing instructors’ use of handheld computers for student recordkeeping and evaluation. J Nurs Educ. 2003;42:41.PubMedGoogle Scholar
- Davies BS, Rafique J, Vincent TR, Fairclough J, Packer MH, Vincent R, Haq I. Mobile medical education (MoMEd)—how mobile information resources contribute to learning for undergraduate clinical students—a mixed methods study. BMC Med Educ. 2012. doi:https://doi.org/10.1186/1472-6920-12-1.Google Scholar
- Tanaka PP, Hawrylyshyn KA, Macario A. Use of tablet (iPad®) as a tool for teaching anesthesiology in an orthopedic rotation. Rev Bras Anestesiol. 2012;62:214–2.View ArticlePubMedGoogle Scholar
- Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, et al. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med. 2013;10(1):e1001363.View ArticlePubMedPubMed CentralGoogle Scholar
- Al-Shorbaji N, Atun R, Car J, Majeed A, Wheeler EL. Technical report: eLearning for undergraduate health professional education—a systematic review informing a radical transformation of health workforce development. World Health Organisation.Google Scholar
- Laurillard D. Pedagogical forms for mobile learning: framing research questions. In: Pachler N, editor. Mobile learning: towards a research agenda. London: WLE Centre, IoE; 2007. p. 153–75. http://eprints.ioe.ac.uk/627/1/Mobile_C6_Laurillard.pdf.Google Scholar
- Harris J. Using qualitative research to develop robust effectiveness questions and protocols for Cochrane systematic reviews. In: Noyes K, et al, editors. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. 2011. Cochrane Collaboration Qualitative Methods Group.Google Scholar
- Bearman M, Dawson P. Qualitative synthesis and systematic review in health professions education. Med Educ. 2013;47:252–60.View ArticlePubMedGoogle Scholar
- Thomas J, Harden A, Newman M. Synthesis: combining results systematically and appropriately. In: Gough D, Oliver S, Thomas J, editors. An introduction to systematic reviews. London: Sage Publications; 2012. p. 179–227.Google Scholar
- Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1(1):1.View ArticleGoogle Scholar
- Ellaway RH. Apples and architraves: a descriptive framework for e-learning research. Med Teach. 2010;32:95–7.View ArticlePubMedGoogle Scholar
- Tabak F, Nguyen NT. Technology acceptance and performance in online learning environments: impact of self-regulation. J Online Learn Teach. 2013;9:116–30.Google Scholar
- Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quart. 1989;13:319–40.View ArticleGoogle Scholar
- Bandura A. Social foundations of thought and action: a social cognitive theory. New Jersey: Prentice-Hall, Inc; 1986.Google Scholar
- Barrick MR, Mount MK. Yes, personality matters: moving on to more important matters. Human Perform. 2005;18:359–72.View ArticleGoogle Scholar
- Thomas J, Brunton J, Graziosi S. EPPI-reviewer 4.0: software for research synthesis. EPPI-Centre Software. London: Social Science Research Unit, Institute of Education; 2010.Google Scholar
- Shepherd J, Kavanagh J, Picot J, Cooper K, Harden A, Barnett-Page E, et al. The effectiveness and cost-effectiveness of behavioural interventions for the prevention of sexually transmitted infections in young people aged 13-19: a systematic review and economic evaluation. Health Technol Assess. 2010;14:1–206.View ArticleGoogle Scholar
- Rees RW, Caird J, Dickson K, Vigus C, Thomas J. ‘It’s on your conscience all the time’: a systematic review of qualitative studies examining views on obesity among young people aged 12–18 years in the UK. BMJ Open. 2014;4:e004404.View ArticlePubMedPubMed CentralGoogle Scholar
- CASP. 10 questions to help you make sense of qualitative research.” from http://media.wix.com/ugd/dded87_29c5b002d99342f788c6ac670e49f274.pdf.
- Bohren MA, Vogel JP, Hunter EC, Lutsiv O, Makh SK, Souza JP, et al. The mistreatment of women during childbirth in health facilities globally: a mixed-methods systematic review. PLoS Med. 2015. doi:https://doi.org/10.1371/journal.pmed.1001847.PubMedPubMed CentralGoogle Scholar
- Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gulmezoglu M, et al. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015. doi:https://doi.org/10.1371/journal.pmed.1001895.PubMedPubMed CentralGoogle Scholar
- Dixon-Woods M. Using framework-based synthesis for conducting reviews of qualitative studies. BMC Med. 2011. doi:https://doi.org/10.1186/1741-7015-9-39.PubMedPubMed CentralGoogle Scholar
- Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009. doi:https://doi.org/10.1186/1471-2288-9-59.PubMedPubMed CentralGoogle Scholar
- Pope C, Ziebland S, Mays N. Qualitative research in health care: analysing qualitative data. BMJ. 2000;320:114–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Laurillard D. The pedagogical challenges to collaborative technologies. IJCSCL. 2009;4:5–20.Google Scholar
- Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.View ArticlePubMedPubMed CentralGoogle Scholar
- Abate KS. The effect of podcast lectures on nursing students’ knowledge retention and application. Nurs Educ Perspect. 2013;34:182–5.View ArticlePubMedGoogle Scholar
- Al-Fahad FN. Students’ attitudes and perceptions towards the effectiveness of mobile learning in King Saud University. Saudi Arabia: TOJET; 2009. p. 82.Google Scholar
- Alipour S, Moini A, Jafaro-Adli S, Gharaie N, Mansouri K. Comparison of teaching about breast cancer via mobile or traditional learning methods in gynecology residents. Asian Pac J Cancer Prev. 2012;13:4593–5.View ArticlePubMedGoogle Scholar
- Arvey SR, Fernandez ME, LaRue DM, Bartholomew LK. When Promotoras and technology meet: a qualitative analysis of Promotoras’ use of small media to increase cancer screening among South Texas Latinos. Health Educ Behav. 2012;39:352–63.View ArticlePubMedGoogle Scholar
- Bidaki MZ, Sanati AR, Ghannad FR. Producing and introducing mobile books, as a new model of providing learning content in medical sciences. Procedia Soc Behav Sci. 2013;83:99–2.View ArticleGoogle Scholar
- Bogossian FE, Kellett SE, Mason B. The use of tablet PCs to access an electronic portfolio in the clinical setting: a pilot study using undergraduate nursing students. Nurs Educ Today. 2009;29:246–3.View ArticleGoogle Scholar
- Boruff JT, Storie D. Mobile devices in medicine: a survey of how medical students, residents, and faculty use smartphones and other mobile devices to find information. J Med Libr Assoc. 2014;102:22.View ArticlePubMedPubMed CentralGoogle Scholar
- Bruce-Low S, Burnet S, Arber K, Price D, Webster L, Stopforth M. Interactive mobile learning: a pilot study of a new approach for sport science and medical undergraduate students. Adv Physiol Educ. 2013;37:292–7.View ArticlePubMedGoogle Scholar
- Burke S, Cody W. Podcasting in undergraduate nursing programs. Nurs Educator. 2014;39:256–9.View ArticleGoogle Scholar
- Chang AY, Littman-Quinn R, Kyer A, Seymour AK, Kovarik CL. Use of mobile learning by resident physicians in Botswana. Telemed E Health. 2012;18:11–3.View ArticleGoogle Scholar
- Chib A. The Aceh Besar midwives with mobile phones project: design and evaluation perspectives using the information and communication technologies for healthcare development model. J Comput-Mediat Comm. 2010;15:500–25.View ArticleGoogle Scholar
- Clay CA. Exploring the use of mobile technologies for the acquisition of clinical skills. Nurs Educ Today. 2011;31:582–6.View ArticleGoogle Scholar
- Davern MS, Sandsmark E, Schwan J, Odom J, Guiton G, Taylor M. Mobile learning: students’ novel approach to practice problems. Med Educ. 2014;48:1104–32.View ArticleGoogle Scholar
- Davies M. Using the Apple iPad to facilitate student-led group work and seminar presentation. Nurs Educ Pract. 2014;14:363–7.View ArticleGoogle Scholar
- Dearnley C, Haigh J, Fairhall J. Using mobile technologies for assessment and learning in practice settings: a case study. Nurs Educ Pract. 2008;8:197–4.View ArticleGoogle Scholar
- Farrell MJ, Rose L. Use of mobile handheld computers in clinical nursing education. J Nurs Educ. 2008;47:13–9.View ArticlePubMedGoogle Scholar
- Gibbons C. How does having a pocket PC affect doctoral students’ experience of learning? A case-study and its implications for postgraduate research training: Visual Learning Lab. 2009. http://www.nottingham.ac.uk/visuallearninglab/documents/reportfiles/gibbons%20cathy%20final%20paper.pdf.
- Han H, Nelson E, Wetter N. Medical students’ online learning technology needs. Clin Teach. 2014;11:15–9.View ArticlePubMedGoogle Scholar
- Kazlauskas A, Robinson K. Podcasts are not for everyone. Brit J Educ Technol. 2012;43:321–30.View ArticleGoogle Scholar
- Kenny RF, Van Neste-Kenny JMC, Burton PA, Qayyum A. Using self-efficacy to assess the readiness of nursing educators and students for mobile learning. IRRODL. 2012;13:1–10.View ArticleGoogle Scholar
- Kenny RF, Van Neste-Kenny JMC, Park CL, Burton PA, Meiers J. Mobile learning in nursing practice education: applying Koole’s FRAME model. J Distance Educ. 2009;23:75–96.Google Scholar
- Kumar LS, Jamatia B, Aggarwal AK, Kannan S. Mobile device intervention for student support services in distance education context—FRAME model perspective. EURODL. 2011. http://www.eurodl.org/?p=archives&year=2011&halfyear=2&article=447. Accessed 15 Jan 2016.
- Maag M. iPod, uPod? An emerging mobile learning tool in nursing education and students’ satisfaction. Sydney: Sydney Univ Press; 2006.Google Scholar
- Martyn J, Larkin K, Sander T, Yuginovich T, Jamieson-Proctor R. Distance and devices—potential barriers to use of wireless handheld devices. Nurs Educ Today. 2014;34:457–61.View ArticleGoogle Scholar
- Mather C, Cummings E. Usability of a virtual community of practice for workforce development of clinical supervisors. Stud Health Technol Inform. 2014;204:104–9.PubMedGoogle Scholar
- Mather C, Cummings E, Allen P. Nurses’ use of mobile devices to access information in health care environments in australia: a survey of undergraduate students. JMIR MHealth UHealth. 2014. doi:https://doi.org/10.2196/mhealth.3467.PubMedPubMed CentralGoogle Scholar
- McAlearney AS, Schweikhart SB, Medow MA. Doctors’ experience with handheld computers in clinical practice: qualitative study. BMJ. 2004;328:1162.View ArticlePubMedPubMed CentralGoogle Scholar
- McKinney AA, Page K. Podcasts and videostreaming: useful tools to facilitate learning of pathophysiology in undergraduate nurse education? Nurs Educ Pract. 2009;9:372–6.View ArticleGoogle Scholar
- Meade O, Bowskill D, Lymn JS. Pharmacology as a foreign language: a preliminary evaluation of podcasting as a supplementary learning tool for non-medical prescribing students. BMC Med Educ. 2009. doi:https://doi.org/10.1186/1472-6920-9-74.PubMedPubMed CentralGoogle Scholar
- Nestel D, Ng A, Gray K, Hill R, Villanueva E, Kotsanas G, et al. Evaluation of mobile learning: students’ experiences in a new rural-based medical school. BMC Med Educ. 2010. doi:https://doi.org/10.1186/1472-6920-10-57.PubMedPubMed CentralGoogle Scholar
- Pilcher JW, Bedford L. Willingness and preferences of nurses related to learning with technology. J Nurses Staff Dev. 2011;27:E10–6.View ArticlePubMedGoogle Scholar
- Pimmer C, Brysiewicz P, Linxen S, Walters F, Chipps J, Grohbiel U. Informal mobile learning in nurse education and practice in remote areas—a case study from rural South Africa. Nurs Educ Today. 2014;34:1398–4.View ArticleGoogle Scholar
- Pimmer C, Linxen S, Grohbiel U, Jha AK, Burg G. Mobile learning in resource-constrained environments: a case study of medical education. Med Teach. 2013;35:e1157–65.View ArticlePubMedGoogle Scholar
- Schrader K, Nguyen-Dobinsky TN, Kayser K, Schrader T. Mobile education in autopsy conferences of pathology: presentation of complex cases. Diagn Pathol. 2006;1:8.View ArticleGoogle Scholar
- Strickland K, Gray C, Hill G. The use of podcasts to enhance research-teaching linkages in undergraduate nursing students. Nurs Educ Pract. 2012;12:210–4.View ArticleGoogle Scholar
- Tews M, Brennan K, Begaz T, Treat R. Medical student case presentation performance and perception when using mobile learning technology in the emergency department. Med Educ Online. 2011. doi:https://doi.org/10.3402/meo.v16i0.7327.PubMedPubMed CentralGoogle Scholar
- Wallace S, Clark M, White J. ‘It’s on my iPhone’: attitudes to the use of mobile computing devices in medical education, a mixed-methods study. BMJ Open. 2012. doi:https://doi.org/10.1136/bmjopen-2012-001099.Google Scholar
- Wang R, Wiesemes R, Gibbons C. Developing digital fluency through ubiquitous mobile devices: findings from a small-scale study. Comput Educ. 2012;58:570–8.View ArticleGoogle Scholar
- Wu PH, Hwang GJ, Su LH, Huang YM. A context-aware mobile learning system for supporting cognitive apprenticeships in nursing skills training. J Educ Techno Soc. 2012;15:223–6.Google Scholar
- Zolfo M, Iglesias D, Kiyan C, Echevarria J, Fucay L, Llacsahuanga E, et al. Mobile learning for HIV/AIDS healthcare worker training in resource-limited settings. AIDS Res Ther. 2010;7:35.View ArticlePubMedPubMed CentralGoogle Scholar