The characteristics of effective technology-enabled dementia education: a systematic review and mixed research synthesis

Abstract

Background

Dementia education is required to address gaps in dementia-specific knowledge among health and social care practitioners amidst increasing dementia prevalence. Harnessing technology for dementia education may remove obstacles to traditional education and empower large communities of learners. This systematic review aimed to establish the technological and pedagogical characteristics associated with effective technology-enabled dementia education for health and social care practitioners.

Methods

MEDLINE, PubMed, Web of Science, CINAHL, Scopus, PsycINFO, ERIC and OVID Nursing Database were searched from January 2005 until February 2020. Quantitative, qualitative and mixed methods studies were eligible for inclusion. Study quality was assessed with the Mixed Methods Appraisal Tool. Quantitative evidence was categorised based on Kirkpatrick’s Model. Qualitative data was synthesised thematically and integrated with quantitative findings before conclusions were drawn.

Results

Twenty-one published papers were identified. Participants were acute, primary and long-term care practitioners, or were students in higher education. Most training was internet-based; CD-ROMs, simulations and tele-mentoring were also described. Technology-enabled dementia education was predominantly associated with positive effects on learning outcomes. Case-based instruction was the most frequently described instructional strategy and videos were common modes of information delivery. Qualitative themes emerged as existing strengths and experience; knowledge gaps and uncertainty; developing core competence and expertise; involving relevant others; and optimising feasibility.

Discussion

Technology-enabled dementia education is likely to improve dementia knowledge, skills and attitudes among health and social care practitioners from multiple practice contexts. Confidence in the results from quantitative studies was undermined by multiple confounding factors that may be difficult to control in the educational research context. Convenience and flexibility are key benefits of technology-enabled instructive and simulated pedagogy that can support the application of theory into practice. More research is required to understand the role of online learning networks and provisions for equitable engagement. A future emphasis on organisational and environmental factors may elucidate the role of technology in ameliorating obstacles to traditional dementia education.

Systematic review registration

PROSPERO (CRD42018115378)

Background

Dementia is a chronic and progressive syndrome in which there is disturbance of multiple higher cortical functions. Alzheimer’s Disease (AD), vascular dementia, dementia with Lewy bodies and frontotemporal dementia are common subtypes although boundaries are indistinct and mixed forms co-exist [1, 2]. The global prevalence of people living with dementia is approximately 50 million and it is predicted to rise to 152 million by 2050 [3]. Within the UK, 850,000 people (one in 14 adults over the age of 65) are estimated to be living with dementia and future prevalence is predicted to mirror global trends [4]. Despite reports of a decrease in age-specific incidence [5, 6], dementia remains a global public health priority [7].

UK dementia policy and strategies have been implemented to improve care for people living with dementia with key objectives that include improved diagnosis rates, post-diagnostic support and workforce development through staff education and training [8,9,10,11,12,13]. The need for an appropriately educated and dementia aware health and social care workforce responds to demographic transition and also concern about care quality for people with dementia [14]. This requirement permeates the entire health and social care spectrum—it is not limited to mental health professionals and designated dementia care settings [15]. In the UK, one in four hospital beds are occupied by someone living with dementia [4]; however, research suggests that there are gaps in dementia knowledge and skills among acute healthcare practitioners [16]. Hospital admission can present challenges for people with dementia who may struggle to adapt due to the disruptive effects of the acute care environment [17]. Inadequate staff training and knowledge around dementia care can result in unmet care needs and an increase in behavioural and non-cognitive symptoms—which practitioners perceive to be burdensome [18]. Among primary healthcare practitioners, more dementia education is required to address low rates of diagnosis, inappropriate specialist referral and sub-optimal patient management [19]. Gaps in dementia knowledge and skills can also exist among social care practitioners working in specialist dementia services including residential and nursing homes [20]. Inadequate dementia training among the long-term care workforce has been linked to substandard care and job dissatisfaction [21]. Effective dementia education that is embedded within pre-registration health and social care programmes will ensure that the future workforce can carry forward the appropriate knowledge, skills and attitudes that are required to work with people with dementia [22].

Technology-enabled learning has gained popularity due to low costs, high flexibility and reduced dependence on geographical boundaries [23]. It is increasingly being adopted in medical and healthcare educational contexts and may be as effective as traditional learning for knowledge and skills acquisition [24]. Convenience and flexibility are key benefits for health and social care practitioners (HSCP) who may experience challenges addressing professional development. Technology can efficiently remove many logistical barriers to traditional HSCP education and offers individualised and point-of-care learning for professionals from a wide range of practice settings [25]. Communication and collaboration are optimised by Web 2.0 technology [26, 27] which characterises the transformation of the static ‘read only’ Web 1.0 into a dynamic ‘read-and-write’ participatory media that has generated a new paradigm for teaching and learning by offering interconnectivity, interactivity, and content creation [28]. Web 2.0 tools include blogs, wikis and networking platforms that enable, and make visible, the social construction of new knowledge [29].

The COVID-19 pandemic resulted in an overwhelming transition to virtual teaching and learning as a preventative measure to contain the spread of the virus [30]. This represented a transformation and further advancement of digital healthcare education with new practices and principles evolving from a surge in uptake and new knowledge gained [31]. Healthcare educators who will harness the potential of technology for dementia education may contribute to a transformation of dementia education and empower large communities of learners. However, educational technology is not a panacea as learners may experience technical issues, have reduced social contact or have inadequate skills for learning with technology. There is also the requirement for knowledge translation into clinical practice. This is a complex phenomenon which can be influenced by the nature of the knowledge, the target audience, the expected outcomes and the instructional methods [32]. Dementia education has relevance to the entire health and social care workforce. HSCPs are key stakeholders who require training to develop the knowledge, skills, and attitudes required to meet the complexities of dementia care in practice. Kirkpatrick’s Four-Level Model provides a framework for the expected outcomes. These include learners’ reactions to the training; learning gains as knowledge, skills and attitudinal change; practice-based behaviour change following training; and the wider results due to the training [33]. The model has been applied effectively to the dementia education context [34,35,36]. An emphasis on instructional methods and pedagogy ensures that outcomes cannot be attributed to technology per se. In this way, the technology is considered enabling of dementia education [37].

Several reviews of dementia education have been conducted [22, 34,35,36, 38,39,40,41,42,43,44,45,46,47,48,49]; however, there has been limited focus on technology-enabled approaches to dementia education. In their comprehensive review of effective dementia education for the health and social care workforce, Surr et al. [35] highlighted that web-based training using interactive learning approaches were found to increase practitioner confidence, competence and self-efficacy. In general, active learning (e.g., using online multimedia methods) was considered to be more effective than passive approaches (e.g., watching an online video lecture). Online discussions were considered beneficial to learning; however, time demands and the need for specialist technical support suggested this to be a resource intensive form of study. Scerri et al. [34] suggested that e-learning may not always be feasible in healthcare settings due to limitations in participants’ time, internet access and digital competence. In contrast, evidence also suggests that the flexibility of dementia e-learning can be beneficial [35]; however, Surr and Gates [36] recommended that learners do not schedule time for their own e-learning due to difficulties in negotiating adequate time for learning—particularly in areas where there are significant work pressures and staff shortages. Scerbe et al. [41] was the only review that focussed exclusively on digital modes of dementia education and reported predominantly positive post-training effects on dementia knowledge, care strategies, communication skills, self-efficacy and attitudes among various healthcare practitioners.

Surr et al. [35] identified key features for effective dementia education for HSCPs which supports the application of approaches to professional development more broadly. Moehead et al. [50] determined key features associated with effective web-based training which were correlated with a web-based dementia training programme. Table 1 demonstrates effective dementia education features as they relate to key features of effective web-based learning—providing support for technology-enabled dementia education (TEDE). Features of effective dementia education require additional emphasis on training duration, theoretical determinants underpinning practice-based learning and provision of structured guidance for dementia care. Effective web-based training requires additional focus on cost-efficiency, accessibility and the reinforcement of learning. Healthcare education policy will benefit from a robust evidence-base from which practitioners can base their practice [51]. There is potentially more to be known about the effectiveness of TEDE and associated pedagogical characteristics within health and social care, and health science educational contexts. TEDE is a relatively new research area which will require cumulative and robust contemporary evidence that reflects the rapid pace of digital transformation.

Table 1 Features associated with effective dementia education & web-based learning

Aim

This systematic review aimed to establish the technological and pedagogical characteristics associated with effective technology-enabled dementia education for health and social care practitioners. The research questions were:

• ▪ What are the methodological strengths and limitations of studies that evaluate technology-enabled dementia education programmes for health and social care practitioners?

• ▪ How do educational theories guide the design and development of technology-enabled dementia education programmes for health and social care practitioners?

• ▪ Can technology-enabled dementia education improve dementia knowledge, skills and care attitudes among health and social care practitioners?

• ▪ What pedagogical and technological characteristics are associated with technology-enabled dementia education for health and social care practitioners?

• ▪ What are the perceptions and experiences of technology-enabled dementia education among health and social care practitioners?

Methods

The content of this systematic review was informed by the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines and checklist [52] (Additional file 1).

Protocol

The review protocol was registered on PROSPERO (CRD42018115378) and published [2].

Criteria for including studies

Table 2 demonstrates the ‘PICOS’ criteria for including studies in the review.

Table 2 PICOS

Search methods

Literature searches were carried out in MEDLINE (OVID interface), CINAHL Complete (EBSCO interface), ERIC (EBSCO interface), PsycINFO (EBSCO interface), PubMed, Web of Science Core Collection, OVID Nursing Database and SCOPUS from January 2005 until November 2018. Studies published before 2005 were not sought so that the review was based on contemporary evidence that reflects the rapid pace of technological progress and pedagogical opportunities since Web 2.0. Keywords included dementia (and subtypes), education and multiple terms for technological modes of education, learning or training. The search was updated in February 2020. The multi-database search strings are available (Additional file 2).

Data collection and analysis

Selection of studies

The titles and abstracts of studies identified from the search were screened by one reviewer (KM). Two other reviewers (LM and CC) independently screened 10% of the titles and abstracts identified in the initial search—by each screening five percent. Second reviewer title and abstract screening was conducted with rigour. All studies identified in the initial search were ordered alphabetically and stratified into blocks of 10. Each block was then ordered numerically and each second reviewer was assigned to either odd or even numbered blocks. The second reviewers were then required to randomly identify one study per block for title and abstract screening. All reviewers used the same eligibility protocol and any conflicting decisions regarding eligibility were resolved though discussion without the need for third party arbitration. Second reviewer screening was used only at the title and abstract review stage; therefore, the full texts of potentially eligible studies were assessed by one reviewer (KM). Studies that did not satisfy the eligibility criteria following full text review were removed and issued with an exclusion rationale. Studies that were published in a foreign language were discarded as it was not possible to determine their eligibility for inclusion. The reference lists of all eligible studies were screened by one reviewer (KM) and studies that met the eligibility criteria were included.

Data extraction

Standardised quantitative and qualitative data extraction forms were developed for the review context. The data extracted included specific details about the study, participant characteristics, and the exposure of interest (TEDE) including the technological and pedagogical characteristics. Outcome data of significance to the review questions were also extracted. In quantitative studies, this involved extracting data relevant to the primary outcomes (i.e. data relevant to Kirkpatrick’s Model) and associated secondary outcomes. In qualitative studies, all data from the ‘findings’ and/or ‘results’ sections from primary studies were extracted to facilitate the subsequent coding that would precede the generation of themes. The data extraction forms also included evidence from the evaluation of methodological quality of primary studies. The forms were pilot tested before application and all data was extracted by one reviewer (KM). Sample data extraction forms are provided (Additional file 3).

Assessment of methodological quality

The Mixed Methods Appraisal Tool (MMAT) Version 2018 [55] was applied for methodological quality assessment. MMAT is a generic critical appraisal tool designed for systematic mixed studies reviews with specific categories for qualitative research (MMAT1), randomised controlled trials (RCTs)–(MMAT2), non-randomised studies (MMAT3) and quantitative descriptive studies (MMAT4). MMAT can also be used to appraise the overall quality of mixed methods studies (MMAT5). In the current review, MMAT was utilised for the independent assessment of quantitative and qualitative research methods. This approach recognised the binary distinction between quantitative and qualitative research and was considered optimal for subsequent data synthesis which would also employ a segregated approach. Each MMAT category has a specific quality criteria with three response options: ‘Yes’ means that the criteria was met, ‘No’ means that the criteria was not met and ‘Can’t tell’ means that there was not enough information in the paper to judge the criteria. One reviewer (KM) appraised the quality of the quantitative studies using MMAT2 and MMAT3. Second reviewers (LM and KS) appraised the quality of 19% of these studies with disagreements resolved through discussion. The quality of the qualitative evidence was appraised by one reviewer (KM) using MMAT1. The overall methodological quality within and across studies was based on proportions of ‘Yes’, ‘Can’t tell’ and ‘No’ judgements. All quality domains were included in the assessments (i.e. all quality domains were considered important) (Table 3).

Table 3 Approach to formulating summary assessments of methodological quality (across domains) within and across studies

Data synthesis

Key study information was presented in a summary table including intervention characteristics and effects. MMAT scores were included so that intervention effects could be considered in relation to the methodological quality of studies. Thereafter, quantitative and qualitative data were synthesised independently [58]. Intervention effects were established from mean, median or percentage pre- to post-test increases or between group differences that favoured the TEDE. The findings were organised by primary outcomes with care settings in subgroups. Qualitative data was synthesised thematically. An inductive coding system was applied to small data segments of shared content from ‘findings’ or ‘results’ in primary studies. The initial codes were then grouped together into broader themes. Findings were reported in a narrative summary with representative participant quotations where relevant. The quantitative and qualitative syntheses were then combined. The quantitative findings provided evidence for the effectiveness of the TEDE interventions which was complimented, confirmed or refuted by the qualitative evidence. The qualitative data also provided a more comprehensive understanding of the essential characteristics of TEDE through the identification of additional theory. Specific descriptions of educational content, pedagogical characteristics, and educational theories described within the primary studies were not included in the combined synthesis and were reported separately.

Results

Results of the search

The total number of studies included in the review was 21. The initial search resulted in a total of 935 potentially eligible records. A total of 453 duplicate records were identified and removed, and the titles and abstracts of 482 remaining records were screened for relevance based on the eligibility criteria. From these, 417 records were considered to be ineligible and the full texts of 65 records were retained for full-text review. Forty-five records were excluded as they focused on descriptive and narrative-based evaluations of TEDE; were not TEDE interventions; were not relevant to the review outcomes; or included non-HSCPs (informal/family carers). The remaining 20 studies plus an additional study identified from the reference lists of eligible studies were included in the final synthesis (Fig. 1).

Fig. 1

Prisma Diagram [59]

Included studies

All the included studies reported on the effectiveness of TEDE using experimental methods. Four studies described robust mixed methods [60,61,62,63]. There were no standalone qualitative studies identified; however, one descriptive case study used experimental methods to establish learning outcomes [64]. This study was classified as quantitative research to satisfy relevant quality appraisal criteria and for appropriate positioning within the synthesis.

The 21 studies originated from nine countries. Ten studies were conducted in the USA. Australia, Canada and the UK produced two studies each. The remaining studies were from Brazil, Germany, Japan, Jordan and Taiwan. The oldest studies were published in 2006 [65, 66], and the most recent study was published in 2020 [67]. Most quantitative studies used a pre- and post-test design, or variant, including four randomised controlled trials [65, 68,69,70]. There were seven single group pre- and post-tests [60,61,62, 66, 71,72,73]; a single group pre- and post-test with follow up [64]; five equivalent/non-equivalent groups with pre- and post-tests [67, 74,75,76,77]; a three group pre- and post-test [63]; and a within subjects pre- and post-test [21]. The remaining studies included a nonrandomised study with control group [78]; and a one group repeated measure design [79].

Seven studies involved medical and nursing students in higher education [63, 66, 67, 70, 74, 75, 78], six included long-term care workers [21, 68, 71, 72, 77, 79], five studies involved primary care practitioners [60, 64, 65, 69, 76] and one study included hospital care workers [73]. One study involved participants from a variety of healthcare settings [61] and one combined participants from higher education and long-term care [62]. The number of participants varied between 421 GPs initially allocated to participate in an RCT [69] and 8 family physicians who participated in the descriptive case study [64].

All of the studies reported quantitative findings for either knowledge, skills, attitudes, behaviours or results. Several studies reported on multiple outcomes. Knowledge was assessed in all but four studies [65, 67, 77, 78]. Attitudinal change was assessed in seven studies [21, 60, 62, 63, 66, 68, 79]; as were skills [21, 66,67,68, 76, 78, 79]. Practitioner behaviours were considered in four studies [65, 70, 77, 79]. Broader results due to the training were explored in two studies [77, 79]. One study assessed the complete range of these primary outcomes [79]. Full details of the included studies are provided in the Characteristics of Included Studies (Additional file 4).

Excluded studies

From 482 records identified during database searching, 417 were discarded following title and abstract screening. The full text of the remaining 65 studies was examined and 45 were judged to be ineligible based on the eligibility criteria. The excluded studies are presented with exclusion rationales (Additional file 5).

Quality assessment of included studies

Judgments on the quality of the individual studies using MMAT are shown in Fig. 2. Support for judgments are provided in Characteristics of Included Studies (Additional file 4).

Fig. 2

MMAT quality appraisal

RCTs

RCTs were judged to be of low methodological quality overall. It was not clear if randomisation processes had been appropriately performed in two out of the four trials included in the review [68, 70]. Between group incomparability was identified in one of the trials [65], and it was not clear if between group similarities were significant in another [69]. An arbitrary threshold was applied for the assessment of outcome data. Acceptable dropout rates were considered to be < 20%, which negatively affected quality judgments in three trials [65, 69, 70]. One trial was unblinded [65], and it was not possible to tell if outcome assessors were blinded in two trials [69, 70]. Participant adherence may have been compromised in a trial using an unsupervised online dementia training [68]. Non-adherence was more obviously problematic in a trial where ‘non-users’ were identified [69], and in a trial that ended prematurely due to participant dissatisfaction [70]. Review authors’ judgements about each methodological quality item are presented as percentages across all included RCTs (Fig. 3).

Fig. 3

Methodological Quality Graph (RCTs)

Quantitative non-randomised studies

Overall, quantitative non-randomised studies were judged to be of low methodological quality. Several of the concerns identified were due to reporting limitations. It was frequently not possible to determine if participants were representative of target populations. Sampling methods were often not described, or there was insufficient information, in relation to sampling or target populations, for firm judgments. Convenience sampling methods were particularly problematic when assessing participant representativeness. Multiple outcome measures were often used within studies and it was frequently not possible to determine if these measures were appropriate. Limitations included inadequate reports of either validity or reliability, partial reporting of valid/reliable measures in studies using multiple measures, reports of validated measures that may not be reliable and vice versa, previously validated measures that were not validated in context, and measures with questionable reliability from sub-optimal alpha levels. An arbitrary threshold was applied to determine the completeness of the outcome data. Acceptable dropout rates were considered to be < 20%. It was frequently not possible to tell if the outcome data was complete. This was a common issue in pre- and post-tests due to insufficient reporting of participant numbers in either pre or post-tests. Two studies reported outcome data below the desired threshold [71, 77]. Interventions were assumed to have been administered as intended unless studies reported evidence to the contrary. ‘Can’t tell’ judgments were generally applied to studies that reported limitations to study processes, or where there were insufficient assurances of intervention controls including the location of participation. The main threat to study quality was from confounding factors which were either not described or accounted for in the study design or analysis. Time difference between pre and post-tests was a common source for potential confounding factors due to the possibility of maturation effects. Review authors’ judgements about each methodological quality item are presented as percentages across all included quantitative non-randomised studies (Fig. 4).

Fig. 4

Methodological quality graph (quantitative non-randomised studies)

Qualitative studies

Qualitative studies were judged to be of moderate methodological quality overall. Specific research methodologies were not reported; however, all studies described otherwise robust qualitative data collection and analysis methods. The form of the data collected and coding methods for data analysis were not described in two studies [60, 62]. Most studies provided representative quotations to justify themes that were identified in the data. Themes were less obvious in one study despite reporting a thematic approach to data analysis [60]. Coherence between qualitative data sources, collection, analysis and interpretation was judged to be satisfactory overall. Review authors’ judgements about each of the methodological quality item are presented as percentages across all included qualitative studies (Fig. 5).

Fig. 5

Methodological quality graph (qualitative studies)

The characteristics and effectiveness of TEDE

A full summary of the included studies and intervention effects is shown in Table 4.

Table 4 Summary of included studies and intervention effects

Theories informing TEDE

Educational theories were not always reported. Chao et al. [79] described the application of principles from Knowles’ Adult Learning Theory to guide the development of their internet-based communication education programme. Accordingly, the authors acknowledged that ‘personal experience in life fosters a desire to understand or a need to perform a job more effectively, thus inspiring a higher motivation to learn’. Downs et al. [65] reported that the educational interventions included in their study reflected ‘different approaches to adult learning’. Hobday et al. [73] cited sources for incorporating effective adult learning principles into their online dementia modules and provided additional evidence of theory-based interactive design principles.

Cognitive constructivism and social constructivism were described in a comprehensive account of learning theories provided in the context of an online dementia education programme for rural physicians [64]. Cognitive constructivism was described as being ‘orientated towards the understanding of individual knowledge construction’ where learning is ‘an active, constructive, cumulative, and goal-oriented process’. Social constructivism, on the other hand, was defined as ‘the interdependence of social and individual processes for the co-construction of knowledge’ whereby learners ‘actively co-construct with others and the self’. The Four-Stage Theory of Physician Learning was described as having a basis in social constructivism and was included in a more focused theoretical framework for physician learning. Despite problem-based learning being referred to as a small group activity, Tomaz et al. [76] described this as simply being a ‘constructivist educational approach’ with influence from cognitive psychology. De Witt Jansen et al. [61] described ‘communities of learners’ in the context of their highly interactive tele-mentoring intervention. The Community of Practice Theory was cited to emphasise importance of ‘learning through continuous participation in a collaborative community consisting of peer learners and expert individuals’.

Rababa and Masha'al [67] explained that branching path simulation was informed by analytic decision-making learning theories and principles of behaviourism and cognitivism. Kimzey [63] discussed Kolb's Experiential Learning Theory which served as a guide for a dementia experiential learning intervention that was compared with TEDE. Tsai et al. [77] discussed Bandura’s Social Learning Theory and suggested that ‘behaviour can be learned through modelling and observation’ which supported their novel simulated training approach to reinforce appropriate caregiving techniques for optimal independence among long term care residents.

The effectiveness of TEDE

Intervention effects were pre- to post-test increases or between group differences favouring TEDE. The first time point was used where studies included follow-up or time series data. Effectiveness was based on a positive direction of effect alone as reliance on statistically significant findings can result in limitations if underpowered studies (that do not report significant effects) are discarded [82]. A summary of intervention effects is shown in Table 5.

Table 5 Summary of intervention effects

TEDE was associated with mostly positive effects across the primary outcomes and in each practice setting. One study did not demonstrate positive attitudinal change among long term care practitioners—although some effects were noted over time [79]. In addition, nursing students’ attitudes did not improve following an online module; however, attitudinal change was observed in students who participated in an experiential learning arm of this study [63].

It is noteworthy that a greater proportion of non-significant findings were established at higher levels of Kirkpatrick’s model (i.e. behaviours and results). There was limited evidence to support practitioner learning gains as determinants of these broader outcomes. Satisfaction with TEDE was not reported in the summary of intervention effects as this outcome was rarely assessed using experimental methods.

The characteristics of effective TEDE

Instructional and design features

All interventions were effective on at least one of the primary outcomes. Each study was screened for descriptions of intervention characteristics and the main pedagogical characteristics were noted. Online learning was the most frequently described delivery format [21, 60, 62,63,64, 68, 70,71,72,73, 78] with four studies describing blended learning approaches [69, 74, 76, 79]. Tele-mentoring [61] and simulation activities [67, 75, 77] were among more contemporary approaches whereas two of the oldest studies described CD-ROM training [65, 66]. Case-based instruction was the most frequently described instructional strategy [61, 62, 64, 65, 67, 69, 70, 73,74,75,76, 79]. Video-modelling [21, 68, 77] and reflective activities [65, 74, 79] were also described. Video was a popular mode of information delivery [21, 60, 66, 68, 70,71,72,73,74, 76,77,78,79]. Real-life videos including people with dementia, HSCPs and dementia experts were common video attributes [60, 71, 73]. Modes of information delivery were not always specified within the primary studies; however, graphics, text or audio were common multimedia choices [21, 64,65,66,67,68, 70,71,72,73,74,75,76,77,78]. Where online discussions were described [61, 64, 74, 76, 79]; three studies specified the use of asynchronous discussion boards [64, 74, 76] and one described a synchronous chat facility [76]. Assessment of learning frequently included assessments, quizzes or multiple choice questions with immediate feedback being an obvious benefit of TEDE. Hyperlinked text was occasionally included for access to external resources. Printed material was not a common resource characteristic.

Educational content

The educational content varied across healthcare settings. Table 6 consolidates the main learning outcomes where described in primary studies.

Table 6 Educational content

Qualitative findings

There were variations in qualitative research objectives and context with prominent difference between pre-TEDE perceptions of dementia care and education [60, 63] and post-TEDE perceptions [60,61,62]. This resulted in two distinct groups which were synthesised independently. A structured summary of the qualitative evidence is presented with the initial codes and resulting themes generated in the synthesis (Additional file 6).

Pre-TEDE perceptions on dementia education and training

Theme 1. Existing strengths and experience

The qualitative data revealed that learners often bring existing knowledge and personal experience to their dementia education. One student stated that she ‘... cares about learning more because family member has disease’ [63]. Existing dementia knowledge was also influenced by media sources with informal learning accounting for some basic proficiency and caregiving competencies among less experienced practitioners [63]. Experiential variation also resulted from differences in professional exposure [60].

Theme 2. Knowledge gaps and uncertainty

Nursing students who were anxious about providing care to people with dementia were keen for more knowledge before engaging in practice. Students often held negative perceptions about dementia and perceived experiential learning to be necessary, as one student suggested: ‘it would be helpful to interact and gain experience with people with AD’ [63]. Another student requested ‘more knowledge before experiencing people with AD so they [sic] would know what to expect’ [63]. Practice-based experiences were not sufficient for primary care practitioners who managed their uncertainty by referring people with dementia to specialists for further investigation and diagnosis [60].

Post-TEDE perceptions on dementia education and training

Theme 1. Developing core competence and expertise

Practitioners frequently reported new knowledge and skills following TEDE. Learner gains also included positive attitudinal change and the application of new behaviours in practice [60,61,62]. Practitioners developed dementia awareness, confidence and increased self-efficacy to perform new skills, as one primary care physician highlighted: ‘What I found very helpful was knowing that you can confidently assess a patient in general practice for dementia and actually start treatment in general practice and looking at the patient holistically’ [60]. Learning gains were associated with developing dementia expertise to a level to which it could then be shared with others [60, 61].

Theme 2. Involving relevant others in TEDE

Participant perceptions following a tele-mentoring programme with significant input from dementia professionals provided valuable evidence for TEDE instructional methods. One learner commented: ‘I liked having access to people with specialist knowledge and experience that was very helpful’ [61].

Participants enjoyed learning in online groups, which was considered important to reduce feelings of professional isolation and for maintaining motivation. Practitioners also enjoyed multidisciplinary perspectives which provided reassurances on their existing practice. A sense of community was considered to be a key benefit. Group work was not universally accepted with reticence noted among some practitioners who feared exposing perceived challenges to a diverse audience [61]. Isolation was also perceived to be problematic where interactivity was not possible [62].

Theme 3. Optimising feasibility

Forward planning was considered important for successful TEDE. Planning for staff cover and time away from clinical responsibilities were key considerations, as were advance preparations for learning activities. Protected learning time was advocated to avoid interruptions during TEDE; however, capacity for protected learning was considered to be dependent on the healthcare setting and clinical demands. Convenience and flexibility were considered to be benefits of TEDE which eliminated the need for travel, expenses, and time away from clinical practice as one participant confirmed: ‘the convenience of, you know, being able to … dial in from … my laptop in work is very helpful … for the two of us contributing here today up in [Trust], having to get down on a weekly basis to something in Belfast you know is not … feasible’ [61]. Technical problems were perceived to be an occasional barrier to TEDE.

Quantitative and qualitative evidence

Evidence from quantitative and qualitative data sources provided support for TEDE as an effective approach for knowledge and skills development among HSCPs. There was consensus across the research paradigms that TEDE can also support attitudinal and behavioural change. The quantitative evidence was weaker at higher levels of Kirkpatrick’s framework due to smaller samples and a relatively higher incidence of non-significant effects. Similarly, results due to training were seldom described in the qualitative evidence, although learning and experiential developments were highlighted which may have indirect influence on broader outcomes. The qualitative data highlighted that practitioners are likely to bring some existing dementia knowledge and skills and illustrated confounding factors including demographic variation and media influence that were not considered in the primary quantitative research. The relative profusion of quantitative evidence provided more support for TEDE within multiple practice contexts.

The inductive approach to qualitative synthesis established additional constructs that were not accessible from the quantitative data using Kirkpatrick’s model. In general, the qualitative evidence provided a broader competency and proficiency context and highlighted additional concepts such as awareness and confidence that did not easily fit into the pre-defined quantitative framework. Self-efficacy was established as a unique and important construct which positions it as a crucial factor for student motivation and improved behaviours in practice [83]. Practitioner expertise following TEDE emerged as a key theme; however, TEDE may only provide foundations for the development of expertise which is likely to require additional experience in practice [84]. The need for experiential learning was highlighted by novice practitioners in particular in order to address fear and uncertainties towards dementia care. This was supported by quantitative evidence where experiential learning was associated with significantly improved learning outcomes compared to TEDE [63].

Primary quantitative studies frequently detailed instructional design strategies and information delivery methods. However, the effects from specific pedagogy were not evaluated; therefore, TEDE effectiveness was attributed to the overarching delivery method. Several studies acknowledged this limitation and incorporated survey reports for more specific feedback of learner preferences. The qualitative evidence provided more focus on instructional design methods and highlighted group learning and access to dementia experts as key pedagogical strategies. Learning with and involving relevant others in TEDE emerged as a key theme which was contextually related to a highly interactive tele-mentoring programme where group work was key.

The qualitative evidence provided additional insights into TEDE through the identification of barriers and facilitators. Convenience and flexibility emerged as the key facilitating factors which are widely reported in the educational technology literature [25, 32, 85, 86]. The potential for technical issues and need for organisational support were potential barriers.

Discussion

This review aimed to establish the characteristics of effective TEDE for HSCPs. The findings were based on 21 studies which provided support for TEDE to improve dementia knowledge, skills, and care attitudes among HSCPs from multiple practice contexts. Confidence in the findings was undermined by limitations in the methodological quality of quantitative studies. RCTs incurred negative quality judgments due to incomplete outcome data and issues with intervention non-adherence. Randomisation processes were generally well described which mitigates allocation bias and supports a causal inference between TEDE and the learning outcomes. However, unlike clinical trials, where the variables of interest can be tightly controlled, randomisation may not adequately control for other sources of error that are common in educational research. Frequent ‘confounders’ include changes in participant motivation, effects of other (non-intervention) training experiences and contextual factors [87]. Confounding also had a substantial negative impact on quality judgments in quantitative non-randomised studies. These extraneous variables appear to be pervasive in educational research which may explain why several TEDE studies described additional evaluation strategies that transcend cause and effect by incorporating context and experience through the integration of programme evaluations and mixed research methods. Crucially, the omission of confounding, as a quality indicator, would have increased the overall quality of the evidence from low to moderate. This brings in to question the relevance of generic appraisal tools (e.g. MMAT) to the educational research context. Confounding bias was not the only concern. MMAT appraisal resulted in frequent ‘Can’t tell’ judgments for participant representativeness despite several evaluations describing intentionally pragmatic sampling methods involving accessible learner cohorts. In contrast, issues from outcome measurement may have greater relevance to the educational research context as outcome measures need to accurately reflect instructional content. Specific tools for quality assessment of educational research studies have been developed. For instance, the Medical Education Research Study Quality Instrument (MERSQI) is a valid and reliable tool designed to measure the quality of experimental, quasi-experimental, and observational studies [88]. MERSQI assigns higher values to RCTs—but it does not include control of confounders as a specific quality indicator. It puts emphasis on the number of institutions studied and response rates, type of data, validity of evaluation instruments, data analysis techniques and key educational outcomes—which are well-aligned with Kirkpatrick’s model. The qualitative evidence was considered to be of higher methodological quality overall. Judgements on the quality of the qualitative studies were based on broad quality domains that are likely to have relevance to multiple research contexts.

Online learning was the most frequently described delivery method in TEDE. Case-based instruction was frequently used within training programmes based on real, virtual or text-based patient cases—which can support the application of theory into practice [89]. E-simulations were contemporary case-based innovations enabling learners to rehearse dementia care skills in a safe environment before application in practice [90]. Future research might explore innovative approaches to develop practitioners’ affective empathy in case-based learning. For instance, positive dementia care attitudes can often result from an appreciation of personhood [91]. Ethnodramas present real-life video cases that promote person-centred care through emotional engagement in the lives of people with dementia. This approach has been used effectively with large groups of healthcare staff and resulted in positive organisational culture change [92]. Incorporating narratives from the arts and humanities (such as film) may also develop practitioners’ awareness, providing insights into ‘what it is like’ for the person experiencing the condition [93]. Distinct from instructional methods, videos, graphics, text and audio were common TEDE multimedia. These media have specific attributes that may enhance learning processes [94]. Educators are encouraged to provide clear justifications for multimedia choices, in relation to how the human mind works and how they can be applied to optimise dementia education [95].

The literature confirmed differences in learning outcomes between practitioner groups which supports recommendations for role relevant dementia education [35]. It is however important that generic core competencies such as person-centred care and communication skills are not overlooked. Experiential variations based on professional, educational, and personal exposure to dementia are all likely to influence more specialised training needs. Future research might consider how technology can be harnessed to respond to individual learning requirements. Adaptive learning technology is an approach which allows users to enter personal data and make choices which alters pathways within programmes to produce material that is relevant [96]. This type of approach was described in a TEDE intervention for informal caregivers, volunteers and professional caregivers [97]. Educators, researchers and instructional designers might explore options for more learner-centred TEDE that is sensitive to existing experience. Practitioners must also have appropriate digital experience and skills to engage with TEDE. Despite requirements for the development and sustainment of digital competency from professional regulators [98], there are significant degrees of anxiety, and even resistance, from HSCPs around the professional use of digital technologies [99]. It is essential that all learners can engage equitably in TEDE and healthcare organisations must recognise digital literacy as a core skill for HSCPs and assist in the development of digital competence [100]. Interventions that are simply easy to use are unlikely to be sufficiently equitable for practitioners with established digital skills who may thrive using more advanced systems.

Peer discussions provide a critical dimension to learning processes regardless of whether they are online or in the traditional classroom [101]. Online learning communities can foster a sense of social connection and are valuable spaces for productive dialogue as learners often prefer online discussions to face-to-face conversations [25]. Learning communities in TEDE were well received by practitioners and may provide opportunities for professional and peer support, debrief and reflection. Reflection was a frequently described pedagogical strategy which can develop depth of understanding and have a wider impact on learning than simply acquiring new knowledge and skills [102]. It has particular relevance to dementia education given the emotional and psychological implications of practice and may play an important role in cultivating practitioners’ affective empathy where conventional ‘testing’ models are not appropriate. Future research might aim to understand the skills and levels of professional moderation required to support reflection and debrief in online TEDE communities. The strengths and limitations of synchronous and asynchronous discussion forums would also merit further investigation. Communication and collaboration are key benefits from Web 2.0; however, it is not clear if social networking has a role in augmenting learning conversations. More research would help determine the suitability of social media in TEDE including the potential for confidentiality issues and professionalism concerns [103].

Future TEDE research might aim to understand how key attributes—convenience and flexibility—can support practitioners who experience barriers to professional development as a result of access limitations. Rural practitioners may gain particular benefit; however, barriers to TEDE in rural areas would also require consideration given the established urban-rural digital divide [104]. TEDE research, like all educational research, is highly context dependent and the ‘real world’ influence cannot be easily eliminated [105]. This suggests that future research might shift focus from effectiveness and generalisable solutions towards a more nuanced understanding of TEDE and the complex environments in which it is situated [106].

Limitations

This review has several limitations. Firstly, the identification of an additional study in citation searching implied limitations to the search strategy. A possible cause for this was the use of the unexploded thesaurus term ‘education’ and the omission of synonymous terms including keywords and relevant variations. The rationale for the search strategy was described at the protocol stage and aimed to increase the precision of the search by reducing irrelevant results from the diverse array of educational subheadings that exist within educational subject headings. To compensate for this, the search strategy was formulated to include additional database-specific thesaurus terms relating to ‘technology-enabled learning’. For instance, ‘Computer-Assisted Instruction’ and ‘Education, Distance’ were thesaurus terms identified in MEDLINE, whereas the educational resource ERIC offered additional and alternative terms (i.e. ‘Blended Learning’, ‘Electronic Learning’, ‘Distance Education’, ‘Multimedia Instruction’, ‘Web Based Instruction’, ‘Online Courses’ and ‘Computer Assisted Instruction’). The associated keywords were developed to contain both a technological and educational component (e.g. online and education) which were formulated with appropriate variations and translated for functionality across the multiple databases. However, the technological components identified may not have been inclusive and variations on the educational component were not consistently integrated. The development of the search strategy was an iterative process guided by a subject librarian and the final search terms were modifications based on multiple search efforts and related retrieval information. It is worthwhile to note that there can be diminishing returns for ongoing search efforts, i.e. after a certain stage, each additional unit of time invested in searching returns fewer references that are relevant to the review [56]. It was however important to the rigorous conduct of this systematic review that the final search strategy was presented, and limitations acknowledged, for increased clarity, transparency and future reproducibility.

The review process included strategies to optimise the identification of relevant studies. Searching multiple bibliographic databases and the reference lists of eligible studies helped to achieve reliable accounts of TEDE characteristics and effectiveness. Bias may have been further minimised through the integration of additional supplementary search methods, e.g. contacting study authors for details of other potentially relevant studies. Decisions to perform additional search methods were influenced by time and resources available; therefore, study authors were not contacted as this can be time consuming with low response rates and no guarantee of obtaining relevant information [107]. It is nonetheless important to highlight this as a limitation and potential source of bias.

The study selection process was comprehensive; however, two papers entitled ‘resources’ could not be located and were discarded at the screening stage. Title and abstract screening, data extraction and quality assessment were mostly conducted by one reviewer due to resource limitations. Risks of selection bias were mitigated by second reviewers screening a percentage of titles and abstracts. Second reviewers also appraised a proportion of studies to mitigate error and subjective judgment in quality assessment. Language bias could also have been introduced in the review as it was exclusively based on English-language reports. Furthermore, studies published in a foreign language were simply discarded at the screening stage which did not permit insights into the extent and effects of this potential bias.

Methods to assess the overall quality of included studies were adapted from guidance that suggests review authors identify the most important domains (‘key domains’) that feed into assessments [56, 57]. In the current review, all domains were considered to be important as issues with confounding bias became apparent following quality assessment. It is worth reiterating that the exclusion of confounding bias, as an unimportant domain, would have resulted in greater confidence in the quality of the evidence overall.

The effectiveness of TEDE was established from vote counting techniques as heterogeneity precluded meta-analysis. This did not include information on the magnitude of effects or differences based on the relative size of studies [82]. Quality judgments were not factored into the analysis of effectiveness; therefore, outcome effects require cautious interpretation. Experimental studies were appropriate to establish intervention effects; however, additional TEDE characteristics may have been identified from descriptive research. This review did not therefore provide a comprehensive account of innovative TEDE practices. It is also important to highlight that effectiveness was attributed to overarching delivery methods and the effects of specific pedagogy were not established. The pedagogical characteristics identified are unlikely to be fully representative due to underreporting in primary studies. Further, broad conclusions on overall TEDE effects were reported despite multiple intervention types being described.

The complexities of TEDE and educational research represented challenges for strict fidelity to the review protocol. It was not possible to report on the full range of secondary outcomes due to reporting limitations in primary studies. Qualitative evidence was intended to complement quantitative evidence; however, the dependency on robust qualitative evidence resulted in a more complete and contextual portrayal of TEDE and shift from complementarity towards triangulation—which omitted several accounts of user satisfaction and subjective experience with TEDE [21, 64, 66,67,68, 71,72,73,74,75, 77]. Analytic themes were not generated from the qualitative synthesis as descriptive themes sufficiently represented the qualitative data, providing support for TEDE and future research. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to comment on the certainty of the quantitative findings was not included due to highly heterogenous study data that were not amenable to the synthesis techniques required for robust appraisal. The GRADE-CERQual approach was not applied to qualitative findings as MMAT appraisal provided sufficient confidence in the quality of the limited qualitative evidence.

Conclusions

TEDE is a convenient and flexible teaching and learning approach that can develop dementia care competence and confidence among various HSCPs. Translation of theory into practice is optimised by case-based instruction using various multimedia that can emulate real-life situations providing a useful proxy for traditional and experiential learning. Reflective activities and debrief are achievable following simulated or instructive activities; however, learning networks for group discussions may require moderation and optimal communication platforms need to be established. Equitable engagement will be critical to the future success of TEDE which may require protected learning time, technical support and sustainment and development of digital skills among practitioners. Future TEDE research might acknowledge critical differences between clinical and educational research and place greater emphasis on specific pedagogy within interventions and the role of TEDE in ameliorating organisational and environmental limitations including barriers to traditional dementia education.