- Open Access
- Open Peer Review
Computer-based cognitive interventions for mild cognitive impairment and dementia in older adults: protocol for a systematic review of published studies and meta-analysis
Systematic Reviewsvolume 8, Article number: 231 (2019)
A growing number of older adults experience mild cognitive impairment (MCI) and dementia. Recent technological advances allow for traditional cognitive interventions to be administered via computers and other devices. The aim of the proposed systematic review and meta-analyses is to determine the efficacy of computerised cognitive interventions for MCI and dementia in older adults.
We will systematically search electronic databases and reference lists to identify randomised controlled trials. We will include studies that examine the use of computer-based cognitive interventions for adults aged over 60 with MCI or dementia. Primarily outcomes are global and domain-specific cognitive function. Secondary outcomes are attitudes (usability, understandability, acceptability of the intervention), mood and quality of life. Risk of bias will be assessed. Finally, the summary effect sizes will be reported.
This systematic review will summarise existing high-quality primary studies on computerised-cognitive interventions for MCI and dementia. Results from this review will provide the basis for future research in developing computer-based interventions for this population.
Systematic review registration
Globally, the number of older persons—aged 60 and over—is growing faster than any other age group . Therefore, the prevalence of later-life cognitive disorders can be expected to increase. Dementia, or major neurocognitive disorder (DSM-5), is the significant impairment of cognitive performance in one or more cognitive domains (e.g. complex attention, learning and memory, executive function, language), ultimately resulting in functional incapacity and death . The most common cause of dementia is Alzheimer’s disease, where it affects 6–9% of adults aged over 60 worldwide . Mild cognitive impairment (MCI) involves cognitive decline that is greater than that which occurs in normal ageing, with some limitations to daily function (Statistical Manual of Mental Disorders (fifth ed.; DSM-5). It is estimated that MCI affects up to 42% of older adults and precedes the onset of dementia .
Studies have indicated that computer-based interventions may be beneficial for improving or maintaining cognitive function to slow the trajectory of cognitive decline, for both those with MCI and dementia [5,6,7,8,9,10]. In recent years, advances in computer technology have allowed such interventions to be administered using personal computers, laptops, tablets and other mobile devices, in an increasingly accessible, individualised and cost-effective manner. The usefulness of computer-based interventions has also been demonstrated in meta-analyses [11, 12]. However, these meta-analyses have been associated with methodological limitations. For example, Garcia-Casal et al.  used a fixed-effects statistical model to calculate summary effect sizes. Such a model assumes that all differences between studies can be accounted for by sampling error . Hence, this study may have unintentionally inflated effect sizes. To correct for such inflation, Hill et al.  used a random-effects statistical model  but failed to discriminate between active and passive control groups in their statistical analysis. Similarly, Sitzer et al.  included mixed treatment types (e.g. computerised training with exercise); therefore, were not able to distinguish the effects of computerised training from those associated with adjunct interventions.
We aim to conduct a systematic review and meta-analysis that uses a random effects model and that compares the effects of computerised training that is not mixed with other interventions, with three types of control groups—placebo, active and passive. The review will consider the effects of such training for individuals diagnosed with dementia and MCI. The purpose of this systematic review protocol is to transparently present the method we will undertake in order to conduct the systematic review, such that it could adequately be replicated. This method includes information regarding eligibility criteria, information sources and search strategy to be used, and the process of data extraction, synthesis and analysis.
Protocol and registration
This protocol was developed in adherence with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines , see Additional file 1 for the PRISMA-P checklist. The review will also adhere to the guidelines specified by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) . This review has been registered with the International Prospective Register of Systematic Reviews (PROSPERO); CRD42016050236.
We will include published randomised controlled trials. Other study designs will be excluded to minimise the influence of selection and reporting bias on summary effect sizes .
The target population is older adults (> 60 years old) who have a diagnosis of dementia or MCI, confirmed by a trained practitioner (e.g. medical practitioner). Studies that include participants below the age of 60 will be included if the mean age of participants is 60 or over .
Included interventions will be computer-based, i.e. delivered on personal computers, laptops and other devices such as tablets and mobile phones, and may be categorised as cognitive stimulation, cognitive recreation, cognitive rehabilitation, cognitive training , or cognitive remediation. The intervention must be designed to improve cognitive function and may be of any length and intensity. Dual interventions, e.g. combined cognitive training and medication will be excluded .
Any type of control group may be included in the review, including placebo, active and passive conditions. Examples of such groups are care-as-usual, non-computerised cognitive training, pharmacological and waitlist conditions. Participants on their usual treatment medication will not be excluded .
The primary outcomes are global cognitive functioning (measured by tests such as the Mini-Mental State Examination) and domain-specific cognitive function (measured by tests such as Hopkins Verbal Learning Test-Revised for memory and the Delis-Kaplin Executive Function System for executive function). Secondary outcome measures will be participant attitudes toward the intervention (e.g. usability, understandability and acceptability), mood and quality of life.
Search methods for identification of eligible studies
The electronic search strategy was guided by the Cochrane Handbook of Systematic Reviews of Interventions . We will search The Cochrane Central Register of Controlled Trials (CENTRAL) , Scopus (which includes most of Embase), CINAHL (via EBSCOhost ), MEDLINE (via PubMed) and ALOIS. Standard filters for identifying RCTs will be applied to CINAHL and MEDLINE.
Search terms were guided by previous meta-analyses [11, 12]. Search terms were chosen to describe the concepts of the health condition, the intervention and the study design included in this review. The references of studies meeting the inclusion criteria and meta-analyses found on the topic of interest will be screened by hand. Preliminarily searches have been conducted to ensure the scope of this review is viable, see Additional file 2 for results of the preliminarily search. An example preliminary search of Cochrane Central revealed 437 records based on the following terms: geriatric OR old* OR elder* OR “late* life” OR senior AND “mild cognitive impairment” OR dementia AND “cognitive training” OR “cognitive rehabilitation” OR “cognitive remediation” OR “brain training” OR “computer training” OR “brain games” OR “brain exercise” OR “cognitive therapy” OR “cognitive treatment” OR “cognitive interventions”.
Data collection and analysis
Selection of studies
Studies must be in English and can be from any country of origin to be included. Two authors will screen the search results at the title, abstract and full-text level . We will use online screening and extraction software Covidence to conduct all stages of screening . Discrepancies between the reviewers’ decisions will be resolved by reaching consensus or by obtaining the opinion of a third reviewer. Reasons for excluding studies at the full-text stage will be recorded. A flow chart illustrating the search and selection process of the review will be included in the final review and inter-rater reliability statistics will be reported.
Data extraction and management
We will extract pre-defined data from studies chosen for inclusion in the review using a paper-based data extraction form.
Publication details: authors, title, journal, year, geographical location in which the study was conducted and funding source.
Study design: type of study (e.g. RCT)
Participant details: sample size, demographic information (e.g. age and gender of participants), condition (e.g. MCI or dementia), participant drop out/completion rates.
Intervention details: the Tidier Checklist  will be used to guide the extraction of the intervention details, with particular attention to technology and software used, the aim of the intervention, dosage and timing of the intervention, information regarding the comparator group(s).
Outcome details: data for primary and secondary outcomes.
Two authors will extract data from the included studies; disagreements will be resolved by a third author. We will contact study authors to obtain further information where necessary. The data will then be exported into the Review Manager (RevMan) program for further analysis . The extracted data will be made available to the public.
Assessment of risk of bias in included studies
To assess the risk of bias of individual studies, two reviewers will use the risk of bias assessment procedure in RevMan independently. Disagreement will be resolved by consensus or a third reviewer and inter-rater reliability statistics will be conducted.
Measures of treatment efficacy
It is expected that different measures will be used to assess treatment efficacy; therefore, we will use the standardised mean difference. This is calculated by dividing a study’s mean difference by that study’s standard deviation . Separate analyses will be conducted for different types of dementia and level of severity (MCI and dementia) using a random effects model.
Dealing with missing data
We will contact authors for missing data and clarity of primary studies if required, such inclusions will be reported in the review.
Studies will be meta-analysed using the RevMan software . We will meta-analyse studies that report our outcomes of interest. The meta-analyses will be conducted using an inverse-variance, random-effects model. We will calculate 95% confidence intervals and two-sided p values for each outcome. We will include forest plots to display the results of the meta-analyses. Where it is not appropriate to include studies in a meta-analysis, we will provide a narrative summary.
Assessment of heterogeneity
Statistical heterogeneity will be examined using the chi-squared test and the I2 statistic, and it will be examined for all studies included. A sensitivity analysis will be conduct between fixed-effects and random-effects models; relevant differences will be reported.
Assessment of reporting biases
We will examine funnel plots of the included studies to evaluate potential publication bias.
Assessment of the quality of the evidence
We will use the GRADE approach (Grading of Recommendation, Assessment, Development and Evaluation), as described in the Cochrane Handbook for Systematic Reviews and Interventions to evaluate the quality of the body of evidence . Following the GRADE guidelines, rating the quality of the body of evidence for each outcome involves consideration of limitations in study design and implementation, the directness of evidence, heterogeneity/inconsistency of results, the precision of results demonstrated by confidence intervals and the probability of publication bias. A summary of evidence based on these guidelines will be provided for all meta-analysed outcomes in the review.
The rapidly growing number of older adults worldwide is likely to increase in the prevalence of neurocognitive disorders such as MCI and dementia. Computer-based cognitive interventions may be effective for improving the lives of older adults with MCI and dementia and may be favoured over traditional interventions for their accessibility and cost-effectiveness.
Observing the methods detailed in this protocol, the review will present up-to-date evidence regarding the effect of computer-based cognitive interventions for older adults with MCI and dementia. The systematic review will be reported according to the PRISMA guidelines  and submitted for publication to an appropriate peer-reviewed journal. The findings of the systematic review will serve as a basis for further research regarding the development of computer applications for MCI and dementia.
There are two clear limitations to the current review protocol. The review will be restricted to published studies; publication bias is expected to be detected by funnel plots. Secondly, only studies in the English language will be included, introducing language bias.
Availability of data and materials
Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
Mild cognitive impairment
United Nations, Department of Economics and Social Affairs, Population Division. World population prospects: the 2015 revision, key findings and advance tables. http://www.un.org. Accessed 7 Nov 2016.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington: American Psychiatric Publishing; 2013.
Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: a systematic review and metaanalysis. Alzheimers Dement. 2013;9(1):63–75. https://doi.org/10.1016/j.jalz.2012.11.007.
Ward A, Arrighi HM, Michels S, Cedarbaum JM. Mild cognitive impairment: disparity of incidence and prevalence estimates. Alzheimers Dement. 2012;8(1):14–21. https://doi.org/10.1016/j.jalz.2011.01.002.
Acevedo A, Loewenstein DA. Nonpharmacological cognitive interventions in aging and dementia. J Geriatr Psychiatry Neurol. 2007;20(4):239–49. https://doi.org/10.1177/0891988707308808.
Lageman S, Cash T, Mickens M. A-50 feasibility and initial results of a randomized-controlled computer-based cognitive training trial in individuals with Parkinson's disease. Arch Clin Neuropsychol. 2014;29(6):521–2. https://doi.org/10.1093/arclin/acu038.50.
Gagnon LG, Belleville S. Training of attentional control in mild cognitive impairment with executive deficits: results from a double-blind randomised controlled study. Neuropsychol Rehab. 2012;22(6):809–35. https://doi.org/10.1080/09602011.2012.691044.
Zaccarelli C, Cirillo G, Passuti S, Annicchiarico R, Barban F. Computer-based cognitive intervention for dementia—Sociable: motivating platform for elderly networking, mental reinforcement and social interaction. 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops; 5–8 May 2013. 2013;430–435. doi:https://doi.org/10.4108/icst.pervasivehealth.2013.252155
Faucounau V, Wu Y, Boulay M, De Rotrou J, Rigaud A. Cognitive intervention programmes on patients affected by mild cognitive impairment: a promising intervention tool for MCI? Journal of Nutrition. Health Aging. 2010;14(1):31–5. https://doi.org/10.1007/s12603-010-0007-z.
Yamaguchi H, Maki Y, Takahashi K. Rehabilitation for dementia using enjoyable video-sports games. Int Psychogeriatr. 2011;23(4):674–6. https://doi.org/10.1017/S1041610210001912.
Garcia-Casal JA, Loizeau A, Csipke E, Franco-Martin M, Perea-Bartolome MV, Orrell M. Computer-based cognitive interventions for people living with dementia: a systematic literature review and meta-analysis. Aging Ment Health. 2016:1–14. https://doi.org/10.1080/13607863.2015.1132677.
Hill NTM, Mowszowski L, Naismith SL, Chadeick VL, Valenzuela M, Lampit A. Computeriszed cognitive trainning in older adults with mild cognitive impairment or dementia: a systematic review and meta-analysis. Am J Psychiatr. 2017;174:329–40. https://doi.org/10.1176/appi.ajp.2016.16030360.
Borenstein M, Hedges L, Higgins J, Rothstein H. Introduction to meta-analysis. Chichester: Wiley; 2009.
Sitzer DI, Twamley EW, Jeste DV. Cognitive trainning in Alzheimer’s disease: a meta-analysis of the literature. Acta Psychiatr Scand. 2006;114:75–90. https://doi.org/10.1111/j.1600-0447.2006.00789.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1). https://doi.org/10.1186/2046-4053-4-1.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. https://doi.org/10.1136/bmj.b2535.
Reeves BC, Deeks JJ, Higgins JPT, Wells GA. Chapter 13: including non-randomized studies. Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]: The Cochrane Collaboration; 2011. http://www.handbook.cochrane.org. Accessed 2 Sept 2019.
Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions (version 5.1.0). The Cochrane Collaboration; 2011. http://www.handbook.cochrane.org. Accessed 7 Nov 2016.
Cochrane library. https://www.cochranelibrary.com. Accessed 22 Feb 2019. [cited 2019 Feb 22]
Ebscohost. https://www.ebsco.com/products/research-databases. Accessed 22 Feb 2019. [Cited 2019 Feb 22]
Covidence. http://www.covidence.org. Accessed 7 Nov 2016. [cited 2016 Nov 7]
Tider Checklist. https://www.bmj.com/content/348/bmj.g1687. Accessed 7 May 2019.
RevMan. http://tech.cochrane.org/revman. Accessed 7 Nov 2016. [cited 2016 Nov 7]
This project was funded by the Barbara Dicker Brain Science Foundation.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.