- Open Access
Use of cognitive enhancers for mild cognitive impairment: protocol for a systematic review and network meta-analysis
Systematic Reviewsvolume 1, Article number: 25 (2012)
Elderly individuals who have memory problems without significant limitations in activities of daily living are often diagnosed as having mild cognitive impairment (MCI). Some of these individuals progress to dementia. Several cognitive enhancers (for example donepezil, galantamine, rivastigmine, memantine) have been approved for use in people with Alzheimer’s dementia but their use in patients with MCI is unclear. We aimed to determine the comparative effectiveness, safety, and cost of cognitive enhancers for MCI through a systematic review and network (that is, indirect comparisons) meta-analysis.
We will include studies that examine the use of cognitive enhancers compared to placebo, supportive care, or other cognitive enhancers among patients diagnosed with MCI. Outcomes of interest include cognition and function (primary outcomes), as well as behavior, quality of life, safety, and cost (secondary outcomes). We will include all experimental studies (randomized controlled trials, quasi-randomized controlled trials, controlled clinical trials), quasi-experimental studies (controlled before-after, interrupted time series), and observational studies (cohort, case–control). Studies will be included regardless of publication status (that is, we will include unpublished studies), year, or language of dissemination.
To identify potentially relevant material, we will search the following electronic databases from inception onwards: MEDLINE, Cochrane Central Register of Controlled Trials, EMBASE, CINAHL, and Ageline. The electronic database search will be supplemented by scanning the reference lists of included studies, searching Google and organization websites for unpublished or difficult to locate material literature, and contacting experts.
Two reviewers will independently screen the studies for inclusion using the eligibility criteria established a priori and independently extract data. Risk of bias will be assessed using the Cochrane Risk of Bias tool for experimental and quasi-experimental studies and the Newcastle Ottawa Scale for observational epidemiology studies. Meta-analysis and network meta-analysis are planned, if the studies are deemed statistically, methodologically, and clinically homogenous.
Our systematic review will provide important information regarding the benefits, costs, and harms of cognitive enhancers for patients with MCI. This information can be used to assist healthcare providers, policy-makers, MCI patients and their family regarding the use of these agents.
PROSPERO registry number
Mild cognitive impairment (MCI) is a diagnosis reserved for elderly individuals who have memory problems without significant activities of daily living limitations . The diagnostic criteria for MCI include: subjective complaint of memory loss; memory impairment on brief cognitive or neuropsychological testing; decline from previously normal level of function; present basic daily functioning unchanged; no medical, neurologic or psychiatric explanation for memory loss; and, cognitive impairment not meeting the criteria for dementia . MCI has recently been recognized as a distinct condition.
A recent systematic review estimated the prevalence and incidence of MCI reported in population-based studies . Ten studies conducted in China, France, Italy, Korea, and the United States reported that the prevalence of MCI ranged from 3% to 42%. The prevalence of MCI increased with age. For individuals 65 years of age or older, the incidence of MCI ranged from 21.5 to 71.3 per 1,000 person-years based on data from two studies conducted in the United States and one study conducted in Italy . These estimates suggest that a large proportion of the population is affected by MCI. Patients with MCI may progress to dementia, thus there is interest in initiating treatment that may prevent or slow this progression.
Pharmacological treatment for Alzheimer’s dementia (AD) includes cholinesterase inhibitors (for example donepezil, galantamine, rivastigmine), as well as an N-Methyl-D-aspartic acid (NMDA) receptor antagonist, memantine (Ebixa, Lundbeck) . Acetylcholinesterase inhibitors donepezil (Aricept, Eisai/Pfizer), rivastigmine (Exelon, Novartis), and galantamine (Reminyl, Shire) act by increasing the concentration of acetylcholine at the neurotransmitter sites . Galantamine also modulates activity at nicotinic receptors . Memantine works on the glutamatergic system and modulates the neurotransmitter glutamate . Although cognitive enhancers have not been widely approved for patients with MCI and are available by special authorization in some countries (for example, Canada), patients and their family members are requesting these agents, making this a challenge in the primary and specialty care settings .
Given their increasing use, our objectives are to examine the comparative effectiveness, safety, and cost of cognitive enhancers for MCI through a systematic review and network meta-analysis (that is, indirect comparison meta-analysis). Specifically, our research questions are:
What is the efficacy of cognitive enhancers (donepezil, rivastigmine, galantamine, memantine) vs. placebo or best supportive care for MCI?
What is the comparative effectiveness of cognitive enhancers with similar modes of action (donezepil and rivastigmine) vs. galantamine and memantine for MCI?
What is the comparative safety of cognitive enhancers for MCI?
What is the comparative cost associated with cognitive enhancers for MCI?
This systematic review protocol was developed using guidance from the PRISMA Statement . It was peer-reviewed by experts in pharmacology, statistics, and systematic reviews. Our protocol is registered in the PROSPERO database (CRD42012002234) and is closely-related to another systematic review protocol that focuses on cognitive enhancers for AD (CRD42012001948) (Tricco, unpublished paper submitted to BMC SRs).
Studies examining patients diagnosed with MCI using established criteria (for example, Montréal Cognitive Assessment  and DemTect  will be included. Studies must examine cognitive enhancers approved for use for AD in Canada (donepezil, rivastigmine, galantamine, memantine) compared with other cognitive enhancers, memantine or placebo and/or supportive care. These agents are also approved for AD in many other countries, including Australia, United States, and the United Kingdom. Supportive care will include social support, functional assistance, caregiver support, information, education, community service, and other non-pharmacological strategies.
We will include experimental studies (for example, randomized controlled trials [RCTs], quasi-randomized trials, controlled clinical trials), quasi-experimental studies (such as interrupted time series, controlled before and after studies), and observational epidemiology studies (for example, cohort, case–control studies). Inclusion will not be limited by publication status (that is, we will include unpublished material), year, or language of dissemination. Potentially relevant articles not written in English will be translated.
Information sources and literature search
The main literature search will be conducted in the following electronic databases: MEDLINE (OVID interface, 1948 onwards), EMBASE (OVID interface, 1947 onwards), the Cochrane Methodology Register (current issue), Cochrane Central Register of Controlled Trials (CENTRAL, current issue), CINAHL (EBSCO interface, 1980 onwards), and Ageline (EBSCO interface, 1961 onwards). The search strategies will be developed using medical subject headings (MeSH) and text words related to cognitive enhancers for MCI patients.
The electronic database search will be supplemented by searching for difficult to locate or unpublished material (that is, grey literature) using methods (Tricco, unpublished paper submitted to BMC SRs). Briefly, we will search public health and trial registry websites, websites of organizations that produce guidelines, conference proceeding abstracts, Google, key journals, and contact manufacturers to obtain their Scientific Information Packets for the medications. Literature saturation will be ensured by searching the authors’ personal files, scanning the reference lists of included studies and relevant reviews, and contacting researchers and healthcare providers who are active in this field.
The literature searches will be conducted by an experienced librarian (Perrier) and peer-reviewed by another librarian using Peer Review of Electronic Search Strategies (PRESS) . The draft literature search can be found in the Appendix. For simplicity, the literature search was conducted in conjunction with another systematic review on a closely-related topic (Tricco, unpublished paper submitted to BMC SRs). The two reviews will be separated after full-text screening. The results from the literature search will be uploaded to our online SysRev Tool, which will be used for screening the results from the literature search .
Study selection process
We will calibrate the inclusion and exclusion criteria by pilot-testing a random sample of 50 citations resulting from the search. A kappa statistic and the percent agreement will be used to calculate inter-rater agreement for study inclusion between reviewers . If poor to moderate agreement is observed (that is, percent agreement less than 70% or a kappa statistic less than 0.6), the inclusion and exclusion criteria will be revised. All citations and full-text articles will be reviewed by two reviewers independently. Conflicts will be resolved by discussion or the involvement of a third reviewer.
Data items and data collection process
Key stakeholders (for example, patients, healthcare providers, policy-makers) will be engaged to refine the key outcomes. Potential outcomes of interest include:
– Cognition: Mini-mental state examination, Goal Attainment Scale, Severe Impairment Battery
– Function: Bristol Activities of Daily Living Scale, Caregiver-rated Modified Crichton Scale, Disability Assessment for Dementia, the Interview for Deterioration in Daily living activities in Dementia, Nurses Observation Scale for Geriatric Patients Activities of Daily Living subscale, the Progressive Deterioration Scale
– Behavior: Neuropsychiatric Inventory
– Global Status: Clinician Interview-Based Impression of Change Incorporating Caregiver Information scale, Clinical Global Impression of Change
– Clinical Outcomes: Mortality, Health-Related Quality of Life, Institutionalization, Falls, Balance; Harms (number of adverse events (for example, nausea, vomiting, diarrhea, dizziness, weight loss, hospitalizations, bradycardia), number of withdrawals, number of withdrawals due to adverse events, severity and timing of adverse events); Benefits to caregivers (for example, caregiver stress)
– Costs and cost-effectiveness
The data will be abstracted and categorized as study characteristics (for example, study design, year of conduct, setting), patient characteristics (such as type and number of patients, mean age, MCI diagnosis criteria, MCI severity, baseline cognition, co-morbidities), primary outcome results (for example, cognition, function), and secondary outcome results (such as behavior, quality of life, costs, falls, balance, and harms).
We will calibrate the online data extraction form by pilot-testing a random sample of five included studies. Two reviewers will abstract all data independently and conflicts will be resolved by discussion or the involvement of a third reviewer.
We will abstract data based on clinically and methodologically relevant follow-up time periods. These include after 3, 6, 12, and 24 months of follow-up. We will also identify multiple publications reporting data from the same group (that is, companion reports) to ensure that data is not counted twice in meta-analysis. Study authors will be contacted for further information when the data are unclear.
Methodological quality/risk of bias appraisal
We will use the Cochrane Risk of Bias Tool to appraise RCTs  and the Cochrane Effective Practice and Organization of Care Risk of Bias Tool for controlled clinical trials, interrupted time series, and controlled before-after studies . The Newcastle-Ottawa Scale will be used for cohort studies and case–control studies . Summary of findings tables will be compiled to show the relevance and level of evidence across all of the included studies using Grading of Recommendations Assessment Development and Evaluation (GRADE) . The McHarm tool  will be used to specifically examine adverse drug reactions reported in the included studies.
We will first describe our results narratively. We will subsequently conduct meta-analysis using a random-effects model  for each type of study design separately. Clinical, methodological, and statistical heterogeneity will be examined and meta-regression analysis will be conducted if significant statistical heterogeneity is identified (that is, I2 statistic > 60%) . Missing data will be imputed using established methods  and we will examine the effect of the missing data on our results using an established method .
If the data allow, network (such as, indirect comparison) meta-analysis will be conducted to rank treatment efficacy among all the available treatments using the WinBUGS software (MRC Biostatistics Unit, Cambridge, England) . Sensitivity analyses will be conducted to assess the effect of inclusion of trials with high rates of dropouts, missing data imputations, instruments used for the primary outcomes, average adherence between groups, inclusion of observational studies in the network meta-analysis, and use of different priors for variance parameters in the network meta-analysis .
According to a recent systematic review, the prevalence of MCI increases with age, with population-based studies reporting prevalence estimates as high as 42% . The incidence of MCI among seniors ranged from 21.5 to 71.3 per 1,000 person-years . These estimates suggest that our systematic review results have the potential to influence a large proportion of the population. Our results will enable healthcare providers, policy-makers, MCI patients and their family members make decisions regarding the use of these agents.
As highlighted previously (Tricco, unpublished paper submitted to BMC SRs), we will employ a multifaceted knowledge translation strategy to ensure our results reach potential endusers. For example, we will publish our results in an open access journal present our findings at relevant meetings (such as the American Geriatrics Society). We will also disseminate our results through newsletters of interested organizations (for example, Alzheimer’s Society), create an educational module for healthcare providers and use our results to inform the development of a patient decision aid.
Appendix: literature search
Database: Ovid MEDLINE(R) <1948 to November Week 2 2011>, Ovid MEDLINE(R) In-Process & Other Non-Indexed Citations < November 22, 2011> Search Strategy:
“benign senescent forgetfulness”.mp.
(chronic adj2 cerebrovascular).mp.
(cognit$ adj2 (impair$ or declin$ or deficit$ or degenerat$ or deteriorat$ or los$ or disorder$ or complain$ or disturb$)).mp.
(cerebr$ adj2 (impair$ or declin$ or deficit$ or degenerat$ or deteriorat$ or los$ or disorder$ or complain$ or disturb$)).mp.
(memory adj2 (impair$ or declin$ or deficit$ or degenerat$ or deteriorat$ or los$ or disorder$ or complain$ or disturb$)).mp.
(mental adj2 (impair$ or declin$ or deficit$ or degenerat$ or deteriorat$ or los$ or disorder$ or complain$ or disturb$)).mp.
(ne?rocognit$ adj2 (impair$ or declin$ or deficit$ or degenerat$ or deteriorat$ or los$ or disorder$ or complain$ or disturb$)).mp.
(ne?ro-cognit$ adj2 (impair$ or declin$ or deficit$ or degenerat$ or deteriorat$ or los$ or disorder$ or complain$ or disturb$)).mp.
((cognit$ or memory or cerebral or brain) adj2 (improv$ or enhanc$ or perform$ or process$ or function$ or rehabilitation or aid$ or stimulat$)).mp.
(confusion$ or confused).tw.
“ischemic white matter”.mp.
(“normal pressure hydrocephalus” and shunt$).mp.
“organic brain disease$”.mp.
“organic brain syndrome”.mp.
Cognition/de [Drug Effects]
Delirium, Dementia, Amnestic, Cognitive Disorders/
(aMCI or MCI).mp.
(“AA CD” or AACD).tw.
(“AA MI” or AAMI).tw.
(“CI ND” or CIND).tw.
(MCD or MNCD).tw.
“N-Methyl-D-aspartic acid receptor antagonist$”.tw.
exp Cholinesterase Inhibitors/
357-70-0.rn. [CAS Registry Numbers]
40 and 75
Animals/not (Animals/and Humans/)
76 not 77
Chertkow H: Diagnosis and treatment of dementia: introduction. Introducing a series based on the Third Canadian Consensus Conference on the Diagnosis and Treatment of Dementia. CMAJ. 2008, 178: 316-321.
Ward A, Arrighi HM, Michels S, Cedarbaum JM: Mild cognitive impairment: disparity of incidence and prevalence estimates. Alzheimers Dement. 2012, 8: 14-21. 10.1016/j.jalz.2011.01.002.
National Institute for Health and Clinical Excellence: Dementia: Supporting people with dementia and their carers in health and social care. http://www.niceorguk/nicemedia/live/10998/30318/30318.pdf [2011 NICE clinical guideline 42]
Hansen RA, Gartlehner G, Webb AP, Morgan LC, Moore CG, Jonas DE: Efficacy and safety of donepezil, galantamine, and rivastigmine for the treatment of Alzheimer's disease: a systematic review and meta-analysis. Clin Interv Aging. 2008, 3 (2): 211-225.
Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009, 339: b2535-10.1136/bmj.b2535.
Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H: The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005, 53: 695-699. 10.1111/j.1532-5415.2005.53221.x.
Kalbe E, Kessler J, Calabrese P, Smith R, Passmore AP, Brand M, Bullock R: DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia. Int J Geriatr Psychiatry. 2004, 19: 136-143. 10.1002/gps.1042.
Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62: 944-952. 10.1016/j.jclinepi.2008.10.012.
SysRev Tool. www.ktclearinghouse.ca[2011, Toronto Canada]
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.
Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration. Edited by: Higgins JPT, Green S. 2011, Oxford: Wiley,www.cochrane-handbook.org,
Cochrane Effective Practice and Organisation of Care Group Draft Risk of Bias Tool. 2011, Oxford: Wiley,http://epoc.cochrane.org/epoc-resources-review-authors,
Wells G, Shea BJ, O'Connell D, Peterson J, Welch V: The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2011, Available: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp
Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, Alderson P, Glasziou P, Falck-Ytter Y, Schunemann HJ: GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011, 64: 395-400. 10.1016/j.jclinepi.2010.09.012.
Santaguida P, Raina P, Ismaila A: The development of the McHarm quality assessment scale for adverse events. Hamilton, [http://hiru.mcmaster.ca/epc/mcharm.pdf]
DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.
Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.
Littell JH, Pillai V: Systematic reviews and meta-analysis. 2008, New York, NY: Oxford University Press
Carpenter J, Rucker G, Schwarzer G: Assessing the sensitivity of meta-analysis to selection bias: a multiple imputation approach. Biometrics. 2011, 67: 1066-1072. 10.1111/j.1541-0420.2010.01498.x.
The bugs project: The bugs project: Winbugs. 2011, Cambridge: MRC Biostatistics Unit,http://www.mrc-bsucamacuk/bugs/winbugs/contents.shtml,
Lu G, Ades AE: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23: 3105-3124. 10.1002/sim.1875.
This systematic review was funded by the Canadian Institutes for Health Research. SES is funded by a Tier 1 Canada Research Chair. SRM is the Endowed Chair in Patient Health Management (supported by the Faculties of Medicine and Dentistry and Pharmacy and Pharmaceutical Sciences) and holds a Health Scholar salary award (supported by Alberta Heritage Foundation for Medical Research and Alberta Innovates - Health Solutions). We thank Drs. Muhammad Mamdani, Charles Goldsmith, David Juurlink, and Joseph Beyene for their valuable feedback on the conceptualization of this review. We also thank Jennifer Deevy for formatting our manuscript.
The authors report no conflicts of interests.
ACT conceived the study, designed the study, helped obtain funding for the study, and helped write the draft protocol. SV helped write the draft protocol. LP developed the search strategies and edited the draft protocol. CS registered the protocol and edited the draft protocol. EL edited the draft protocol. MHC provided input into the design and draft of the protocol. BH and SM provided feedback on the protocol during its development. SES conceived the study, designed the study, obtained the funding, and helped write the draft protocol. All authors read and approved the final protocol.