Skip to main content
Full access
Articles
Published Online: 14 November 2016

Computerized Cognitive Training in Older Adults With Mild Cognitive Impairment or Dementia: A Systematic Review and Meta-Analysis

Abstract

Objective:

Previous meta-analyses indicate that computerized cognitive training (CCT) is a safe and efficacious intervention for cognition in older adults. However, efficacy varies across populations and cognitive domains, and little is known about the efficacy of CCT in people with mild cognitive impairment or dementia.

Method:

The authors searched Medline, Embase, PsychINFO, CINAHL, and CENTRAL through July 1, 2016, for randomized controlled trials of CCT in older adults with mild cognitive impairment or dementia. Overall cognition, individual cognitive domains, psychosocial function, and activities of daily living were pooled separately for mild cognitive impairment and dementia trials.

Results:

The overall effect on cognition in mild cognitive impairment across 17 trials was moderate (Hedges’ g=0.35, 95% CI=0.20–0.51). There was no evidence of publication bias or difference between active- and passive-controlled trials. Small to moderate effects were found for global cognition, attention, working memory, learning, and memory, with the exception of nonverbal memory, and for psychosocial functioning, including depressive symptoms. In dementia, statistically significant effects were found on overall cognition (k=11, g=0.26, 95% CI=0.01–0.52) and visuospatial skills, but these were driven by three trials of virtual reality or Nintendo Wii.

Conclusions:

CCT is efficacious on global cognition, select cognitive domains, and psychosocial functioning in people with mild cognitive impairment. This intervention therefore warrants longer-term and larger-scale trials to examine effects on conversion to dementia. Conversely, evidence for efficacy in people with dementia is weak and limited to trials of immersive technologies.
Dementia is a progressive neurocognitive disorder characterized by insidious cognitive and functional decline until death. At present, the global prevalence of dementia is estimated at 5%−7% of people over 60 years (1). Mild cognitive impairment often precedes dementia and is characterized by largely intact everyday function despite objective evidence of cognitive decline (2). Mild cognitive impairment is a proximal risk factor for dementia (3), falls (4), and higher health expenditure (5), and risk increases proportionally with the number of impaired cognitive domains and symptom severity (3).
Conversion from mild cognitive impairment to dementia can be conservatively estimated at 5%−10% per year (3, 6, 7), and similar rates have been observed in the opposite direction (i.e., reversion from mild cognitive impairment to normal cognition) (79). Thus, mild cognitive impairment is an unstable cognitive state with potential to avert progression to dementia and attendant health and societal sequelae. To date, there is no systematic evidence for the effectiveness of any intervention on the cognitive and psychological symptoms of mild cognitive impairment (10). The current preferred medical treatment, cholinesterase inhibitors, only offer modest short-term cognitive benefits, and their clinical value continues to be debated given the risk of adverse events in clinical trials (11).
Computerized cognitive training (CCT) has generated considerable attention as a safe, relatively inexpensive and scalable intervention that aims to maintain cognition in older adults. CCT involves guided drill-and-practice on standardized tasks designed to load on specific cognitive processes, typically without explicit teaching of memory or problem-solving strategies, which distinguish CCT from other approaches for cognitive remediation (12). CCT can target single or multiple domains and usually adapts task difficulty to individual performance. Recent meta-analyses of randomized controlled trials of CCT have found moderate effect sizes on cognition in healthy older adults (13) and in Parkinson’s disease (14), as well as on symptom severity, daily functioning, and cognition in major depression (15).
While CCT is a frequent intervention in primary prevention trials (16), the extent to which CCT can benefit cognition in already diagnosed mild cognitive impairment or dementia is unclear. Systematic reviews of cognitive interventions in mild cognitive impairment or dementia have reported mixed results (1725), but these interventions combined CCT with non-CCT interventions, such as cognitive stimulation or individual rehabilitation strategies, and mixed randomized controlled trials with other designs. We therefore aimed to conduct separate systematic reviews and meta-analyses of narrowly defined CCT in individuals with mild cognitive impairment or dementia in order to chart potential benefits on cognition and behavior across domains and diagnostic groups.

Method

This work adheres with PRISMA [Preferred Reporting Items for Systematic Reviews and Meta-Analyses] guidelines (26), was prospectively registered with PROSPERO (CRD42015023679), and follows our published methods for meta-analysis of CCT in older adults (13, 14).

Information Sources and Study Selection

We searched Medline, Embase, PsychINFO, CINAHL, and CENTRAL from inception to July 1, 2016 for randomized controlled trials examining the effects of CCT on one or more cognitive or behavioral outcomes in older adults with mild cognitive impairment or dementia (for the full search strategy, see Table S1 in the data supplement accompanying the online version of this article). We did not apply database limits, and non-English articles were translated. Additional articles were obtained by scanning reference lists of included studies and previous reviews. One reviewer (N.T.M.H. or V.L.C.) conducted initial eligibility screening based on title and abstract, followed by assessment of full-text versions by two independent reviewers (N.T.M.H., V.L.C., or an additional reviewer [see the Acknowledgments]). Disagreements were resolved by a senior reviewer (A.L.), who approved the final list of included studies. When eligibility was unclear, one reviewer (N.T.M.H.) contacted authors for additional information.

Eligibility Criteria

Types of participants.

The mean age of participants was ≥60 years old, with a diagnosis of mild cognitive impairment or dementia (of any etiology), confirmed by examining the inclusion criteria or baseline scores against standardized diagnostic criteria (2, 27).

Types of interventions.

At least 4 hours of drill and practice, with a clear cognitive rationale, videogames, or virtual reality, had to be completed. Studies combining CCT with other interventions were eligible if the control group received the same adjacent intervention. Studies were excluded if less than 50% of the cognitive intervention was CCT or not involving interaction with a computer (e.g., merely watching stimuli).

Types of controls.

Passive (no-contact, wait-list), active (e.g., sham CCT, psychoeducation), or pencil-and-paper cognitive training was required. Physical exercise as a sole control condition was excluded.

Types of outcomes.

Outcomes were change from baseline to posttraining in nontrained measures of cognition (global cognition, verbal or nonverbal learning, verbal or nonverbal memory, working memory, processing speed, attention, language, visuospatial skills, and executive function); activities of daily living; instrumental activities of daily living; or psychosocial functioning (neuropsychiatric symptoms, quality of life, and depression). All eligible outcomes per study and domain were included. Index scores were excluded if subdomain scores were available.

Data Collection and Coding

Coding of outcomes into cognitive domains and effect direction were performed independently by two reviewers (N.T.M.H. and L.M.) according to accepted neuropsychological categorization (28) or by consulting with a senior reviewer (A.L.) (for categorization of outcomes by domains, see Table S2 in the online data supplement). Outcomes were recorded as mean and standard deviations for each group at baseline and follow-up with the exception of standardized mean difference and 95% confidence interval (29) or mean change and standard deviation (30).
When studies included mixed cohorts, we asked primary authors for split data by diagnosis and group. Three studies for which split data were not available were coded as dementia according to baseline indications of functional impairment in >50% of the sample (3133).

Risk of Bias in Individual Studies and Quality Appraisal

The Cochrane Collaboration’s risk of bias tool (34) was used to assess risk of bias in individual studies. Studies with high or unclear risk of bias for the blinding of assessors or incomplete outcome data categories were considered as high risk of bias. Methodological quality within studies was further assessed using the PEDro-P scale [Physiotherapy Evidence Database Rating Scale] (35). The original scale consists of 11 items. However, blinding of therapists and patients was not assessed due to nonfeasibility in CCT trials, and thus the maximum obtainable score (reflecting higher quality) was 9. Assessments were conducted by two independent reviewers (N.T.M.H., V.L.C. or an additional reviewer [see Acknowledgments]). A senior reviewer (A.L.) established consensus scores and resolved disagreements.

Data Analysis

We calculated standardized mean differences as Hedges’ g and 95% confidence interval of change in outcome measures between the CCT and control groups from baseline to posttraining and each follow-up. A positive standardized mean difference indicates a therapeutic effect of CCT over and above the control. Pooling of standardized mean differences across studies was performed using a random-effects model. Analogous to Cohen’s d (36), Hedges’ g estimates of <0.30, ≥0.30 and <0.60, and ≥0.60 were considered small, moderate, and large, respectively. Analyses were performed for overall cognitive outcomes, as well as for each cognitive or behavioral domain separately. When studies provided more than one outcome per domain for analysis, their standardized mean difference and variance were combined into a single study-level estimate. Finally, standardized mean differences from each arm (CCT and control) were split at the study level and pooled across studies in order to investigate nonspecific effects among control groups and likewise to investigate whether CCT genuinely enhances cognition.
Heterogeneity across studies was quantified using the I2 statistic, considered as low, moderate, or large when at 25%, 50%, or 75%, respectively (37). Small study effect (publication bias) was assessed by visually inspecting funnel plots of standardized mean differences against standard error for asymmetry (38). When at least 10 studies were available for analysis, Egger’s test of the intercepts (39) was used to formally test asymmetry, and the Duval and Tweedie trim and fill (40) was used to quantify the magnitude of small study effect. When less than 10 studies were available and potential asymmetry was found, a sensitivity analysis was performed by recalculating effect size after removal of outliers. A planned series of subgroup analyses based on key study design features (13) was not performed due to null statistical heterogeneity among mild cognitive impairment outcomes (I2=0% and τ2=0.001 for the most powered analysis, Figure 1), making redundant tests for further between-study variance. All analyses were performed using Comprehensive Meta-analysis version 3.0.
FIGURE 1. Meta-Analyses of Overall and Global Cognition Outcomesa
a Studies are sorted by publication year. CCT=computerized cognitive training.

Results

Study Selection

The initial search provided a total of 22,276 records. After removing duplicates, 14,961 articles were screened based on titles and abstracts, of which 660 full-text versions were assessed for inclusion. Twenty-six studies were eligible for inclusion in the review, of which one was excluded because the summary data were not provided in the original report (41) and could not be obtained from the authors. Four articles (30, 4244) were split into two studies each, and two articles reporting outcomes from the same trial (45, 46) were combined into one study. Finally, one additional study was obtained from a book chapter (47), resulting in a final data set of 29 independent comparisons (mild cognitive impairment: k=17, dementia: k=12) (Figure 2). We requested additional data from authors of 18 reports, of which six provided data (29, 31, 44, 4850).
FIGURE 2. Summary of Trial Identification and Selectiona
a RCT=randomized controlled trial.

Characteristics of Included Studies

Mild cognitive impairment.

The 17 included studies encompassed 686 participants (CCT: N=351, mean group size: N=21; control: N=335, mean group size: N=20) (Table 1). Mean age ranged between 67 and 81 years old, and 51.88% of participants were female. One study (51) did not report gender ratios. Active control was provided in 11/17 studies. The mean PEDro-P score was 7.2/9 (SD=1.03), and 14/17 studies had high or unclear risk of bias (for risk of bias assessments, see Table S3 in the online data supplement). The majority of studies (15/17) administered supervised training.
TABLE 1. Characteristics of Included Studiesa
StudyNPopulation DiagnosisMean Age (Years)bSex (% Female)Mean Mini-Mental State Examination or EquivalentDeliveryProgram and Targeted DomainsDosecNumber of SessionsdSession LengtheSession/WeekfControlRisk of BiasgPEDro-P Scale
Kim et al. (66)30 (CCT, N=15; control, N=15)Mild cognitive impairment78.77026.7SupervisedVirtual reality simulating household tasks612303ActiveHigh7
Rozzini et al. (51)37 (CCT, N=15; control, N=22)Mild cognitive impairment  26.2SupervisedNeuropsychological training:6060605ActiveLow8
Memory, attention, language, executive function, visuospatial processing
Barnes et al. (29)47 (CCT, N=22; control, N=25)Mild cognitive impairment7440 Home-basedPosit science brain fitness50301005ActiveHigh8
Speed, verbal memory, working memory
Finn et al. (48)16 (CCT, N=8; control, N=8)Mild cognitive impairment72.695027.76Home-basedLumosity1030203–5PassiveHigh7
Attention, speed, nonverbal memory, executive functions
Herrera et al. (56)22 (CCT, N=11; control, N=11)Mild cognitive impairment76.635027.27SupervisedIn-house program2424602ActiveHigh8
Verbal memory, nonverbal memory, verbal learning, non- verbal learning, attention, speed
Tarnanas et al. (47)71 (CCT, N=32; control, N=39)Mild cognitive impairment70.0560.526.5SupervisedVirtual reality museum task6040902ActiveHigh7
Wittelsberger et al. (54)27 (CCT, N=17; control, N=10)Mild cognitive impairment70.0748.1422.88SupervisedNintendo Wii bowling1212602PassiveHigh5
Finn et al. (49)24 (CCT, N=12; control, N=12)Mild cognitive impairment73.9529.1627.79SupervisedRepetition lag training96902PassiveHigh6
Verbal learning, verbal memory
Hughes et al. (57)20 (CCT, N=10; control, N=10)Mild cognitive impairment77.47027.1SupervisedNintendo Wii3624901ActiveHigh7
Fiatarone Singh et al. (43) (study 1 [CCT + exercise vs. sham CCT + exercise])49 (CCT, N=27; control, N=22)Mild cognitive impairment70.16827SupervisedCOGPACK7852902ActiveLow9
Verbal memory, nonverbal memory, executive functions, attention, speed
Fiatrone Singh et al. (43) (study 2 [CCT + sham exercise vs. sham CCT + sham exercise])51 (CCT, N=24; control, N=27)Mild cognitive impairment70.16827SupervisedCOGPACK7852902ActiveLow9
Verbal memory, nonverbal memory, executive functions, attention, speed
Barban et al. (44) (study 2, mild cognitive impairment)106 (CCT, N=46; control, N=60)Mild cognitive impairment73.5447.1627.74SupervisedSociable2424602PassiveHigh8
Verbal memory, nonverbal memory, executive functions, language, attention, visuospatial processing
Hagovska et al. (45, 46)78 (CCT, N=40; control, N=38)Mild cognitive impairment66.9748.7526.33SupervisedCogniPlus1020302PassiveHigh7
Verbal memory, nonverbal memory, verbal learning, nonverbal learning, working memory, attention, executive functions, visuospatial processing
Barcelos et al. (53)17 (CCT, N=8; control, N=9)Mild cognitive impairment80.65620.8hSupervisedIn-house virtual reality enhanced recumbent stationary bike coin and dragon collection182420–452ActiveHigh6
Visuospatial processing, executive functions, attention
Gooding et al. (30) (study 1 [CCT and ACG])41 (CCT, N=31; control, N=10)Mild cognitive impairment75.59j61.9j50.62iSupervisedBrainFitness by Posit Science3032602ActiveHigh5
Memory, attention, executive functions
Gooding (30) (study 2 [CVT and ACG])33 (CCT, N=23; CTL, N=10)Mild cognitive impairment75.59j61.9j50.84iSupervisedBrainFitness by Posit Science3032602ActiveHigh5
Memory, attention, executive functions
Lin et al. (67)21 (CCT, N=10; control, N=11)Mild cognitive impairment73.047.6225.02hHome-basedPosit Science InSight.2424604ActiveHigh7
Processing speed, visuospatial, attention, executive functions
Optale et al. (31)31 (CCT, N=15; control, N=16)Mixedk80.9667.7421.91SupervisedVirtual reality Virtools platform1836303ActiveHigh8
Nonverbal learning, nonverbal memory, attention, visuospatial processing
Galante et al. (32)11 (CCT, N=7; control, N=4)Mixedk75.51Not reported22.9SupervisedNeuropsychological training1212603ActiveHigh9
Memory (domain unspecified), working memory, language, attention, executive functions, visuospatial processing
Zhuang et al. (33)33 (CCT, N=19; control, N=14)Mixedk78.0775.7510.16SupervisedIn-house program10872903Not SpecifiedHigh8
Nonverbal learning, Nonverbal memory, executive functions, visuospatial, processing
Heiss et al. (58)35 (CCT, N=18; control, N=17)Dementia66.2945.7121.1SupervisedRigling Reha-Service4848602ActiveHigh6
Memory, executive functions, visuospatial
Lowenstein et al. (52)44 (CCT, N=19, control, N=25)Dementia76.4334.0923.96Supervised + home-basedCommercial games1824452ActiveHigh7
Language, executive functions, nonverbal learning, nonverbal memory, verbal memory, nonverbal memory, attention
Tarraga et al. (59)31 (CCT, N=15; control, N=16)Dementia76.5487.0921.55SupervisedSmart Brain2472203ActiveHigh7
Memory, attention, language, visuospatial processing, working memory, executive functions
Fernandez-Calvo et al. (55)30 (CCT, N=15; control, N=15)Dementia75.743.3319.66SupervisedNintendo Wii Big Brain Academy3636603PassiveLow8
Nonverbal memory, working memory, executive functions, visuospatial processing
Boller et al. (42) (study 1 [recollection + control])18 (CCT, N=12; control, N=6)Dementia80.8255.524.59Supervised + home-basedRepetition lag training6302015PassiveHigh9
Verbal learning, verbal memory
Boller et al. (42) (study 2 [recognition + control])18 (CCT, N=12; control, N=6)Dementia81.555.525.51Supervised + home-basedRepetition lag training6302015PassiveHigh9
Verbal learning, verbal memory
Lee et al. (60)13 (CCT, N=7; control, N=6)Dementia77.769.2316.07SupervisedIn-house computerized errorless learning program612602ActiveHigh6
Verbal memory, nonverbal memory, working memory, verbal learning, nonverbal learning, attention, executive functions, global cognition
Man et al. (50)44 (CCT, N=20; control, N=24)Dementia80.298522.03SupervisedVirtual reality home and shop simulation510302–3ActiveLow7
Barban et al. (44) (study 1)81 (CTT, N=42; control, N=39)Dementia76.7970.3723.4SupervisedSociable2424602PassiveHigh8
Verbal memory, nonverbal memory, executive functions, language, attention, visuospatial processing
a
Abbreviations: ACG=active control group; CCT=computerized cognitive training; CVT=cognitive vitality training; PEDro-P=Physiotherapy Evidence Database Rating Scale.
b
Weighted mean age.
c
Total number of training hours.
d
Total number of CCT sessions.
e
Session length (minutes).
f
Number of sessions per week.
g
Defined has having high or unclear risk of bias for blinding of assessors and/or incomplete outcome data.
h
Measured using the Montreal Cognitive Assessment (1–30 scale).
i
Measured using the Modified Mini-Mental State Examination (1–100 scale).
j
Summary statistics from study 1 and study 2.
k
Coded as dementia.

Dementia.

The 12 included studies encompassed a total of 389 participants (CCT: N=201, mean group size: N=17; control: N=188, mean group size: N=16) (Table 1). Mean age ranged between 66 and 81 years old, and 63.5% of participants were female. One study (32) did not report gender ratios. Active control was confirmed in 7/12 studies. The mean PEDro-P score was 7.7/9 (SD=1.25), and 10/12 studies had high or unclear risk of bias (see Table S3 in the online data supplement). The majority of studies provided supervised training (9/12). One study (52) reported only behavioral outcomes.

Meta-Analysis of Mild Cognitive Impairment Outcomes

Overall efficacy on cognitive outcomes.

The overall effect size was moderate and statistically significant (k=17, g=0.35, 95% confidence interval [CI]=0.20–0.51, p<0.001, I2=0%) (Figure 1). The funnel plot did not reveal significant asymmetry (Egger’s intercept=1.39, p=0.11 [see Figure S1 in the data supplement). After splitting arms, CCT groups revealed a statistically significant improvement (g=0.32, 95% CI=0.20–0.44, I2=28.47%), compared with no change across control groups (g=0.02, 95% CI=–0.08 to 0.11, I2=0%). The effect size across active-controlled trials (k=11, g=0.40, 95% CI=0.17–0.63, I2=18.95%) was comparable to that of trials with passive control groups (k=6, g=0.32, 95% CI=0.09–0.55, I2=0%). Domain-specific effect sizes are summarized in Figure 3.
FIGURE 3. Efficacy of Computerized Cognitive Training (CCT) in Mild Cognitive Impairment Within Individual Domainsa
a IADL=Instrumental activities of daily living.

Global cognition.

The global cognition effect size was moderate and statistically significant (k=12, g=0.38, 95% CI=0.14–0.62, p=0.002, I2=44.17%) (Figure 1). The funnel plot did not reveal asymmetry (Egger’s intercept=0.33, p=0.83) (see Figure S1 in the data supplement). Once again, the pooled effect size across CCT groups was significant (g=0.28, 95% CI=0.05–0.51), compared with no change in the controls (g=–0.02, 95% CI=–0.16 to 0.12), and there was no difference between the effect across active (k=8, g=0.41, 95% CI=0.03–0.75) and passive (k=4, g=0.37, 95% CI=0.02–0.72) controlled trials.

Verbal learning.

The verbal learning effect size was moderate and statistically significant (k=11, g=0.39, 95% CI=0.14–0.63, p=0.002, I2=37.3%) (see Figure S2 in the data supplement). The funnel plot revealed significant asymmetry (Egger’s intercept=3.95, p=0.04) (see Figure S3 in the data supplement). A trim and fill analysis imputed three studies; the adjusted effect size was small and statistically nonsignificant (g=0.20, 95% CI=–0.08 to 0.49).

Verbal memory.

The verbal memory effect size was moderate and statistically significant (k=12, g=0.42, 95% CI=0.21–0.63, p<0.001, I2=33.02%) (see Figure S2 in the data supplement). The funnel plot revealed significant asymmetry (Egger’s intercept=2.5, p=0.06) (see Figure S3 in the data supplement). A trim and fill analysis did not impute additional studies.

Nonverbal learning.

The nonverbal learning effect size was moderate and statistically significant (k=8, g=0.50, 95% CI=0.25–0.76, p<0.001, I2=15.32%) (see Figure S2 in the data supplement). The funnel plot did not reveal asymmetry (see Figure S3 in the data supplement).

Working memory.

The working memory effect size was large and statistically significant (k=9, g=0.74, 95% CI=0.32–1.15, p<0.001, I2=63.1%) (see Figure S4 in the data supplement). The funnel plot revealed one outlier (53) (see Figure S3 in the data supplement). A sensitivity analysis after removal of the outlier revealed a moderate and statistically significant effect (g=0.58, 95% CI=0.27–0.90).

Attention.

The attention effect size was moderate and statistically significant (k=6, g=0.44, 95% CI=0.20–0.68, p<0.001, I2=0%) (see Figure S4 in the data supplement). The funnel plot revealed potential asymmetry (see Figure S3 in the data supplement), but asymmetry was not formally assessed due to an insufficient number of studies.

Psychosocial functioning.

The psychosocial functioning effect size was moderate and statistically significant (k=8, g=0.52, 95% CI=0.01–1.03, p=0.045, I2=78.69%) (see Figure S4 in the data supplement). The funnel plot revealed one study outside of the funnel (46), but this was a relatively large study and the rest of the funnel plot did not suggest small-study effect (see Figure S3 in the data supplement). A sensitivity analysis after removal of the outlier revealed a small and statistically significant effect with no evidence of heterogeneity (g=0.27, 95% CI=0.01–0.52, p=0.04, I2=0%).

Other domains.

Statistically nonsignificant results were found for nonverbal memory (k=7, g=0.20, 95% CI=–0.03 to 0.43, I2=8.79%), executive function (k=13, g=0.20, 95% CI=–0.05 to 0.44, I2=49.75%), processing speed (k=7, g=0.09, 95% CI=–0.17 to 0.35, I2=34.1%), visuospatial skills (k=5, g=0.18, 95% CI=–0.23 to 0.60, I2=64.68%), language (k=6, g=0.41, 95% CI=–0.10–0.92, I2=80.69%), or instrumental activities of daily living (k=6, g=0.21, 95% CI=–0.18 to 0.61) (see Figure 3). Analysis of activities of daily living outcomes was not performed because only one study (54) was available for analysis.

Meta-Analysis of Dementia Outcomes

Overall efficacy on cognitive outcomes.

The overall effect was small and statistically significant (k=11, g=0.26, 95% CI=0.01–0.52, p=0.045, I2=26.48%) (Figure 1). The funnel plot did not reveal significant asymmetry (Egger’s intercept=0.61, p=0.67) (see Figure S3 in the data supplement). However, the summary effect was driven by two studies with a g value ≥1.0 (31, 55). Removal of any of these resulted in statistically nonsignificant effect sizes (after removal of Optale et al. [31]: g=0.17, 95% CI=–0.05 to 0.40, I2=1.61%; after removal of Fernandez-Calvo et al. [55]: g=0.17, 95% CI=–0.06 to 0.39], I2=0%). A mixed-effects analysis revealed that separating these two studies from the other studies in the analysis created two homogenous subgroups with statistically significant difference in effect sizes (outliers: g=1.07, 95% CI=0.54–1.59, I2=0%; remaining: g=0.08, 95% CI=–0.15 to 0.31, I2=0%; Q-between=11.23, df=1, p=0.001).

Efficacy on individual cognitive domains.

The effect size on global cognition was moderate and statistically nonsignificant (k=7, g=0.31, 95% CI=–0.11 to 0.72, p=0.15, I2=56.66%). A moderate and statistically significant effect size was found on visuospatial skills (k=3, g=0.54, 95% CI=0.07–1.01), but this was once more driven by the Optale et al. study (31) (see Figure S4 in the data supplement). There were no other statistically significant effects on any other domain (see Table S4 in the data supplement).

Long-Term Outcomes

Four mild cognitive impairment studies from three articles (43, 56, 57) and four dementia studies (32, 5860) reported outcomes beyond the first follow-up (see Table S5 in the data supplement). Results were not pooled due to an insufficient number of studies and variability of follow-up times, but individual study results indicated a substantial waning of training benefits after training cessation.

Discussion

Based on results from 17 randomized controlled trials of moderate quality, we conclude that CCT is a viable intervention for enhancing cognition in people with mild cognitive impairment. The overall effect size on cognition (g=0.35) is larger than effect sizes previously reported for healthy older adults (g=0.22) (13) and for Parkinson’s disease (g=0.23) (14). This effect was corroborated by a moderate effect size on common clinical measures of global cognition (mainly the Mini-Mental State Examination and Alzheimer’s Disease Assessment Scale-cognitive subscale). Participants in CCT groups improved significantly over the intervention period, while controls did not show any cognitive change, immune to retest effects or nonspecific factors. Most of the trials (70%) used an active control condition, and the effects across active- and passive-controlled trials were comparable. The results of the mild cognitive impairment analysis are therefore robust and indicate a beneficial therapeutic role for CCT in this population. Our analysis updates the benefits on global cognition and memory found in a previous meta-analysis of cognitive training in mild cognitive impairment (17) and is the first, to our knowledge, to focus specifically on randomized trials of CCT.
Moderate effect sizes on most memory and learning domains are encouraging, as amnestic symptoms are the most common presentation of Alzheimer’s disease (27), and amnestic mild cognitive impairment profiles are at higher risk for dementia conversion (3). On the other hand, consistent with findings of previous meta-analyses of CCT (13, 15), we report lack of efficacy on executive function, a key predictor of functional decline (61). Since cognitive training gains typically reflect training content (13, 62), this result may be due to insufficient training on executive processes (mainly fluid intelligence, inhibitory control, and reasoning) within studies. Future studies should consider dedicating more time to executive tasks. More surprising is the null effect on processing speed, since CCT exercises are typically timed and this domain was among the most responsive in prior meta-analyses in other populations (13, 14). In healthy older adults, effects on speed are driven by–and limited to–trials of processing speed training (13), and so again training content may help explain this result.
Depression is associated with mild cognitive impairment (63), as well as conversion to dementia (64). It is therefore notable that we found moderate effect sizes on psychosocial functioning (depression, quality of life, and neuropsychiatric symptoms) in mild cognitive impairment, consistent with prior studies (15) and suggestive that CCT may generalize to benefit mood. On the other hand, reliable effects were not seen on instrumental activities of daily living outcomes. A limitation in this area is the prevalent use of subjective measures that are insensitive to naturalistic or intervention-related change.
Conversely, the pattern of results in individuals with dementia was weak and driven by two studies. Importantly, clinically meaningful effect sizes were found only for studies that used nontraditional approaches to CCT, namely virtual reality (31, 50) and Nintendo Wii (55) (see Figure 1). It is conceivable that these methods are more stimulating and personally engaging than traditional CCT, an idea that merits further research. Overall, there is no robust evidence that CCT can benefit cognition or function in dementia, in keeping with prior meta-analyses in the field (22, 23).

Limitations

To our knowledge, this is the first meta-analysis focusing exclusively on randomized trials of CCT in people with mild cognitive impairment or dementia. Yet since most trials have focused on short-term cognitive outcomes, we had insufficient data to evaluate the durability of CCT effects and whether these may reduce conversion to dementia. Similarly, functional outcomes were measured mainly using proxy measures that are prone to multiple-source bias, typically requiring long-term follow-up and large samples to detect subtle effects on function.
Methodological differences across mild cognitive impairment studies did not translate into statistically meaningful heterogeneity and thus did not warrant planned moderator analysis such as delivery mode and dose. These factors are critical to CCT outcomes but have yet to be thoroughly investigated in primary studies (13, 65). Notably, while methodological quality across the literature has improved since prior reviews, sample sizes continue to be small. Given an effect size of g=0.36, 80% power, and controlling α at 0.05, the minimal intention-to-treat sample size for CCT trials in mild cognitive impairment is about 64. By contrast, only three studies would have met this criterion (44, 46, 47), and the median sample size across studies was 33.
It is noteworthy that we compared effect size estimates and precision in active- and passive-controlled trials because it has been argued that CCT benefits may be limited to passive-controlled studies (18, 20). As in healthy older adults (13), we did not find any systematic difference in effect sizes. However, since only five of the 17 studies employed a passive-control design, a formal subgroup analysis was underpowered and warrants caution.

Conclusions

In mild cognitive impairment, CCT is efficacious on global cognition, memory, working memory, and attention and helps improve psychosocial functioning, including depressive symptoms. Effects on other domains such as executive function and processing speed are negligible. Conversely, CCT is not likely to be beneficial for people with dementia, but immersive technologies may be more useful. Future trials should include larger sample sizes and directly compare CCT alternatives in order to optimize outcomes. Finally, there is insufficient data to determine whether training gains can be maintained over the long-term without further training, and thus study of efficient booster regimens is needed in order to examine whether CCT can indeed delay or prevent progression of mild cognitive impairment to dementia.

Acknowledgments

The authors thank Anna Radowiecka for assistance with full-text assessment, Harry Hallock for assistance with the article figures, Renata Diniz for assistance with risk of bias and assessments and translations from Spanish, and Shin Ho Park for translations from Korean.

Supplementary Material

File (appi.ajp.2016.16030360.ds001.pdf)

References

1.
Prince M, Bryce R, Albanese E, et al:. The global prevalence of dementia: a systematic review and metaanalysis. Alzheimers Dement 2013; 9:63–75 e62
2.
Albert MS, DeKosky ST, Dickson D, et al: The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 2011; 7:270–279
3.
Knopman DS, Beiser A, Machulda MM, et al: Spectrum of cognition short of dementia: Framingham Heart Study and Mayo Clinic Study of Aging. Neurology 2015; 85:1712–1721
4.
Muir SW, Gopaul K, Montero Odasso MM: The role of cognitive impairment in fall risk among older adults: a systematic review and meta-analysis. Age Ageing 2012; 41:299–308
5.
Callahan KE, Lovato JF, Miller ME, et al: Associations between mild cognitive impairment and hospitalization and readmission. J Am Geriatr Soc 2015; 63:1880–1885
6.
Mitchell AJ, Shiri-Feshki M: Rate of progression of mild cognitive impairment to dementia—meta-analysis of 41 robust inception cohort studies. Acta Psychiatr Scand 2009; 119:252–265
7.
Roberts RO, Knopman DS, Mielke MM, et al: Higher risk of progression to dementia in mild cognitive impairment cases who revert to normal. Neurology 2014; 82:317–325
8.
Koepsell TD, Monsell SE: Reversion from mild cognitive impairment to normal or near-normal cognition: risk factors and prognosis. Neurology 2012; 79:1591–1598
9.
Lopez OL, Becker JT, Chang YF, et al: Incidence of mild cognitive impairment in the Pittsburgh Cardiovascular Health Study-Cognition Study. Neurology 2012; 79:1599–1606
10.
Cooper C, Li R, Lyketsos C, et al: Treatment for mild cognitive impairment: systematic review. Br J Psychiatry 2013; 203:255–264
11.
Tricco AC, Soobiah C, Berliner S, et al: Efficacy and safety of cognitive enhancers for patients with mild cognitive impairment: a systematic review and meta-analysis. CMAJ 2013; 185:1393–1401
12.
Lustig C, Shah P, Seidler R, et al: Aging, training, and the brain: a review and future directions. Neuropsychol Rev 2009; 19:504–522
13.
Lampit A, Hallock H, Valenzuela M: Computerized cognitive training in cognitively healthy older adults: a systematic review and meta-analysis of effect modifiers. PLoS Med 2014; 11:e1001756
14.
Leung IH, Walton CC, Hallock H, et al: Cognitive training in Parkinson disease: a systematic review and meta-analysis. Neurology 2015; 85:1843–1851
15.
Motter JN, Pimontel MA, Rindskopf D, et al: Computerized cognitive training and functional recovery in major depressive disorder: a meta-analysis. J Affect Disord 2016; 189:184–191
16.
Andrieu S, Coley N, Lovestone S, et al: Prevention of sporadic Alzheimer’s disease: lessons learned from clinical trials and future directions. Lancet Neurol 2015; 14:926–944
17.
Li H, Li J, Li N, et al: Cognitive intervention for persons with mild cognitive impairment: A meta-analysis. Ageing Res Rev 2011; 10:285–296
18.
Martin M, Clare L, Altgassen AM, et al: Cognition-based interventions for healthy older people and people with mild cognitive impairment. Cochrane Database Syst Rev 2011; (1):CD006220
19.
Simon SS, Yokomizo JE, Bottino CM: Cognitive intervention in amnestic mild cognitive impairment: a systematic review. Neurosci Biobehav Rev 2012; 36:1163–1178
20.
Reijnders J, van Heugten C, van Boxtel M: Cognitive interventions in healthy older adults and people with mild cognitive impairment: a systematic review. Ageing Res Rev 2013; 12:263–275
21.
Aguirre E, Woods RT, Spector A, et al: Cognitive stimulation for dementia: a systematic review of the evidence of effectiveness from randomised controlled trials. Ageing Res Rev 2013; 12:253–262
22.
Bahar-Fuchs A, Clare L, Woods B: Cognitive training and cognitive rehabilitation for mild to moderate Alzheimer’s disease and vascular dementia. Cochrane Database Syst Rev 2013; 6:CD003260
23.
Huntley JD, Gould RL, Liu K, et al: Do cognitive interventions improve general cognition in dementia? A meta-analysis and meta-regression. BMJ Open 2015; 5:e005247–e005247
24.
Coyle H, Traynor V, Solowij N: Computerized and virtual reality cognitive training for individuals at high risk of cognitive decline: systematic review of the literature. Am J Geriatr Psychiatry 2015; 23:335–359
25.
García-Casal JA, Loizeau A, Csipke E, et al: Computer-based cognitive interventions for people living with dementia: a systematic literature review and meta-analysis. Aging Ment Health (Epub ahead of print, January 25, 2016)
26.
Liberati A, Altman DG, Tetzlaff J, et al: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 2009; 339:b2700
27.
McKhann GM, Knopman DS, Chertkow H, et al: The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 2011; 7:263–269
28.
Strauss EH, Sherman EMS, Spreen O: A Compendium of Neuropsychological Tests: Administration, Norms and Commentary. Oxford, United Kingdom, Oxford University Press, 2006
29.
Barnes DE, Yaffe K, Belfor N, et al: Computer-based cognitive training for mild cognitive impairment: results from a pilot randomized, controlled trial. Alzheimer Dis Assoc Disord 2009; 23:205–210
30.
Gooding AL, Choi J, Fiszdon JM, et al: Comparing three methods of computerized cognitive training for older adults with subclinical cognitive decline Neuropsychol Rehabil 2016; 26:810–821
31.
Optale G, Urgesi C, Busato V, et al: Controlling memory impairment in elderly adults using virtual reality memory training: a randomized controlled pilot study. Neurorehabil Neural Repair 2010; 24:348–357
32.
Galante E, Venturini G, Fiaccadori C: Computer-based cognitive intervention for dementia: preliminary results of a randomized clinical trial. G Ital Med Lav Ergon 2007; 29(suppl B):B26–B32
33.
Zhuang JP, Fang R, Feng X, et al: The impact of human-computer interaction-based comprehensive training on the cognitive functions of cognitive impairment elderly individuals in a nursing home. J Alzheimers Dis 2013; 36:245–251
34.
Higgins JP, Altman DG, Gøtzsche PC, et al: The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011; 343:d5928
35.
Maher CG, Sherrington C, Herbert RD, et al: Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther 2003; 83:713–721
36.
Cohen J: Statistical Power Analysis for the Behavioral Sciences. Oxfordshire, United Kingdom, Taylor and Francis, 2013
37.
Higgins JP, Thompson SG, Deeks JJ, et al: Measuring inconsistency in meta-analyses. BMJ 2003; 327:557–560
38.
Sterne JA, Sutton AJ, Ioannidis JP, et al: Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011; 343:d4002
39.
Egger M, Davey Smith G, Schneider M, et al: Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315:629–634
40.
Duval S, Tweedie R: Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000; 56:455–463
41.
Gaitán A, Garolera M, Cerulla N, et al: Efficacy of an adjunctive computer-based cognitive training program in amnestic mild cognitive impairment and Alzheimer’s disease: a single-blind, randomized clinical trial. Int J Geriatr Psychiatry 2013; 28:91–99
42.
Boller B, Jennings JM, Dieudonné B, et al: Recollection training and transfer effects in Alzheimer’s disease: effectiveness of the repetition-lag procedure. Brain Cogn 2012; 78:169–177
43.
Fiatarone Singh MA, Gates N, Saigal N, et al: The Study of Mental and Resistance Training (SMART) study—resistance training and/or cognitive training in mild cognitive impairment: a randomized, double-blind, double-sham controlled trial. J Am Med Dir Assoc 2014; 15:873–880
44.
Barban F, Annicchiarico R, Pantelopoulos S, et al: Protecting cognition from aging and Alzheimer’s disease: a computerized cognitive training combined with reminiscence therapy. Int J Geriatr Psychiatry 2016; 31:340–348
45.
Hagovská M, Takáč P, Dzvoník O: Effect of a combining cognitive and balanced training on the cognitive, postural and functional status of seniors with a mild cognitive deficit in a randomized, controlled trial. Eur J Phys Rehabil Med 2016; 52:101–109
46.
Hagovská M, Olekszyová Z: Impact of the combination of cognitive and balance training on gait, fear and risk of falling and quality of life in seniors with mild cognitive impairment. Geriatr Gerontol Int 2016; 16:1043–1050
47.
Tarnanas I, Tsolakis A, Tsolaki M: Assessing Virtual Reality Environments as Cognitive Stimulation Method for Patients with MCI, in Technologies of Inclusive Well-Being. Edited by Brooks AL, Brahnam S, Jain LC. Berlin, Springer, 2014, pp 39–74
48.
Finn M, McDonald S: Computerised cognitive training for older persons with mild cognitive impairment: A pilot study using a randomised controlled trial design. Brain Impair 2011; 12:187–199
49.
Finn M, McDonald S: Repetition-lag training to improve recollection memory in older people with amnestic mild cognitive impairment. A randomized controlled trial. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn 2015; 22:244–258
50.
Man DW, Chung JC, Lee GY: Evaluation of a virtual reality-based memory training programme for Hong Kong Chinese older adults with questionable dementia: a pilot study. Int J Geriatr Psychiatry 2012; 27:513–520
51.
Rozzini L, Costardi D, Chilovi BV, et al: Efficacy of cognitive rehabilitation in patients with mild cognitive impairment treated with cholinesterase inhibitors. Int J Geriatr Psychiatry 2007; 22:356–360
52.
Loewenstein DA, Acevedo A, Czaja SJ, et al: Cognitive rehabilitation of mildly impaired Alzheimer disease patients on cholinesterase inhibitors. Am J Geriatr Psychiatry 2004; 12:395–402
53.
Barcelos N, Shah N, Cohen K, et al: Aerobic and cognitive exercise (ACE) pilot study for older adults: executive function improves with cognitive challenge while exergaming. J Int Neuropsychol Soc 2015; 21:768–779
54.
Wittelsberger R, Krug S, Tittlbach S, et al: The influence of Nintendo-Wii bowling upon residents of retirement homes. Z Gerontol Geriatr 2013; 46:425–430
55.
Fernández-Calvo B, Rodríguez-Pérez R, Contador I, et al: Efficacy of cognitive training programs based on new software technologies in patients with Alzheimer-type dementia. Psicothema 2011; 23:44–50
56.
Herrera C, Chambon C, Michel BF, et al: Positive effects of computer-based cognitive training in adults with mild cognitive impairment. Neuropsychologia 2012; 50:1871–1881
57.
Hughes TF, Flatt JD, Fu B, et al: Interactive video gaming compared with health education in older adults with mild cognitive impairment: a feasibility study. Int J Geriatr Psychiatry 2014; 29:890–898
58.
Heiss WD, Kessler J, Mielke R, et al: Long-term effects of phosphatidylserine, pyritinol, and cognitive training in Alzheimer’s disease: a neuropsychological, EEG, and PET investigation. Dementia 1994; 5:88–98
59.
Tárraga L, Boada M, Modinos G, et al: A randomised pilot study to assess the efficacy of an interactive, multimedia tool of cognitive stimulation in Alzheimer’s disease. J Neurol Neurosurg Psychiatry 2006; 77:1116–1121
60.
Lee GY, Yip CCK, Yu ECS, et al: Evaluation of a computer-assisted errorless learning-based memory training program for patients with early Alzheimer’s disease in Hong Kong: a pilot study. Clin Interv Aging 2013; 8:623–633
61.
Marshall GA, Rentz DM, Frey MT, et al: Executive function and instrumental activities of daily living in mild cognitive impairment and Alzheimer’s disease. Alzheimers Dement 2011; 7:300–308
62.
Ball K, Berch DB, Helmers KF, et al: Effects of cognitive training interventions with older adults: a randomized controlled trial. JAMA 2002; 288:2271–2281
63.
Richard E, Reitz C, Honig LH, et al: Late-life depression, mild cognitive impairment, and dementia. JAMA Neurol 2013; 70:374–382
64.
Cooper C, Sommerlad A, Lyketsos CG, et al: Modifiable predictors of dementia in mild cognitive impairment: a systematic review and meta-analysis. Am J Psychiatry 2015; 172:323–334
65.
Hampstead BM, Gillis MM, Stringer AY: Cognitive rehabilitation of memory for mild cognitive impairment: a methodological review and model for future research. J Int Neuropsychol Soc 2014; 20:135–151
66.
Kim MY, Lee KS, Choi JS, et al: Effectiveness of cognitive training based on virtual reality for the elderly. J Korean Acad Rehabil Med. 2005; 29:424–433
67.
Lin F, Heffner KL, Ren P, et al: Cognitive and neural effects of vision-based speed-of-processing training in older adults with amnestic mild cognitive impairment: a pilot study. J Am Geriatr Soc 2016; 64:1293–1298

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 329 - 340
PubMed: 27838936

History

Received: 27 March 2016
Revision received: 11 August 2016
Accepted: 22 August 2016
Published online: 14 November 2016
Published in print: April 01, 2017

Keywords

  1. Dementia-Alzheimer-s Disease
  2. Cognitive Therapy

Authors

Details

Nicole T.M. Hill, M.BMSc.
From Black Dog Institute, the University of New South Wales, New South Wales, Australia; the Regenerative Neuroscience Group and Healthy Brain Ageing Program, Brain and Mind Centre, University of Sydney, New South Wales, Australia; the School of Psychology, University of Sydney, New South Wales, Australia; and the School of Medical Sciences, University of Sydney, New South Wales, Australia.
Loren Mowszowski, D.Psych.
From Black Dog Institute, the University of New South Wales, New South Wales, Australia; the Regenerative Neuroscience Group and Healthy Brain Ageing Program, Brain and Mind Centre, University of Sydney, New South Wales, Australia; the School of Psychology, University of Sydney, New South Wales, Australia; and the School of Medical Sciences, University of Sydney, New South Wales, Australia.
Sharon L. Naismith, D.Psych.
From Black Dog Institute, the University of New South Wales, New South Wales, Australia; the Regenerative Neuroscience Group and Healthy Brain Ageing Program, Brain and Mind Centre, University of Sydney, New South Wales, Australia; the School of Psychology, University of Sydney, New South Wales, Australia; and the School of Medical Sciences, University of Sydney, New South Wales, Australia.
Verity L. Chadwick, B.Sc. (Hons.)
From Black Dog Institute, the University of New South Wales, New South Wales, Australia; the Regenerative Neuroscience Group and Healthy Brain Ageing Program, Brain and Mind Centre, University of Sydney, New South Wales, Australia; the School of Psychology, University of Sydney, New South Wales, Australia; and the School of Medical Sciences, University of Sydney, New South Wales, Australia.
Michael Valenzuela, Ph.D.
From Black Dog Institute, the University of New South Wales, New South Wales, Australia; the Regenerative Neuroscience Group and Healthy Brain Ageing Program, Brain and Mind Centre, University of Sydney, New South Wales, Australia; the School of Psychology, University of Sydney, New South Wales, Australia; and the School of Medical Sciences, University of Sydney, New South Wales, Australia.
Amit Lampit, Ph.D.
From Black Dog Institute, the University of New South Wales, New South Wales, Australia; the Regenerative Neuroscience Group and Healthy Brain Ageing Program, Brain and Mind Centre, University of Sydney, New South Wales, Australia; the School of Psychology, University of Sydney, New South Wales, Australia; and the School of Medical Sciences, University of Sydney, New South Wales, Australia.

Notes

Address correspondence to Dr. Lampit ([email protected]).

Funding Information

National Health and Medical Research Council10.13039/501100000925: 1108520
Dr. Mowszowski is supported by a National Health and Medical Research Council of Australia/Australian Research Council (NHMRC-ARC) Dementia Research Development Fellowship. Dr. Naismith is an NHMRC Career Development Fellow. Ms. Chadwick is a former employee of Synaptikon. Dr. Valenzuela receives in-kind research support in the form of no-cost software from BrainTrain and Synaptikon for projects unrelated to this study; he is also an NHMRC Career Development Fellow. Dr. Lampit is supported by an NHMRC/ARC Dementia Research Development Fellowship. Ms. Hill reports no financial relationships with commercial interests.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share