Age-related cognitive decline is common and may lead to substantial difficulties and disabilities in everyday life. We hypothesized that 10 hours of visual speed of processing training would prevent age-related declines and potentially improve cognitive processing speed.
Within two age bands (50–64 and≥65) 681 patients were randomized to (a) three computerized visual speed of processing training arms (10 hours on-site, 14 hours on-site, or 10 hours at-home) or (b) an on-site attention control group using computerized crossword puzzles for 10 hours. The primary outcome was the Useful Field of View (UFOV) test, and the secondary outcomes were the Trail Making (Trails) A and B Tests, Symbol Digit Modalities Test (SDMT), Stroop Color and Word Tests, Controlled Oral Word Association Test (COWAT), and the Digit Vigilance Test (DVT), which were assessed at baseline and at one year. 620 participants (91%) completed the study and were included in the analyses. Linear mixed models were used with Blom rank transformations within age bands.
All intervention groups had (p<0.05) small to medium standardized effect size improvements on UFOV (Cohen's d = −0.322 to −0.579, depending on intervention arm), Trails A (d = −0.204 to −0.265), Trails B (d = −0.225 to −0.320), SDMT (d = 0.263 to 0.351), and Stroop Word (d = 0.240 to 0.271). Converted to years of protection against age-related cognitive declines, these effects reflect 3.0 to 4.1 years on UFOV, 2.2 to 3.5 years on Trails A, 1.5 to 2.0 years on Trails B, 5.4 to 6.6 years on SDMT, and 2.3 to 2.7 years on Stroop Word.
Visual speed of processing training delivered on-site or at-home to middle-aged or older adults using standard home computers resulted in stabilization or improvement in several cognitive function tests. Widespread implementation of this intervention is feasible.
Citation: Wolinsky FD, Vander Weg MW, Howren MB, Jones MP, Dotson MM (2013) A Randomized Controlled Trial of Cognitive Training Using a Visual Speed of Processing Intervention in Middle Aged and Older Adults. PLoS ONE 8(5): e61624. doi:10.1371/journal.pone.0061624
Editor: Jerson Laks, Federal University of Rio de Janeiro, Brazil
Received: December 19, 2012; Accepted: March 5, 2013; Published: May 1, 2013
Copyright: © 2013 Wolinsky et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by National Institutes of Health (NIH) grant RC1 AG-035546 to FDW. The visual speed of processing training video game used in IHAMS is commercially available from Posit Science Corporation (San Francisco, CA, USA). None of the members of the investigative team have any conflicts of interest or commitment involving Posit Science. Specifically, no one on the investigative team will financially profit in any way from the use of the visual speed of processing training. Posit Science acquired ownership in October 2007 of Ball and Roenker's original speed of processing intervention that was used in the multi-site ACTIVE study on which FW was a co-investigator. In collaboration with Professors Ball and Roenker, Posit Science subsequently developed the current version of the VSP training video game used in IHAMS. From December 2007 to March 2009, FW had a part-time consulting arrangement (15 days total) with Posit Science to support additional analyses of the first five-years of the ACTIVE follow-up data that had not been identified in the original ACTIVE protocols nor funded by the various NIH grants supporting ACTIVE. That arrangement was approved in advance by the ACTIVE Executive Committee (which included the NIH project officers), and was approved by the Provost of the University of Iowa. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Age-related cognitive decline is common and affects memory, orientation, attention, abstract thinking, and perception –. These cognitive declines may lead to substantial difficulties and disabilities in everyday life –. Because life expectancy is at an all-time high and improving , identifying interventions that can be widely and efficiently implemented and that may prevent or even reverse cognitive decline are clinical and public health priorities –. This is especially important given evidence that cognitive declines are well-documented as early as age 30 in cross-sequential data – and as early as age 45 in longitudinal data .
Because part (but clearly not all) of these declines reflect negative brain plasticity, cognitive abilities may be strengthened somewhat by interventions that promote positive brain plasticity , , , . Among the most promising such interventions are complex video games that train strategic control in structured situations . Ball and Roenker – developed the precursor to such a video game intervention focusing on visual speed of processing. Their original training program was used as one of three interventions in the U.S. National Institutes of Health (NIH) funded, multi-site Advanced Cognitive Trial for Independent and Vital Elderly (ACTIVE), the largest cognitive training trial ever conducted –. Results from ACTIVE demonstrated that each of the three cognitive training interventions—memory, reasoning, and visual speed of processing—affected their targeted proximal and primary outcomes over both short- and long-term (1–5 year) follow-up periods – and reflected the equivalent of 6, 4, and 8 years, respectively, of cognitive decline restoration . However, only the visual speed of processing intervention had significant and substantial effects on a variety of health outcomes including health-related quality of life, depressive symptoms and the onset of suspected clinical depression, self-rated health, and internal locus of control that lasted up to five years –.
ACTIVE, however, had some limitations , . First, because ACTIVE used a no contact rather than an attention control group, placebo effects could not be ruled out except by direct comparison of one training intervention to another. Second, because ACTIVE's booster training was compliance-conditioned, treatment effects could not be separated from adherence effects. Third, because ACTIVE relied on only one speed of processing outcome (the Useful Field of View test; UFOV ), which was thematically similar to the original visual speed of processing intervention, the possibility of “training to the test” existed. Fourth, because ACTIVE used Ball and Roenker's – original, MS-DOS based visual speed of processing intervention that required ongoing, supervised assistance and touch screen monitors, the potential for widespread implementation was limited. Finally, because ACTIVE only included participants≥65, it is not known whether the same training effects could be achieved at younger ages.
The objective of the Iowa Healthy and Active Minds Study (IHAMS) was to address these limitations. We designed IHAMS as a four-arm, parallel RCT that used the newest (MS-Windows based) version of the visual speed of processing training program that can be used on any personal computer (PC) without supervision. Participants were randomized separately within two age bands (50–64 and 65 years old or older) to either an attention control group using a computerized crossword puzzle game in a university-based laboratory, or to two active intervention groups receiving the visual speed of processing training in a university-based laboratory—one with and one without booster training, or to one active intervention group that was given the visual speed of processing software to take home and use on their own PCs. Primary and secondary neuropsychological outcomes were assessed at baseline and one year later.
IHAMS (NCT-01165463) was reviewed and approved by the University of Iowa (IRB Protocol 200908789), and funded by the NIH (RC1 AG035546). Written informed consent was obtained from all participants at baseline, and verbal consent was obtained at all follow-up interviews.
Protocol and Adjustments
The protocol for this trial and supporting CONSORT checklist are available as supporting information (see Checklist S1 and Protocol S1). Five adjustments were made to the funded protocol prior to enrollment. First, direct randomization to four study arms within age bands was used, rather than initial randomization to three study arms with subsequent second level randomization to no booster vs. booster training within the on-site visual speed of processing training arm. Second, UFOV was specified as the sole primary outcome because no data existed from ACTIVE or any other study for the other neuropsychological outcomes, which were re-designated as secondary outcomes. Third, the power calculations were revised based on additional analyses of the one-year UFOV results from the ACTIVE study. Fourth, participants were trained in two-hour sessions, rather than the one-hour sessions used in ACTIVE due to the logistical and financial constraints of the funding mechanism. Finally, Blom rank transformations were used within age bands for normalization of the left and right censored neuropsychological outcomes, with linear mixed models used for consistency with prior studies.
Details about the protocol  and post-training results on the primary outcome (UFOV)  have previously been reported. Figure 1 presents the IHAMS CONSORT flow diagram for the three visual speed of processing active intervention arms (commercially available as Road Tour from Posit Science Corporation, San Francisco, CA, USA) vs. the attention control computerized crossword puzzle game (commercially available as Boatload of Crosswords, Boatload Puzzles, Yorktown Heights, NY, USA).
Figure 1. CONSORT Flow Chart for the IHAMS Study.doi:10.1371/journal.pone.0061624.g001
Sample size estimation was based on a secondary analysis of the ACTIVE data where the average one-year improvement in the UFOV score for the no contact controls was 69.9 ms (standard deviation = 159.1 ms) vs. 220.5 ms (standard deviation = 188.3) for the speed of processing group, for a 150.6 ms improvement differential. With 650 participants overall, a minimum of 138 in each group after 15% attrition by the one-year follow-up, and a reduced improvement differential of only 60 ms (due to IHAMS' inclusion of younger participants, use of an attention control group, and unconditional randomization to booster training), there would be 81.6% power (alpha = 0.05, two-tailed) for the primary outcome.
Potential participants were identified from patients attending the general internal or family medicine clinics at the University of Iowa. Using the electronic medical record (Epic, Verona, WI, USA), initial inclusion criteria were age (≥50), having≥2 visits to the clinic in the past year, and having no ICD9-CM codes indicating cognitive impairment. Cognitive impairment codes were Alzheimer's disease (331.0), Pick's disease (331.1), arteriosclerotic dementia (290.4 to 290.43), other senile or pre-senile dementia (290.0 to 290.9), dementia due to alcohol (291.1 to 291.2) or drugs (292.82 to 292.83), amnestic syndrome (294.0), or dementia due to other organic conditions (294.1). This electronic screening identified 5,743 potential participants.
Randomly selected (without replacement) weekly samples of 250 of these 5,743 individuals were then sent letters beginning in February 2010 and ending in November 2010 that were signed by the clinic medical directors and the principal investigator (FW) inviting them to participate by calling the IHAMS project office. Responding individuals underwent a brief screening telephone call to determine whether they met further inclusion criteria that could not be assessed using the electronic medical record. These were (a) having a PC and internet connection in the home, (b) no significant uncorrected self-reported vision issues, (c)<3 errors on the Short Portable Mental Status Screening Questionnaire , and (d) living within 30 miles of the project office. Of the 5,743 potential participants, 1,627 could not be reached, 2,079 did not respond or declined, 390 failed to meet one or more of the inclusion (telephone screening) criteria, and 966 had not been sent their letters by the time study enrollment closed.
The 681 eligible participants were invited to the project laboratory where written informed consent was obtained prior to their enrollment and baseline assessments, which were conducted by trained interviewers. Participants were then randomized by the study statistician (MJ) within age bands (50–64 and≥65) using a computerized algorithm, a 3:3:4:4 allocation ratio, random permuted blocks of 4, 8, and 12, and sequentially numbered opaque envelopes , . Because the participants' group assignments remained sealed until after the end of their initial visits, when the envelope was opened by the study coordinator (MD), the baseline assessments were fully double-blinded. After that, however, participants were no longer blinded because they knew the group to which they had been assigned.
After their baseline assessments and randomization, participants were invited back to the project laboratory on a subsequent day for their first training session. At that first session each on-site training participant received a scripted 15-minute introduction on how to use the assigned training program before going to one of two identical training rooms (one had the visual speed of processing program on five private work stations, while the other had the attention control program on five private work stations) to complete the first of their five weekly, two-hour training sessions. After completing 10 hours of training (the same basic training dose used in ACTIVE), or at approximately 6–8 weeks post-randomization for non-adherents (whichever came first), all on-site participants were invited back to the project laboratory for post-training assessments. One of the on-site active intervention training groups was also invited back at 11 months for two additional 2-hour “booster” training sessions (as in ACTIVE). All on-site participants were invited back for one-year assessments at which blinding was broken for the assessors but not for the investigative team at the concluding set of questions that solicited the participants' views about their assigned training program. After completing the one-year assessments, all on-site participants were given a copy of the visual speed of processing training software and installation directions to take home and load on their PCs and use at their discretion in perpetuity.
The at-home training participants were also invited back to the research lab after their baseline assessments, and received the scripted 15-minute introduction on how to use the visual speed of processing training program. This was followed by a 5–10 minute scripted introduction on how to load the training software onto their home PC. These participants were then given a copy of the training software and the loading instructions and asked to go home, load it on their PCs, and then complete 10 hours of training. Like the patients in the other three training groups, the at-home training participants were invited back for their post-training assessments at 6–8 weeks post-randomization, and for their one-year assessments. After completing the one-year assessments, at-home participants were told that they could continue to use the visual speed of processing training software on their home PCs at their discretion in perpetuity.
Visual Speed of Processing Training
Figure 2 shows the appearance of the training program. After clicking on the start button in Figure 2a, Figure 2b is shown where the license plate and the eight circular locations surrounding it are masked. The masked license plate is then replaced (Figure 2c) with the target vehicle, either a car or a truck, and the eight masked circular locations are replaced with seven distracter stimuli (rabbit crossing signs in this example) or the target stimulus (always the Route 66 sign). The stimuli signs are presented for a specified time and are then replaced by Figure 2d. The amount of time that Figure 2c remains on the screen is measured in milliseconds (ms). In Figure 2e, both target vehicles (the car and truck) and the 8 circular locations are presented and the user is first required to select the correct target vehicle before selecting the circular location where the target sign appeared (Figure 2f).
Figure 2. How the Visual Speed of Processing Training Program Appears to the User.doi:10.1371/journal.pone.0061624.g002
Cognitive processing speed is trained by progressively reducing the ms of exposure that Figure 2c must remain on the screen for correct identification of both stimuli. The training program does not advance to a greater challenge until participants can maintain a 75% success rate at the current challenge level. As performance improves the challenge level is increased as follows: the visual field expands to add medium and distal orbits, these are accompanied by an increasing number of distracters (up to 47), and the vehicle pairs morph through nine different stages to become more similar and thus increasingly difficult to differentiate.
The attention control group used a computerized crossword puzzle game for training purposes. This game offered a choice between three puzzle sizes, three levels of complexity, and varying font sizes. It also included optional help features such as filling in an unknown letter or word. There is, however, no progressive challenge to the user by increased speed, visual field size, number of distractors, or degree of difficulty of target stimulus differentiation. Thus, the crossword puzzle program provides an appropriate, computerized attention control alternative to the active visual speed of processing training.
The primary outcome  was the UFOV , which was obtained at the baseline, post-training, and one-year assessments. It includes stimulus identification, divided attention, and selective attention subtests scored from 17-500 ms reflecting the shortest exposure time at which the participant could correctly perform each subtest, with a composite score ranging from 51–1500 ms. The secondary outcomes  were obtained at the baseline and one-year assessments. They were the Trail Making A and B tests (Trails ), the Symbol Digit Modalities Test (SDMT ), the Stroop Color and Word Test (Stroop ), the Controlled Oral Word Association Test (COWAT ), and the Digit Vigilance Test (DVT ). The Trails assess visual scanning ability, processing speed, and set-shifting/executive functioning, and are coded as the number of seconds to correctly complete connecting the number (Trails A) and number-letter (Trails B) sets. The SDMT is a substitution task that captures divided attention and processing speed, and is based on how many of 110 possible digit-symbol pairs are correctly scored in 90 seconds. The Stroop assesses the effect of interference with and inhibition on cognitive flexibility and processing speed, and other aspects of executive functioning, and is scored as the correct number of words, colors, and color-words identified in 45 seconds on each subtest. The COWAT is a phonemic test that assesses verbal fluency based on the number of unique words beginning with the letter C (or F or L) generated by the participant during 60 seconds, with a composite score of the number of correct words across the three letter trials. The DVT is a visual cancellation task that assesses sustained attention and psychomotor speed, and is performed by crossing out randomly placed 6′s in 59 rows of numbers, and is scored as the error (commission and omission) and time totals.
Means on the selected background characteristics and the neuropsychological outcomes were compared by intervention group and age band using chi-squared, analysis of variance, or Kruskal-Wallis tests for independent samples, as appropriate. The distributions on the neuropsychological tests are typically not normal due in part to left and right censoring (i.e., fixed minimal and maximal scores), and this was the case in IHAMS. At baseline, four of the outcomes were positively skewed (skewness = 1.3 to 3.0), six outcomes were leptokurtic (kurtosis = 1.3 to 7.1), and both distributional violations occurred for four outcomes (UFOV, Trails A, Trails B, and DVT errors). Therefore, Blom rank transformations were used to improve distributional normalization for model estimation, which resulted in means of zero and standard deviations of one , and yielded results that are directly interpretable as standardized effect sizes (Cohen's d ) because the effect of each intervention group vs. the attention control group is now measured in standard deviations. The Blom rank transformations were calculated separately within age bands to adjust for the different initial ability levels and to facilitate relative effect size comparisons.
Although attrition was modest (9%), it was evaluated using multivariable logistic regression (with backwards elimination given the small number of attriters) on the baseline neuropsychological tests, the treatment groups, age bands, and self-reported health . Intent-to-treat analyses among the 620 (91%) respondents with complete data at the baseline and one-year assessments were conducted using linear mixed models. These models included between-person main effects for treatment group and age band, within-person main effects for time, and all two- and three-way interaction terms. Dunnett tests were used to compare each visual speed of processing training group to the attention control group. Significant observed effects were then converted into years of protection against age-related declines and/or years of improvement in cognitive performance by re-estimating the models using the original scalar values (i.e., non-Blom rank transformed scores), and dividing those effects by annualized age declines determined from prior normative studies. To address non-adherence to training (and provide a preliminary effectiveness analysis), especially within the at-home training group, the analyses were repeated after restricting the analytic sample to those who completed at least one hour of training.
91% of the participants completed their one-year assessments. To gauge the extent of differential attrition, the baseline neuropsychological tests, treatment groups, age bands, and self-reported health were all considered in an initial multiple logistic regression model. Only three of these variables were retained on the final step of the backwards elimination process. Participants in the booster training group had greater odds of being lost to follow-up (adjusted odds ratio [AOR] = 2.051, p = 0.021; the adjustment was for self-rated health and errors on the DVT test), as did those with lower self-reported health (AOR 1.597 per lower category rating, p = 0.004; the adjustment was for the booster training group status and errors on the DVT test), and those with more errors on the DVT test (AOR = 1.040 per error, p = 0.006; the adjustment was for booster training group status and self-rated health). Overall, the model fit the data reasonably well, with a p value of 0.710 on the Hosmer-Lemeshow statistic, and an area under the curve (AUC) of 0.690.
Median training time was 13 hours for the on-site visual speed of processing training with boosters group vs. 9–10 hours for the other training and attention control groups. These average training times, however, mask substantial heterogeneity in adherence rates. Among those in the at-home visual speed of processing training group, 28.3% completed less than one hour of training vs. 9.8%, 2.0%, and 3.2% in the on-site visual speed of processing without booster training, on-site visual speed of processing with booster training, and on-site attention control groups, respectively (p<0.001). A substantial amount of the non-adherence in the at-home training group was due to 32 participants' self-reported inability to successfully load the visual speed of processing software on their home PCs, a problem that would likely be resolved using the web-based delivery method that is now commercially available.
Table 1 contains the group means for the background characteristics of the 620 participants in the analytic sample at baseline, by training group and age band with p values obtained from analysis of variance or chi-squared tests as appropriate. The only significant difference (p<0.05) involved marital status for the middle aged (i.e., 50–64 year old) adults, with the attention control group being less likely to be married. This difference was also the only one observed when the age bands were combined (data not shown). Table 2 contains the group means (prior to Blom rank transformations) for the neuropsychological tests at baseline by training group and age band with p values obtained using Kruskal-Wallis tests. Significant differences (p<0.05) were observed only for the SDMT for the middle aged adults, with the attention control group being somewhat disadvantaged (i.e., fewer correct pairs). When the age bands were combined (data not shown), however, significant differences (p<0.05) were observed for the SDMT, Trails B, and Stroop Word outcomes, with the attention control group again being somewhat disadvantaged (i.e., fewer correct pairs, slower times, and fewer correct words).
Table 1. Baseline Group Means on Background Characteristics by Treatment Group within Age Bands, among Participants with Complete Data at Baseline and One Year.doi:10.1371/journal.pone.0061624.t001
Table 2. Baseline Group Means prior to Blom Rank Transformations on the Primary and Secondary Outcomes by Treatment Group within Age Bands, among Participants with Complete Data at Baseline and One Year.doi:10.1371/journal.pone.0061624.t002
Linear Mixed Models
Table 3 contains the results obtained from the linear mixed models of treatment group differences on the Blom rank transformed primary and secondary outcome measures. Cell entries are Cohen's d statistics (and associated Dunnett test p values) of the within-person changes in the neuropsychological outcomes from baseline to one year between each visual speed of processing training group vs. the attention control group. Cohen's d  statistics of 0.20 to 0.49 are considered small standardized effect sizes, Cohen's d statistics of 0.50 to 0.79 are considered medium standardized effect sizes, and Cohen's d statistics of 0.80 or greater are considered large standardized effect sizes. We note that there were no significant main effects for age bands, or for any interaction involving age bands. Thus, the standardized effect sizes shown were comparable for both age bands.
Table 3. Intent-to-Treat Linear Mixed Model Results for the Blom Rank Transformed Primary and Secondary Outcomes (the Comparator is always the Attention Control Group), N = 620.doi:10.1371/journal.pone.0061624.t003
Compared to the attention control group, all three visual speed of processing training groups had significant small to medium effect size improvements (i.e., faster completion times) on the UFOV (primary outcome). The difference between the differences observed for the on-site visual speed of processing with and without booster training (at 11 months) groups vs. the on-site attention control group reflects the effect of booster training. The differences observed for the on-site and at-home visual speed of processing training groups reflect the comparability of the effect of these two training delivery modalities despite the lower adherence rates in the at-home group. To better characterize these effect sizes, Figure 3 plots the Blom rank transformed means for the UFOV by treatment group at baseline and at the one-year follow-up. As shown, the attention control group experienced a one-year age-related decline in UFOV scores. In contrast, the on-site (with no boosters) and the at-home training groups were equally protected from that one-year age-related decline, while the on-site with booster training group had improved UFOV scores.
Figure 3. Plots of Blom Rank Transformed Means on the Useful Field of View by Treatment Group at Baseline and One Year.doi:10.1371/journal.pone.0061624.g003
All three visual speed of processing training groups also had significant small effect size improvements (i.e., faster completion times, more correct symbol to digit matches, or more correct words) on four of the secondary outcomes—the Trails A, Trails B, SDMT, and Stroop word tests. In contrast to the effects on the UFOV, there was no additional benefit observed for booster training on any of the secondary outcomes. Consistent with the effects on the UFOV, visual speed of processing training was comparably effective when it was received in an unstructured at-home setting as it was in the structured project laboratory setting. To better characterize these effects, treatment group means at baseline and the one-year follow-up were plotted (data not shown). In general, these means plots revealed age-related declines for the attention control group, but protection against age-related declines for the treatment groups on the Trails A, Trails B, SDMT, and Stroop word tests. Although there were no statistically significant visual speed of processing training effects on the other secondary outcomes (Stroop color and color-word, COWAT, and DVT time and errors tests), all observed differences reflected larger improvements (more correct responses, faster times, and fewer errors) vs. the attention control group that were also comparable across delivery modes.
To gauge the clinical relevance of the significant intervention effects shown in Table 3, we converted them into years of protection against age-related declines and/or years of improvement in cognitive performance. This was done by re-estimating the models using the original scalar values (i.e., non-Blom rank transformed scores), and then dividing those effects by annualized age declines determined from prior normative studies. As shown in Table 4, the significant intervention effects reflect protection against normal age-related declines and/or improvements of 3.0 to 4.1 years (depending on intervention group) on UFOV, 2.2 to 3.5 years on Trails A, 1.5 to 2.0 years on Trails B, 5.4 to 6.6 years on SDMT, and 2.3 to 2.7 years on Stroop Word.
Table 4. Conversion of Standardized Effects1 into Years of Protection Against Age-Related Declines and/or Years of Improvement in Cognitive Performance (the Comparator is Always the Attention Control Group), N = 620.doi:10.1371/journal.pone.0061624.t004
Non-Adherence Sensitivity Analyses
Because of the significantly lower adherence rate in the at-home training group, the linear mixed model analyses were repeated after restricting the sample to those who completed at least one hour of training. With one exception those results were comparable to the analyses reported above. The exception involved the results for the primary outcome (UFOV). When non-adherent participants were excluded from the analyses the standardized effect sizes for visual speed of processing training were −0.278 for on-site training (p<0.05), −0.580 for on-site training with boosters at 11 months (p<0.001), and −0.524 for at-home training (p<0.001). Thus, when non-adherence was taken into consideration the observed effect sizes for the on-site with booster and at-home training groups were comparable.
In IHAMS, we addressed the five main limitations of the multi-site ACTIVE study by conducting an RCT of three methods of delivering the newest version of the visual speed of processing training that does not require ongoing supervision and which can be given to participants to use on their home PCs. IHAMS randomized 681 participants to 10 hours of on-site training, 10 hours of on-site training plus four hours of booster training at 11 months, 10 hours of self-administered at-home training, or 10 hours of on-site attention control (crossword puzzle program use). Among the 620 participants (91%) re-assessed at one-year, all three methods of delivering the visual speed of processing training had statistically significant small to medium standardized effect size (Cohen's d ) improvements (i.e., faster completion times) on the primary outcome (UFOV), with the on-site booster training group having the largest improvements. The larger improvements in the on-site with booster training group were expected, and the magnitude of these effects was consistent with those observed in previous studies using the original version of the visual speed of processing training with group (i.e., non-tailored) delivery protocols, including the ACTIVE study , –. The clinical relevance of these effects is that they translate into 3.0 to 4.1 years, depending on intervention group, of protection against normal age-related declines and/or improvements in UFOV performance.
What sets IHAMS apart from ACTIVE is that it was designed to be the first RCT to determine whether visual speed of processing training would work equally well for older and middle aged adults, and whether the training would affect other important neuropsychological outcomes. We found no significant differences in standardized effect sizes between the middle (50–64) and older (≥65) age bands. Thus, it is possible that visual speed of processing training may be used to address cognitive decline at least across those life course stages for which age-related cognitive decline has been demonstrated using the large, prospective Whitehall II cohort . Because substantial cross-sequential data exist suggesting that age-related cognitive decline actually begins as early as age 28 , , -, additional RCTs of visual speed of processing on adults at substantially earlier life course stages appear warranted.
IHAMS also breaks new ground in terms of visual speed of processing's ability to affect other important neuropsychological outcomes. We found significant effects reflected in small standardized effect size (Cohen's d ) improvements (i.e., faster completion times, more correct symbol to digit matches, or more correct words) on four of the secondary outcomes—the Trails A, Trails B, SDMT, and Stroop word tests. The clinical relevance of these effects is that they translate into 2.2 to 3.5 years of protection against age-related declines and/or years of improvement in cognitive performance on Trails A, 1.5 to 2.0 years on Trails B, 5.4 to 6.6 years on SDMT, and 2.3 to 2.7 years on Stroop Word. Moreover, while the improvements on the Stroop color and color-word, COWAT, and DVT times and errors tests were not statistically significant, they were all in the expected direction. That said, it is especially important to note here that several of these neuropsychological tests are more direct and commonly used measures of executive function than the primary outcome—UFOV. Therefore, these effects on the secondary outcomes suggest the potential for having beneficial cascading effects of as little as 10 hours of visual speed of processing training in many domains of everyday life that are highly affected by executive function.
Visual speed of processing training operates by requiring peripheral information processing (the Route 66 sign) in the presence of distractors (the rabbit crossing signs) simultaneously with performing a centrally located primary attention task (identification of the car or truck in the license plate). In addition to their effects on other aspects of everyday life , these targeted skills have repeatedly been shown to be especially important for the operation of motor vehicles and the retrospective, concurrent, and prospective reduction of accidents and collisions . Indeed, in a six-year prospective follow-up to participants in the ACTIVE study, motor vehicle collisions were reduced by 43% in person-mile analyses and by 48% in the person-time analyses for the visual speed of processing training group compared to the no-contact control group . And as previously noted, visual speed of processing training in ACTIVE has also been shown to result in significant and substantial long-lasting improvements on a number of health and quality of life outcomes -.
For several reasons, our results have important implications for clinical practice and public health. First, age-related cognitive decline is common, and processing speed has been shown to play an early and central role in the cascading process that leads to many cognitive limitations -. Second, having a PC in the home has become relatively common, and with minimal instruction at the time of a clinical or public health encounter, patients could be given the visual speed of processing training software to take home and load onto their PCs and then use it there in private and at convenient times. Third, although we observed some adherence issues in the at-home training group, this issue likely could be addressed either by (a) a brief weekly engagement reminder delivered by e-mail or telephone, both of which could be automated, and/or (b) shifting to the new web-based version of the visual processing speed training that would overcome the difficulties faced by some participants in successfully loading the software onto their home PCs. Therefore, given the substantial evidence that it improves processing speed on a number of standard neuropsychological tests that focus on executive function, visual speed of processing training would appear to be a worthy weapon for consideration in the armamentaria of both clinical and public health practitioners in their battle against the common enemy of age-related cognitive decline.
Nonetheless, further research is needed to address several questions. These are whether: (1) the addition of brief weekly engagement reminders and/or the use of the web-based platform remediates the adherence issues observed for at-home training, (2) the training is effective for younger age bands (i.e., 30–50 year olds); (3) the observed effects last (although results from ACTIVE suggest endurance up to five years); and, (4) the training results in morphologic improvements to specific neural and structural mechanisms detectable using functional magnetic resonance imaging?
Finally, IHAMS is not without limitations, three of which warrant mention here. First, its respondents were predominantly white (95%), married (72%), college educated (71%), and healthy (68% reported excellent or very good health). Therefore, replication with more diverse and socioeconomically and health disadvantaged samples is needed. We note, however, that the ACTIVE study had a large (N = 2,802), racially and ethnically diverse, and socioeconomically disadvantaged sample, and that the effects of visual speed of processing training in it were comparable across race, ethnicity, socioeconomic, and health characteristics –.
Second, IHAMS participants were generally cognitively preserved. For example, among those 65 years old or older, the mean on the UFOV at baseline in IHAMS was 386 ms (standard deviation = 182), which is noticeably faster than the mean of 485 ms (standard deviation = 250) at baseline on the same three subtests in ACTIVE. And among those 50–64 years old in IHAMS, the mean on the UFOV at baseline was even faster at 247 ms (standard deviation = 149; note that there are no age-comparable data from ACTIVE). Thus, a legitimate question is whether these statistically significant improvements on standard neuropsychological tests that target executive function are relevant. At this time we can only point to the empirical evidence shown in Table 4 that 1.6 to 6.6 years of protection against age-related declines and/or years of improvement in cognitive performance were achieved, even among the cognitively preserved IHAMS participants. Further research on more cognitively challenged individuals is needed to determine if comparable or even greater effects of visual speed of processing training can be achieved.
Third, despite a well-developed and carefully executed randomization protocol, significant differences (p<0.05) were observed when the two age bands were combined for the SDMT, Trails B, and Stroop Word outcomes (see Table 2) at baseline between one or more of the intervention groups and the attention controls. For these significant differences, as well as for other differences that did not reach statistical significance, the attention control group was generally somewhat disadvantaged (i.e., fewer correct pairs, slower times, and fewer correct words). While this is unfortunate, we found no evidence that it led to arbitrary results. Indeed, in sensitivity analyses we re-estimated the linear mixed model within median splits on the UFOV (the primary outcome) at baseline. The standardized effect sizes (Cohen's d statistics ) were statistically significant in both halves, but were larger in the slower performing half of the median split (Cohen's d = −0.341, p = 0.003; −0.671, p = 0.001; and −0.318, p = 0.004 for the on-site, on-site with boosters, and at-home training groups) than in the faster performing half (Cohen's d = −0.272, p = 0.019; −0.464, p = 0.001; and −0.375, p = 0.001, respectively).
In conclusion, we note that IHAMS successfully achieved all of its objectives and resolved the five limitations in the ACTIVE study. IHAMS demonstrated that all three modes of delivering the visual speed of processing training intervention significantly improved the primary outcome by clinically relevant amounts. Moreover, all three intervention arms also significantly improved several secondary outcomes that tap executive function (suggesting that the intervention effect was not merely “training to the test”), also by clinically relevant amounts. Finally, we observed comparable standardized effect sizes for both the middle and older age participants, underscoring the return on investment of beginning visual speed of processing training in middle age.
CONSORT Checklist for the IHAMS Study.
The Original NIH-Funded IHAMS Protocol.
Conceived and designed the experiments: FW MV-W MJ MH. Performed the experiments: FW MV-W MH MJ MD. Analyzed the data: FW MJ MV-W MH. Wrote the paper: FW MV-W MH MJ MD. Study statistician: MJ. Project Coordinator: MD.
- 1. Birren JE, Woods AM, Williams MV (1980) Behavioral slowing with age: causes, organization, and consequences of slowing. In Poon LW, editor, Aging in the 1980s: Psychological issues. Washington, DC: American Psychological Association. pp. 293–308.
- 2. Edwards JD, Wadley VG, Myers RS, Roenker DL, Cissell GM, et al. (2002) Transfer of a speed of processing intervention to near and far cognitive functions. Gerontol 48: 329–340. doi: 10.1159/000065259
- 3. Madden DJ (1992) Four to ten milliseconds per year: Age-related slowing of visual word identification. J Gerontol: Psych Sci Soc Sci 47: P59–P68. doi: 10.1093/geronj/47.2.p59
- 4. Roenker DL, Cissell GM, Ball KK, Wadley VG, Edwards JD (2003) Speed-of-processing and driving simulator training result in improved driving performance. Hum Factors 45: 218–233. doi: 10.1518/hfes.184.108.40.206241
- 5. Burdick DJ, Rosenblatt A, Samus QM, Steele C, Baker A, et al. (2005) Predictors of functional impairment in residents of assisted living facilities: The Maryland Assisted Living Study. J Gerontol: Biol Sci Med Sci 60A: 258–264. doi: 10.1093/gerona/60.2.258
- 6. Cahn-Weiner DA, Malloy PF, Boyle PA, Marran M, Salloway S (2000) Prediction of functional status from neuropsychological tests in community-dwelling elderly individuals. Clin Neuropsychol 14: 187–195. doi: 10.1076/1385-4046(200005)14:2;1-z;ft187
- 7. Hertzog C, Kramer AF, Wilson RS, Lindenberger U (2008) Enrichment effects on adult cognitive development: Can the functional capacity of older adults be preserved and enhanced? Psychol Sci Pub Interest 9: 1–65. doi: 10.1111/j.1539-6053.2009.01034.x
- 8. Salthouse TA (2012) Consequences of age-related cognitive declines. Ann Rev Psychol 63: 201–226. doi: 10.1146/annurev-psych-120710-100328
- 9. Wang H, Preston SH (2009) Forecasting United States mortality using cohort smoking histories. PNAS 106: 393–398. doi: 10.1073/pnas.0811809106
- 10. National Academy of Sciences (2006) Workshop on identifying new interventions to extend disability decline in elderly populations. Bethesda, MD: National Academies of Science. Available: http://www.nia.nih.gov/sites/default/files/meeting-report_7.pdf. Accessed 2013 Apr 9.
- 11. National Institutes of Health (2011) PA 11–123: Translational research to help older adults maintain their health and independence in the community. Washington, DC: NIH.
- 12. Institute of Medicine (2012) Living well with chronic illness: A call for public health action. Washington, DC: National Academies Press.
- 13. Salthouse TA (2010) Selective review of cognitive aging. J Int Neuropsychol Soc 16: 754–760. doi: 10.1017/s1355617710000706
- 14. Salthouse TA (2009) When does age-related cognitive decline begin? Neurobiol Aging 30: 507–514. doi: 10.1016/j.neurobiolaging.2008.09.023
- 15. Salthouse TA (2010) Influence of age on practice effects in longitudinal neurocognitive change. Neuropsychol 24: 563–572. doi: 10.1037/a0019026
- 16. Singh-Manoux A, Kivimaki M, Clymour MM, Elbaz A, Berr C, et al. (2012) Timing of onset of cognitive decline: Results from Whitehall II prospective cohort study. BMJ 343: 1–8. doi: 10.1136/bmj.d7622
- 17. Draganski B, Gaser C, Kempermann G, Kuhn HG, Winkler J, et al. (2006) Temporal and spatial dynamics of brain structure changes during extensive learning. J Neurosci 26: 6314–6317. doi: 10.1523/jneurosci.4628-05.2006
- 18. Doidge N (2007) The brain that changes itself: Stories of personal triumph from the frontiers of brain science. New York: Viking Penguin.
- 19. Edwards JD, Vance DE, Wadley VG, Cissell GM, Roenker DL, et al. (2005) Reliability and validity of Useful Field of View test scores as administered by personal computer. J Clin Exp Neuropsychol 27: 529–543. doi: 10.1080/13803390490515432
- 20. Wadley VG, Benz RL, Ball KK, Roenker DL, Edwards JD, et al. (2006) Development and evaluation of home-based speed of processing training for older adults. Arch Phys Med Rehabil 87: 757–763. doi: 10.1016/j.apmr.2006.02.027
- 21. Ball KK, Edwards JD, Ross LA (2007) The impact of speed of processing training on cognitive and everyday functions. J Gerontol B Psychol Sci Soc Sci 62B: 19–31.
- 22. Jobe JB, Smith DM, Ball KK, Tennstedt SL, Marsiske M, et al. (2001) ACTIVE: A cognitive intervention trial to promote independence in older adults. Controlled Clin Trials 22: 453–479.
- 23. Ball KK, Berch DB, Helmers KF, Jobe JB, Leveck MD, et al. (2002) Effects of cognitive training interventions with older adults: A randomized controlled trial. JAMA 288: 2271–2281. doi: 10.1001/jama.288.18.2271
- 24. Willis SL, Tennstedt SL, Marsiske M, Ball KK, Elias J, et al. (2006) Long-term effects of cognitive training on everyday functional outcomes in older adults. JAMA 296: 2805–2814. doi: 10.1001/jama.296.23.2805
- 25. Jones RN, Marsiske M, Ball K, Rebok G, Willis SL, et al.. (2012) The ACTIVE cognitive training interventions and trajectories of performance among older adults. J Health Aging. doi: 10.1177/0898264312461938.
- 26. Wolinsky FD, Mahncke HW, Kosinksi M, Unverzagt FW, Smith DM, et al. (2009) The ACTIVE cognitive training trial and predicted medical expenditures. BMC Health Serv Res 9(109): 1–9. doi: 10.1186/1472-6963-9-109
- 27. Wolinsky FD, Unverzagt FW, Smith DM, Jones R, Wright E, et al. (2006) The effects of the ACTIVE cognitive training interventions on clinically relevant declines in health-related quality of life. J Gerontol: Psychol Sci Soc Sci 61B: S281–S287. doi: 10.1093/geronb/61.5.s281
- 28. Wolinsky FD, Unverzagt FW, Smith DM, Jones R, Stoddard A, et al. (2006) The ACTIVE cognitive training trial and health-related quality of life: Protection that lasts for five years. J Gerontol: Bio Sci Med Sci 61A: 1324–1329. doi: 10.1093/gerona/61.12.1324
- 29. Wolinsky FD, Vander Weg MW, Martin R, Unverzagt FW, Ball KK, et al. (2009) The effect of speed of processing training on depressive symptoms in ACTIVE. J Gerontol: Bio Sci Med Sci 64A: 468–472. doi: 10.1093/gerona/gln044
- 30. Wolinsky FD, Mahncke HW, Vander Weg MW, Martin R, Unverzagt FW, et al. (2009) The ACTIVE cognitive training interventions and the onset of and recovery from suspected clinical depression. J Gerontol: Psychol Sci Soc Sci 64B: 577–585. doi: 10.1093/geronb/gbp061
- 31. Wolinsky FD, Mahncke HW, Vander Weg MW, Martin R, Unverzagt FW, et al. (2010) Speed of processing training improves self-rated health in older adults: Enduring effects observed in the multi-site ACTIVE study. Int Psychogeriatr 22: 470–478. doi: 10.1017/s1041610209991281
- 32. Wolinsky FD, Vander Weg MW, Martin R, Unverzagt FW, Willis SL, et al. (2010) Cognitive training improves internal locus of control among older adults. J Gerontol: Psych Sci Soc Sci 65B: 470–478. doi: 10.1093/geronb/gbp117
- 33. Wolinsky FD, Vander Weg MW, Howren MB, Jones MP, Martin R, et al. (2011) Protocol for a randomized controlled trial to improve cognitive functioning in older adults: The Iowa Healthy and Active Minds Study. BMJ Open 1(218): 1–10. doi: 10.1136/bmjopen-2011-000218
- 34. Wolinsky FD, Vander Weg MW, Howren MB, Jones MP, Martin R, et al. (2011) Interim results from a randomized controlled trial to improve visual processing speed in older adults: The Iowa Healthy and Active Minds Study. BMJ Open 1(225): 1–13. doi: 10.1136/bmjopen-2011-000225
- 35. Pfeiffer EA (1975) A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc 23: 433–441.
- 36. Reitan RM, Wolfson D (1985) The Halstead-Reitan neuropsychological test battery: Therapy and clinical interpretation. Tucson, AZ: Neuropsychological Press.
- 37. Smith A (1982) Symbol digit modality test. Los Angeles, CA: Western Psychological Services.
- 38. Golden CJ (1978) The Stroop color and word test. Chicago, IL: Stoelting Company.
- 39. Benton AL, Hamsher K, Silvan AB (1994) Multilingual aphasia examination (3rd edition) Iowa City, IA: AJA Associates.
- 40. Lewis R, Rennick PM (1979) Manual for the repeatable cognitive-perceptual-motor battery. Gross Point, MI: Axon.
- 41. Blom G (1958) Statistical estimates and transformed beta-variables. New York, NY: Wiley.
- 42. Cohen J (1992) A power primer. Psychol Bull 112: 155–159. doi: 10.1037//0033-2909.112.1.155
- 43. Hosmer DW, Lemeshow S (2000) Applied logistic regression. New York: Wiley.
- 44. Edwards JD, Wadley VG, Vance DE, Wood K, Roenker DL, et al. (2005) The impact of speed of processing training on cognitive and everyday performance. Aging Ment Health 9: 262–271. doi: 10.1080/13607860412331336788
- 45. Clay OJ, Wadley VG, Edwards JD, Roth DL, Roenker DL, et al. (2005) Cumulative meta-analysis of the relationship between useful field of view and driving performance in older adults: Current and future implications. Optom Vis Sci 82: 724–731. doi: 10.1097/01.opx.0000175009.08626.65
- 46. Ball K, Edwards JD, Ross LA, McGwin G (2011) Cognitive training decreases motor vehicle collision involvement of older drivers. J Am Geriatr Soc 58: 2107–2113. doi: 10.1111/j.1532-5415.2010.03138.x
- 47. Salthouse TA (1996) The processing-speed theory of adult age differences in cognition. Psychol Rev 103: 403–428. doi: 10.1037//0033-295x.103.3.403
- 48. Zimprich DM (2002) Can longitudinal changes in processing speed explain longitudinal changes in fluid intelligence? Psychol Aging 17: 690–695. doi: 10.1037//0882-79220.127.116.110
- 49. Wahl HW, Schmitt M, Danner D, Coppin A (2010) Is the emergence of functional ability decline in early old age related to change in speed of cognitive processing and also to change in personality? J Aging Health 22: 691–712. doi: 10.1177/0898264310372410
- 50. Salthouse TA (1994) The nature of the influence of speed on adult age-differences in cognition. Develop Psychol 30: 240–259. doi: 10.1037/0012-1618.104.22.168
- 51. Edwards JD, Ross LA, Wadley VG, Clay OJ, Crowe M, et al. (2006) The useful field of view test: Normative data for older adults. Arch Clin Neuropsychol 21: 275–286. doi: 10.1016/j.acn.2006.03.001
- 52. Tombaugh TN (2004) Trail Making Test A and B: Normative data stratified by age and education. Arch Clin Neuropsychol 19: 203–214. doi: 10.1016/s0887-6177(03)00039-8
- 53. Lezak MD, Howieson DB, Loring DW (2004) Neuropsychological assessment, 4th ed. New York: Oxford.
- 54. Vogel A, Stokholm J, Jorgensen K (2012) Performances on Symbol Digit Modalities Test, and modified Stroop test in a healthy Danish sample. Neuropsychol Cognition 28. In press.