Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reaction Time and Mortality from the Major Causes of Death: The NHANES-III Study

  • Gareth Hagger-Johnson ,

    g.hagger-johnson@ucl.ac.uk

    Affiliation Department of Epidemiology and Public Health, University College London (UCL), London, United Kingdom

  • Ian J. Deary,

    Affiliation Department of Psychology, Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, United Kingdom

  • Carolyn A. Davies,

    Affiliation Medical Research Council (MRC)/Chief Scientist Office (CSO) Social and Public Health Sciences Unit, University of Glasgow, Glasgow, United Kingdom

  • Alexander Weiss,

    Affiliation Department of Psychology, Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, United Kingdom

  • G. David Batty

    Affiliations Department of Epidemiology and Public Health, University College London (UCL), London, United Kingdom, Department of Psychology, Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, United Kingdom

Abstract

Objective

Studies examining the relation of information processing speed, as measured by reaction time, with mortality are scarce. We explored these associations in a representative sample of the US population.

Methods

Participants were 5,134 adults (2,342 men) aged 20–59 years from the Third National Health and Nutrition Examination Survey (NHANES III, 1988–94).

Results

Adjusted for age, sex, and ethnic minority status, a 1 SD slower reaction time was associated with a raised risk of mortality from all-causes (HR = 1.25, 95% CI 1.12, 1.39) and cardiovascular disease (CVD) (HR = 1.36, 95% CI 1.17, 1.58). Having 1 SD more variable reaction time was also associated with greater risk of all-cause (HR = 1.36, 95% CI 1.19, 1.55) and CVD (HR = 1.50, 95% CI 1.33, 1.70) mortality. No associations were observed for cancer mortality. The magnitude of the relationships was comparable in size to established risk factors in this dataset, such as smoking.

Interpretation

Alongside better-established risk factors, reaction time is associated with increased risk of premature death and cardiovascular disease. It is a candidate risk factor for all-cause and cause-specific mortality.

Introduction

Slower and more variable simple reaction times are associated with elevated rates of all-cause [1], [2], [3], [4] and cardiovascular disease (CVD) [2], [3], [5] mortality risk. Simple reaction time is thought to be a more basic index of neuropsychological functioning than choice reaction time. Choice reaction time involves choosing one of several response options, which is more cognitively complex. Reaction time variability represents variability across multiple trials within each participant's performance during a testing session. Such variability is also thought to be an important index of neuropsychological functioning [6]. Reliability of reaction time as a measure is increased by averaging scores over numerous trials.

As a measure of processing speed, reaction time is moderately inversely correlated with higher-level cognitive ability as assessed by psychometric tests: people with higher cognitive ability tend to have shorter, less variable reaction times [7]. Lower cognitive ability measured in childhood [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], early adulthood [20], [21], [22], [23], [24], [25], and old age [4], [5], [26] is also associated with greater risk of all-cause [4], [13], [18], [23], [25], [26], [27], [28] and cardiovascular disease [5], [24], [27], [29] mortality. In a meta-analysis comprising 16 studies of over one million participants, a 1 standard deviation increase in cognitive ability in childhood was associated with 24% lower risk of mortality [28]. Reaction time and cognitive ability may both predict mortality risk because they both measure important aspects of neuropsychological functioning or reflect the integrity of one or more bodily systems. However, reaction time is also seen to explain the IQ-mortality association [2] suggesting that it may mediate the association between more complex cognitive processes and mortality.

In most studies of mortality risk factors, cognition has been ascertained using standard, psychometric tests of intelligence which some commentators claim are not equally valid for adults from different cultural backgrounds. Compared to psychometric tests of intelligence, [30], [31] simple reaction time can be regarded as a ‘culture-reduced’ measure of cognitive ability. It also relatively quick to measure at low cost [32]. In studies to date, slower and more variable simple reaction times have been associated with all-cause and CVD mortality risk [1], [2], [3], [33].

Our aim was to examine the relation between slower and more variable simple reaction times, with cause-specific mortality, in a representative sample of the US civilian community-dwelling population.

Participants and Methods

Participants

The sampling strategy for the Third National Health and Nutrition Examination Survey (NHANES III, 1988–94) [34], [35] involved a complex, multi-stage, stratified and clustered design. The sample was representative of the community-dwelling population of the US. Participants completed a home-based interview, questionnaire and visited a mobile examination centre. The analytic sample comprised 5,134 adults (2,342 men) aged 20 to 59 with data on reaction time and who were followed for mortality for 15 years (378 deaths). Mortality status was ascertained following a probabilistic match between NHANES-III and the National Death Index, using death certificates. Mortality was specified as the underlying cause listed on each death certificate. Follow-up time was censored at death or end of follow-up, whichever came first. The July 1997 data file was used for analyses, which is available in a publically accessible database (http://www.cdc.gov/nchs/nhanes/nh3data.htm#1a).

Measures

Reaction time.

Reaction time was measured as part of the computerized Neurobehavioral Evaluation System 2 (NES2) [36], [37]. Participants were asked to depress a button immediately upon seeing a ‘0’ displayed on a screen. Mean reaction time across 50 trials was used for analysis. There was a random inter-stimulus interval ranging from 2.5 to 5 seconds. There were no practice trials.

Covariates.

Age in years, sex and ethnic minority status (Non-Hispanic white vs. Non-Hispanic black, Mexican-American or other) were recorded. Educational attainment was denoted as the highest grade or year of regular school that the participant completed (range 1 to 17). Occupational social class was based on the participant's longest-held occupation, ranked from lowest (e.g. equipment cleaners) to highest (e.g. executives, administrators, and managers). Poverty-income ratio is an index of relative poverty, where scores of 1 or below indicate being at or above relative poverty.

Health behaviors.

Participants reported the number of cigarettes smoked per day. Alcoholic drinks were defined as a 12-oz serving of beer, a 4-oz glass of wine, or an ounce of liquor; the number consumed weekly was recorded. To estimate saturated fat intake, a 24-hour dietary recall method conducted by interviewers. Participants self-reported all food and drink consumed in the previous 24 hours, which was used to estimate saturated fat consumption according to the USDA database. Respondents were asked how frequently they performed specific leisure time physical activities in the past month. We then classified participants as being physically active (moderate activity 5 or more times per week or vigorous activity 3 times per week), inactive (no moderate or vigorous activities), or insufficiently active (falling between these two categories) [38].

Cardiovascular disease risk factors.

During the clinical examination, systolic and diastolic blood pressure were measured up to six times according to a standard protocol using a mercury sphygmomanometer. Body Mass Index (BMI) was computed from weight and standing height squared, using measurements taken in the examination. For descriptive analyses, overweight was defined as BMI 25–29.99 and obesity as ≥30. Serum cholesterol was measured enzymatically; levels of C-reactive protein were ascertained using a Behring latex-enhanced CRP assay. CRP values ≥3 are considered potentially indicative of cardiovascular disease risk [39].

Statistical analysis

Having determined that the proportionality assumption had not been violated, Cox regression with years of follow-up as the timescale was performed in Mplus version 6.2. Sample weights were used to obtain corrected standard errors, allowing for the survey design which involved over-sampling of subgroups considered to have particular public health relevance (e.g. ethnic minorities and older adults). All reaction time scores were standardized to z-scores (mean = 0; standard deviation = 1) where higher scores indicate slower or more variable (i.e. disadvantage) reaction times. For descriptive analyses, means (for continuous variable) and proportions (for categorical variables) were age-adjusted. Missing data on variables other than the exposure and vital status were replaced using multiple imputation [40] of 40 datasets, corresponding to approximately 1 dataset per 1% missing data [41].

Percent attenuation

To identify variables that might explain an association between reaction time and mortality, percentage attenuation following the addition of groups of confounders and possible mediators (hereafter, covariates) was calculated using the formula 100*[(BModel 1−BModel 1+covariates)/(BModel1)] where B is the logit (not the hazard ratio). Each group of variables (educational attainment, SES, health behaviours, CVD risk factors) was evaluated separately to reduce the likelihood of over-adjustment.

Sensitivity analyses

Sensitivity analyses included comparing estimates following multiple imputation with estimates from models performed on participants with complete data, to identify possible sources of bias. We also repeated analysis after excluding participants who died within five years of neuropsychological assessment. This allowed us to evaluate the possible impact of reverse causality, that is, that participants may have worsening reaction time scores because they were already terminally ill. We also compared results in three age groups, to evaluate possible effect modification by age.

Results

In preliminary analyses (not shown), we found no evidence that the reaction time-mortality associations differed by sex or ethnic minority status (p-values for interactions all >.05). We thus pooled data for men and women.

The baseline characteristics of the study population in relation to later vital status are shown in Table 1. A total of 378 (7.4%) participants died during 14.6 years of follow-up (104 cardiovascular deaths; 84 cancer deaths). Adjusted for age, participants who died were more likely to be male, have lower socio-economic position, were physically inactive, and smoked cigarettes and drank alcohol more heavily (Table 1).

thumbnail
Table 1. Baseline characteristics of the Analytic Sample According to Vital Status after 15 years of follow-up.

https://doi.org/10.1371/journal.pone.0082959.t001

In Table 2 we depict baseline characteristics of study members according to reaction time. Taken together, shorter reaction time was associated with more favourable levels of some baseline characteristics (e.g. occupational grade and poverty/income ratio) but not others (e.g. smoking and alcohol drinking). Slower participants tended to have more variable reaction time scores, as indicated by the strong positive correlation between both measures (r = 0.64, p<0.001).

thumbnail
Table 2. Baseline characteristics of the Analytic Sample According to Mean Reaction Time.

https://doi.org/10.1371/journal.pone.0082959.t002

Results from the Cox Regression analyses for the associations between reaction time and mortality are shown in Table 3. After adjusting for age, sex and ethnic minority status, being 1 SD slower on reaction time was associated with a 25% increase in all-cause mortality risk (HR = 1.25, 95% CI 1.12, 1.39). A significant association was observed for CVD mortality (HR = 1.36, 95% CI 1.17, 1.58) but not cancer mortality for which there was no significant relation with reaction time (HR = 0.85, 95% CI 0.54, 1.34). In fully adjusted models which also adjusted for educational attainment, occupational grade, poverty/income ratio, health behaviors and CVD risk factors, the association was attenuated but remained statistically significant for all-cause mortality (HR = 1.15, 95% CI 1.02,1.29; 37% attenuation), and CVD mortality (HR = 1.22, 95% CI 1.15,1.29; 36% attenuation).

thumbnail
Table 3. Hazard Ratio (95% Confidence Intervals) for the Relation of Reaction Time Measures with Mortality.

https://doi.org/10.1371/journal.pone.0082959.t003

Having 1 SD more variable reaction time was also associated with all-cause mortality, increasing risk by 36% (HR = 1.36, 95% CI 1.19, 1.55), adjusting for age, sex and ethnic minority status. The association was somewhat stronger for CVD mortality (HR = 1.50, 95% CI 1.33, 1.70). Again, there was no significant relationship between this component of reaction time and cancer mortality (HR = 0.99, 95% CI 0.72, 1.34). In fully adjusted models, the association was attenuated but remained significant for all-cause (HR = 1.25, 95% CI 1.09, 1.44; 27% attenuation) and CVD (HR = 1.35, 95% CI 1.16, 1.58; 25% attenuation) mortality. Associations were only slightly attenuated in additional models for reaction time variability in which simple reaction time was controlled for, allowing for the fact that participants with slower reaction times tended to have more variable reaction times (Table S2). This suggests that the association between reaction time variability and mortality is not simply accounted for by the tendency of those with more variable to have slower reaction times. Reaction time mean was not significantly associated with mortality after adjustment for variability (Table S2) suggesting that reaction time variability was driving the association.

The effect sizes were generally similar when analyses were performed on a nested sample of participants with complete data (Table S1), adjusting for age, sex and ethnic minority status. One exception was all-cause mortality and reaction time mean, which was markedly stronger among complete case data (HR = 1.68, 95% CI 1.28, 2.20). The general pattern of results and conclusions drawn were largely unaffected. Repeating results after excluding participants who died within five years of cognitive assessment weakened the associations (HR for reaction time mean = 1.14, 95% CI 1.03, 1.26; HR for reaction time variability = 1.19, 95% CI 1.19, 1.07, 1.31), but had little influence the overall pattern of findings, mitigating concerns about reverse causation. Results were similar across age groups (Table 4).

thumbnail
Table 4. Hazard Ratio (95% Confidence Intervals) for the Relation of Reaction Time Measures with Mortality in Three Age Groups.

https://doi.org/10.1371/journal.pone.0082959.t004

Discussion

In a representative sample of adults, slower and more variable performance on a simple reaction time task was associated with increased rates of both all-cause and cardiovascular disease mortality over a follow-up period of approximately 15 years. The association between reaction time variability and mortality remained after adjustment for reaction time mean, and was therefore not accounted for by the tendency for people with more variable reaction times to have slower responses. No association was observed for cancer mortality, although fewer deaths were available for this outcome. Socio-economic status, health behaviors and established CVD risk factors partly but not fully explained these associations.

The strengths of the study include the range of covariates considered, some of which occur between reaction time and survival. For this reason, we calculated their contribution to the attenuation of the association separately to avoid over-adjustment. No variables attenuated the associations fully, suggesting that the association between simple reaction time and mortality is independent of socio-demographic, socio-economic, health behaviors and CVD risk factors. The pattern of results was similar to those found in the Health and Lifestyle Survey (HALS) [4], [5], the Twenty-07 Study [2], and also to the Baltimore Longitudinal Study of Aging [1]. For example, in the Twenty-07 study, reaction time mean and variability both predicted mortality, consistent with our findings [2]. These studies also considered choice reaction time. Simple reaction time scores were averaged over 50 trials and thus the reliability of scores in this study are greater than those of the other studies which averaged over 20 trials.

To our knowledge, this is the first study to estimate the association between simple reaction time (mean and variability) and mortality in a representative sample of the US community-dwelling population. Our study replicates findings in the UK population [2], [3]. The associations we found for simple reaction time converge with those found in other studies. Data were not available on choice reaction time, but it is likely that simple reaction time mean and variability are less susceptible to confounding than choice reaction time. Choice reaction time involves choosing between stimuli and responding with several response options. This involves more complex cognitive processes and decision-making than simple reaction time. Study limitations include the lack of statistical power available to consider other specific causes of death, particularly cancer. Since cancer is not a single disease entity, site-specific cancers may have different associations with reaction time [42]. Analysis of site-specific cancer risk was not possible given the relatively small number of cancer deaths. Reaction time was only measured once at baseline, and so we were not able to adjust for changes in the exposure over follow-up or consider time-varying confounders. Reaction time scores are stable in the short [32] to medium term [43], but show age-related decline [44]. Although we proposed several variables as possible mediators and evaluated by how much they attenuated associations between reaction time and mortality, mediation is not straightforwardly assessed in cross-sectional data [45] and so longitudinal repeated measures of these covariates would be informative. Another limitation is that age-related cognitive decline may have occurred prior to baseline, particularly for older adults in the sample [46]. In descriptive analyses, the often weak and inconsistent relation between reaction time and covariates is likely to account for why these variables explained relatively little of the association with mortality. There may be further explanatory variables or effect modifiers that were not included in our models [43]. However, the fact that results were very similar when re-run on participants with complete data provides support for the view that results were not influenced by missing data patterns. The two exceptions in complete case analysis, a stronger association between reaction time mean in relation to all-cause mortality and between reaction time variability in relation to cancer mortality, could have been biased by non-ignorable missing data patterns. The fact that the sample were relatively young is both a strength and a limitation – reaction time could be measured before the onset of disease and death, but relatively few deaths occurred over follow-up because the sample were young. Finally, there are likely several confounding factors that were not considered in our analysis. Residual confounding could have introduced bias.

Mechanisms underlying the association between slower and more variable reaction times and mortality risk are not known. One hypothesis concerns ‘system integrity’, which suggests that since bodily systems deteriorate with age, slower and more variable reaction times reflect a central nervous system that is deteriorating in parallel with other bodily systems [2], [47]. Given the correlated heterogeneity in the aging of these systems, slower and more variable reaction times in adulthood might indicate poor physiological functioning across several bodily systems, any of which might increase risk of death in turn [48]. Simple reaction time, being less proximal to cognitive abilities than choice reaction time, might be an indicator of system integrity. It is likely however, to be one of several possible markers, and depends on whether simple reaction time actually measures functioning in one, or several systems. This question can be addressed if researchers consider if, how and why reaction time reflects functioning in other systems both cross-sectionally and longitudinally.

Our results demonstrate that slower and more variable reaction times are predictors of mortality risk in a representative population sample. Priorities for future research should include identifying the mechanisms underlying these associations. Since reaction time can be measured at low cost relatively quickly [32], it should be measured routinely in epidemiological studies.

Supporting Information

Table S1.

Comparison of Hazard Ratios (95% Confidence Intervals) in the Main Analysis (Multiple Imputation) with Complete Cases.

https://doi.org/10.1371/journal.pone.0082959.s001

(DOCX)

Table S2.

Hazard Ratios (95% Confidence Intervals) for Reaction Time Mean and Variability Mutually Adjusted.

https://doi.org/10.1371/journal.pone.0082959.s002

(DOCX)

Acknowledgments

Dr. Batty was a Wellcome Trust Career Development Fellow during the preparation of this manuscript.

Author Contributions

Conceived and designed the experiments: GH. Performed the experiments: GH. Analyzed the data: GH GB. Wrote the paper: GH ID CD AW GB.

References

  1. 1. Metter EJ, Schrager M, Ferrucci L, Talbot LA (2005) Evaluation of movement speed and reaction time as predictors of all-cause mortality in men. Journals of Gerontology Series A 60: 840–846.
  2. 2. Deary IJ, Der G (2005) Reaction time explains IQ's association with death. Psychological Science 16: 64–69.
  3. 3. Roberts BA, Der G, Deary IJ, Batty GD (2009) Reaction time and established risk factors for total and cardiovascular disease mortality: Comparison of effect estimates in the follow-up of a large, UK-wide, general-population based survey. Intelligence 37: 561–566.
  4. 4. Shipley BA, Der G, Taylor MD, Deary IJ (2006) Cognition and all-cause mortality across the entire adult age range: Health and lifestyle survey. Psychosomatic Medicine 68: 17–24.
  5. 5. Shipley BA, Der G, Taylor MD, Deary IJ (2008) Cognition and mortality from the major causes of death: the Health and Lifestyle Survey. Journal of Psychosomatic Research 65: 143–152.
  6. 6. Hendrickson A (1982) The biological basis of intelligence. Part I: Theory. . In: Eysenck H, editor. A mjodel for intelligence. Berlin: Springer-Verlag. pp. 151–196.
  7. 7. Johnson W, Deary I (2011) Placing inspection time, reaction time, and perceptual speed in the broader context of cognitive ability: The VPR model in the Lothian Birth Cohort 1936. Intelligence 39: 405–417.
  8. 8. Batty GD, Deary IJ, Gottfredson LS (2007) Premorbid (early life) IQ and later mortality risk: Systematic review. Annals of Epidemiology 17: 278–288.
  9. 9. Batty GD, Deary IJ, Macintyre S (2007) Childhood IQ in relation to risk factors for premature mortality in middle-aged persons: the Aberdeen Children of the 1950s study. Journal of Epidemiology and Community Health 61: 241–247.
  10. 10. Batty GD, Deary IJ, Schoon I, Gale CR (2007) Mental ability across childhood in relation to risk factors for premature mortality in adult life: the 1970 British Cohort Study. Journal of Epidemiology and Community Health 61: 997–1003.
  11. 11. Corley J, Crang JA, Deary IJ (2009) Childhood IQ and in-service mortality in Scottish Army personnel during World War II. Intelligence 37: 238–242.
  12. 12. Hart CL, Taylor MD, Smith GD, Whalley LJ, Starr JM, et al. (2003) Childhood IQ, social class, deprivation, and their relationships with mortality and morbidity risk in later life: Prospective observational study linking the Scottish Mental Survey 1932 and the Midspan studies. Psychosomatic Medicine 65: 877–883.
  13. 13. Hart CL, Taylor MD, Smith GD, Whalley LJ, Starr JM, et al. (2005) Childhood IQ and all-cause mortality before and after age 65: Prospective observational study linking the Scottish Mental Survey 1932 and the Midspan studies. British Journal of Health Psychology 10: 153–165.
  14. 14. Jokela M, Batty GD, Deary IJ, Gale CR, Kivimaki M (2009) Low childhood IQ and early adult mortality: The role of explanatory factors in the 1958 British Birth cohort. Pediatrics 124: E380–E388.
  15. 15. Lager A, Bremberg S, Vagero D (2009) The association of early IQ and education with mortality: 65 year longitudinal study in Malmo, Sweden. British Medical Journal 339.
  16. 16. Leon DA, Lawlor DA, Clark H, Batty GD, Macintyre S (2009) The association of childhood intelligence with mortality risk from adolescence to middle age: Findings from the Aberdeen Children of the 1950s cohort study. Intelligence 37: 520–528.
  17. 17. Pearce MS, Deary IJ, Young AH, Parker L (2006) Childhood IQ and deaths up to middle age: The Newcastle Thousand Families Study. Public Health 120: 1020–1026.
  18. 18. Starr JM, Deary IJ, Whalley LJ (2008) All-cause mortality in the Aberdeen 1921 birth cohort: Effects of socio-demographic, physical and cognitive factors. BMC Public Health 8.
  19. 19. Batty G, Deary I, Gottfredson L (2007) Premorbid (early life) IQ and later mortality risk: Systematic review. Annals of Epidemiology 17: 278–288.
  20. 20. Batty GD, Deary IJ, Tengstrom A, Rasmussen F (2008) IQ in early adulthood and later risk of death by homicide: cohort study of 1 million men. British Journal of Psychiatry 193: 461–465.
  21. 21. Batty GD, Gale CR, Tynelius P, Deary IJ, Rasmussen F (2009) IQ in early adulthood, socioeconomic position, and unintentional injury mortality by middle age: a cohort study of more than 1 million Swedish men. American Journal of Epidemiology 169: 606–615.
  22. 22. Batty GD, Mortensen LH, Gale CR, Shipley MJ, Roberts BA, et al. (2009) IQ in late adolescence/early adulthood, risk factors in middle age, and later cancer mortality in men: the Vietnam Experience Study. Psycho-Oncology 18: 1122–1126.
  23. 23. Batty GD, Shipley MJ, Mortensen LH, Boyle SH, Barefoot J, et al. (2008) IQ in late adolescence/early adulthood, risk factors in middle age and later all-cause mortality in men: the Vietnam Experience Study. Journal of Epidemiology and Community Health 62: 522–531.
  24. 24. Batty GD, Shipley MJ, Mortensen LH, Gale CR, Deary IJ (2008) IQ in late adolescence/early adulthood, risk factors in middle-age and later coronary heart disease mortality in men: the Vietnam Experience Study. European Journal of Cardiovascular Prevention & Rehabilitation 15: 359–361.
  25. 25. Batty GD, Wennerstad KM, Smith GD, Gunnell D, Deary IJ, et al. (2009) IQ in early adulthood and mortality by middle age cohort study of 1 million Swedish men. Epidemiology 20: 100–109.
  26. 26. Batterham PJ, Christensen H, Mackinnon AJ (2009) Fluid intelligence is independently associated with all-cause mortality over 17 years in an elderly community sample: An investigation of potential mechanisms. Intelligence 37: 551–560.
  27. 27. Batty GD, Shipley MJ, Dundas R, Macintyre S, Der G, et al. (2009) Does IQ explain socio-economic differentials in total and cardiovascular disease mortality? Comparison with the explanatory power of traditional cardiovascular disease risk factors in the Vietnam Experience Study. European Heart Journal 30: 1903–1909.
  28. 28. Calvin CM, Deary IJ, Fenton C, Roberts BA, Der G, et al. (2011) Intelligence in youth and all-cause-mortality: systematic review with meta-analysis. International Journal of Epidemiology 40: 626–644.
  29. 29. Batty GD, Shipley MJ, Gale CR, Mortensen LH, Deary IJ (2008) Does IQ predict total and cardiovascular disease mortality as strongly as other risk factors? Comparison of effect estimates using the Vietnam Experience Study. Heart 94: 1541–1544.
  30. 30. Walker AJ, Batchelor J, Shores A (2009) Effects of education and cultural background on performance on WAIS-III, WMS-III, WAIS-R and WMS-R measures: Systematic review. Australian Psychologist 44: 216–223.
  31. 31. Suzuki L, Aronson J (2005) The cultural malleability of intelligence and its impact on the racial/ethnic hierarchy. pp. 320–327.
  32. 32. Deary I, Liewald D, Nissan J (2011) A free, easy-to-use, computer-based simple and four-choice reaction time programme: the Deary-Liewald reaction time task. Behavior Research Methods 43: 258–268.
  33. 33. Deary IJ, Der G, Ford G (2001) Reaction times and intelligence differences - A population-based cohort study. Intelligence 29: 389–399.
  34. 34. U.S. Department of Health and Human Services (DHHS) (1996) National Center for Health Statistics. Third National Health and Nutrition Examination Survey, 1988–1994, NHANES III Laboratory Data File (CD-ROM). Public Use Data File Documentation Number 76200. Springfield, VA: Centers for Disease Control and Prevention.
  35. 35. U.S. Department of Health and Human Services (DHHS) (1996) The Third National Health and Nutrition Examination Survey (NHANES III, 1988–94) Reference Manuals and Reports. Hyattsville, MD: Centers for Disease Control and Prevention.
  36. 36. Letz R (1990) The Neurobehavioral Evaluation System 2 User's Manual. Winchester, MA: Neurobehavioral Systems Inc.
  37. 37. Baker EL, Letz RE, Fidler AT, Shalat S, Plantamura D, et al. (1985) A computer-based neurobehavioral evaluation system for occupational and environmental epidemiology: rationale, methodology and pilot study results. Journal of Occupational Medicine 27: 206–212.
  38. 38. Pate RR, Pratt M, Blair SN, Haskell WL, Macera CA, et al. (1995) Physical activity and public health. JAMA 273: 402–407.
  39. 39. Pearson T, Mensah G, Alexander W, Anderson J, Cannon R, et al. (2003) Markers of Inflammation and Cardiovascular Disease. Circulation 107: 499–511.
  40. 40. Enders CK (2010) Applied missing data analysis. New York: Guildford Press.
  41. 41. White I, Royston P, Wood A (2011) Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine 30: 377–399.
  42. 42. Batty G, Modig Wennerstad K, Davey Smith G, Gunnell D, Deary I, et al. (2007) IQ in early adulthood and later cancer risk: cohort study of one million Swedish men. Annals of Oncology 18: 21–28.
  43. 43. Hagger-Johnson G, Shickle D, Roberts B, Deary I (2012) Neuroticism combined with slower and more variable reaction time: synergistic risk factors for 7-year cognitive decline in females. Journals of Gerontology Series B
  44. 44. Der G, Deary I (2006) Age and sex differences in reaction time in adulthood: results from the United Kingdom Health and Lifestyle Survey. Psychology and aging 21: 62–73.
  45. 45. Maxwell S, Cole D (2007) Bias in cross-sectional analyses of longitudinal mediation. Psychological methods 12: 23–44.
  46. 46. Singh-Manoux A, Kivimaki M, Glymour MM, Elbaz A, Berr C, et al. (2012) Timing of onset of cognitive decline: results from Whitehall II prospective cohort study. BMJ 344.
  47. 47. Deary I, Johnson W, Starr J (2010) Are processing speed tasks biomarkers of cognitive aging? Psychology and aging 25: 219–228.
  48. 48. Deary I (2012) Looking for System Integrity in Cognitive Epidemiology. Gerontology