Early identification of Alzheimer’s disease (AD) is needed both for clinical trials and in clinical practice. In this study, we compared brief cognitive tests and cerebrospinal fluid (CSF) biomarkers in predicting conversion from mild cognitive impairment (MCI) to AD.
At a memory clinic, 133 patients with MCI were followed until development of dementia or until they had been stable over a mean period of 5.9 years (range 3.2–8.8 years). The Mini-Mental State Examination (MMSE), the clock drawing test, total tau, tau phosphorylated at Thr181 (P-tau) and amyloid-β1–42 (Aβ42) were assessed at baseline.
During clinical follow-up, 47% remained cognitively stable and 53% developed dementia, with an incidence of 13.8%/year. In the group that developed dementia the prevalence of AD was 73.2%, vascular dementia 14.1%, dementia with Lewy bodies (DLB) 5.6%, progressive supranuclear palsy (PSP) 4.2%, semantic dementia 1.4% and dementia due to brain tumour 1.4%. When predicting subsequent development of AD among patients with MCI, the cognitive tests classified 81% of the cases correctly (AUC, 0.85; 95% CI, 0.77–0.90) and CSF biomarkers 83% (AUC, 0.89; 95% CI, 0.82–0.94). The combination of cognitive tests and CSF (AUC, 0.93; 95% CI 0.87 to 0.96) was significantly better than the cognitive tests (p = 0.01) and the CSF biomarkers (p = 0.04) alone when predicting AD.
The MMSE and the clock drawing test were as accurate as CSF biomarkers in predicting future development of AD in patients with MCI. Combining both instruments provided significantly greater accuracy than cognitive tests or CSF biomarkers alone in predicting AD.
Citation: Palmqvist S, Hertze J, Minthon L, Wattmo C, Zetterberg H, et al. (2012) Comparison of Brief Cognitive Tests and CSF Biomarkers in Predicting Alzheimer’s Disease in Mild Cognitive Impairment: Six-Year Follow-Up Study. PLoS ONE 7(6): e38639. doi:10.1371/journal.pone.0038639
Editor: John C. S. Breitner, McGill University/Douglas Mental Health Univ. Institute, Canada
Received: January 26, 2012; Accepted: May 8, 2012; Published: June 22, 2012
Copyright: © 2012 Palmqvist et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by the Swedish Research Council (grant numbers: 14002, 523-2010-520 and 2006-6227); Swedish Brain Power; the Alzheimer’s Association (grant number NIRG-08-90356); the Regional Agreement on Medical Training and Clinical Research (ALF) between Skåne County Council and Lund University; the Royal Swedish Academy of Sciences and the Torsten and Ragnar Söderberg Foundation; Stiftelsen för Gamla Tjänarinnor; The Swedish Society of Medicine; Skåne County Council’s Research and Development Foundation and the Trolle-Wachtmeister Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have read the journal’s policy and have the following conflicts: KB has served at Advisory Boards for Innogenetics, Belgium. This does not alter the authors' adherence to all the PLoS ONE policies on sharing data and materials. The authors have declared that no other competing interests exist.
The early identification of Alzheimer’s disease (AD) is becoming increasingly important so that the correct care and follow-up can be initiated , . Many on-going studies address disease-modifying treatments for AD, and in the future it will probably be important to identify AD patients very early in order to commence these treatments in time . AD is generally preceded by an incipient preclinical phase , which progresses to mild cognitive impairment (MCI)  and finally to dementia . MCI is not only caused by incipient dementia, but has many different causes and varying patterns of progression. To identify patients with AD at an early stage, it is therefore important to identify specifically those MCI patients who will later convert to AD.
A most successful biomarker-based method of predicting the conversion from MCI to AD has been the analysis of cerebrospinal fluid (CSF) and in particular total tau (tau), tau phosphorylated at Thr181 (P-tau) and the 42-amino-acid isoform of amyloid-β1–42 (Aβ42). These analyses have provided classification accuracies of around 80% or even more. – Unfortunately, these analyses are not available everywhere, and are unlikely to become a standard procedure because of the increasing prevalence of dementia, especially in developing countries, and the fact that the majority of patients must be evaluated in primary care.
Another way to predict AD is by administering brief cognitive tests. The most commonly used cognitive tests for dementia screening are the Mini-Mental State Examination (MMSE) and the clock drawing test . Several studies have examined their ability to predict AD, but with highly varying results ranging from zero predictive ability to values similar to those of CSF –. One way to establish their predictive ability is compare their performance with well-validated CSF biomarker. It would also be useful if the brief cognitive tests were as accurate as CSF biomarkers in predicting AD, because cognitive tests are available everywhere, can be administered quickly, are very cheap and well tolerated by patients. In addition to comparing the MMSE and clock drawing test with CSF, it would be useful to know whether they complement one another, providing additional diagnostic value, especially in clinics that use both CSF analysis and cognitive tests.
To our knowledge, no previous article has compared the clock drawing test and the MMSE with CSF biomarkers for the prediction of AD. Only two different studies have ever reported on any kind of cognitive test and CSF biomarkers in the same MCI study; a Swedish MCI study and the Alzheimer’s Disease Neuroimaging Initiative (ADNI) , –. The Swedish MCI paper did not have the aim of comparing the methods and the ADNI papers only followed the patients for about two years and did not examine brief cognitive tests suitable for primary care.
The primary aim of this study was to compare the abilities of the MMSE and the clock drawing test with CSF biomarkers to predict AD among MCI patients. Our secondary aim was to investigate the additional diagnostic value achieved by combining the cognitive tests with CSF biomarkers.
Materials and Methods
The MCI Population
This study was conducted at the Memory Clinic of Skåne University Hospital in Malmö, Sweden. The MCI cohort consisted of patients referred to the clinic between October 2000 and January 2006. Most patients were referred from primary care units, but some referrals came from other clinics at the hospital. The specific procedures of this cohort have been described in greater detail elsewhere . At the initial visit, all patients were assessed by physicians experienced in dementia disorders, and underwent thorough physical, psychiatric and neurological examinations, as well as an interview that focused on their cognitive symptoms and ADL function. The patients also underwent a computed tomography or magnetic resonance imaging of the brain, lumbar puncture, cognitive tests and routine blood analysis, including assessment of their apolipoprotein E (APOE) genotype. The MCI criteria proposed by Petersen and colleagues were applied , i.e. 1) memory complaints of the patient, but preferable also acknowledged by an informant; 2) objective memory impairment in relation to age and education, assessed by the physician; 3) a relatively preserved general cognition based on the physicians structural interview and a MMSE score of at least 24 points; 4) intact or very slightly impaired ADL; and 5) not fulfilling the DSM-IIIR criteria for dementia .
In the present study, 133 patients with MCI at baseline were included. The patients were followed over time with repeated clinical visits, until development of either a specific type of dementia or until they had been cognitively stable (stable MCI) for 5.9 years (range 3.2–8.8 years). AD was diagnosed as probable AD according to NINCDS-ADRDA , vascular dementia (VaD; either probable VaD according to NINDS-AIREN  or subcortical VaD according to Erkinjuntti and colleagues ) or dementia with Lewy bodies (DLB) according to the McKeith criteria . A consensus group of three study physicians experienced in dementia disorders (OH, JH and LM) later determined all diagnoses. The physicians were blinded to the CSF and cognitive test data collected on the initial visit.
The Regional Ethics Committee in Lund, Sweden, approved the study design and the consent. All patients gave their written informed consent. The data were analyzed anonymously.
The MMSE and the Clock Drawing Test
The maximum score of the MMSE is 30 and the test consists of the following parts: time and place orientation (10 points), word registration (3 points), attention (5 points), delayed word recall (3 points), various verbal tasks (8 points) and visuo-construction (1 point) . The attention part was administered using the serial 7s task. Spelling backwards was only used if the patient could not perform serial 7s. Apart from the total MMSE score, the combined score of orientation and delayed word recall was also used as a variable, hereafter referred to as MMSE (orientation & recall). These two parts have previously been shown to be the best MMSE predictors of future AD , , .
The clock drawing test was administered on a blank piece of paper and the patients were instructed to draw the face of a clock with all the numbers on it and set the time to 10 after 11. The test was scored according to Shulman et al. , since this scoring method has been better at predicting AD compared to other scoring methods . Five points were given for a perfect clock and 0–4 points depending on the severity of the errors.
CSF was collected at baseline in polypropylene tubes and gently mixed to avoid gradient effects. All samples were centrifuged within 30 minutes at +4°C at 2000 g for 10 min to remove cells and debris. Samples were stored in aliquots at −80°C pending biochemical analysis. The procedure used and the analysis of the CSF followed the Alzheimer’s Association Flow Chart for lumbar puncture . The Luminex xMAP technology was used to determine the levels of tau, Aβ42 and P-tau . In addition to tau, Aβ42 and P-tau, the ratio of Aβ42/tau was tested as a separate variable in the logistic regression models since it previously has shown high predictive accuracy in this cohort . Lumbar puncture was only conducted at the initial visit.
The categorical variables sex and presence of the APOE ε4 allele were analysed using the χ2 test. All non-categorical variables were compared using the Kruskal-Wallis one-way analysis of variance. If this test was significant, Mann-Whitney U test was performed. Sensitivity and specificity were calculated using the receiver operating characteristic (ROC) curve analysis. ROC curve analysis was first performed on single CSF and cognitive test variables. The cut-off which produced the highest Youden index (sensitivity + specificity –1) was chosen. The method of DeLong et al. (implemented in MedCalc) was used to compare the ROC curves of single variables and the logistic regression models .
The ability of the CSF biomarkers and cognitive tests to predict dementia and AD was also examined with logistic regression analysis using the backward likelihood ratio (LR) method. Sex and age were adjusted for in the regression models. Before entering the clock drawing data into the regression models this variable was dichotomized because of the small number of patients at the more impaired levels. The original cut-off by Shulman of <4 points was used , .
The variables were screened for multicollinearity using the Spearman correlation, because multicollinearity can cause unstable models. There were strong correlations between the MMSE and MMSE (orientation & recall) (r = 0.89; p<0.001) and between tau and Aβ42/tau (r −0.88; p<0.001). The models that included tau and MMSE (orientation & recall) produced better accuracies than the models with Aβ42/tau and the MMSE. Therefore, the latter two variables were removed to reduce collinearity. Aβ42 was entered separately both as a continuous variable and as a dichotomised variables (cut-off according to the highest Youden index, which was <208). The variable that classified most patients correctly was used.
To compare the models that included the CSF variables with the models that included the cognitive test variables, the probabilities of each model were saved as a new variable (a value between 0 and 1 for each individual). These variables were then used to plot ROC curves and to compare the areas under the curves (AUCs). The comparison of AUCs has previously been used to compare logistic regression models .
A p value of <0.05 was considered statistically significant (hereafter referred to as “significant”). The ROC analyses, including the comparisons of the AUCs, were performed with MedCalc version 11.5.1 (MedCalc Software, MariaKerke, Belgium). All other analyses were performed with SPSS software, version 19.0.0 (SPSS Inc., Chicago, IL).
Of the 133 patients with MCI at baseline, 53.4% (71 patients) developed dementia and 46.6% (62 patients) remained stable during the mean follow-up period of 5.9 years (range 3.2–8.8 years). The dementia incidence was 13.8% per year and 10.1% for AD specifically. Among those who developed dementia, the prevalence of AD was 73.2% (52 patients), VaD 14.1% (10 patients), DLB 5.6% (4 patients), progressive supranuclear palsy (PSP) 4.2% (3 patients), semantic dementia 1.4% (1 patient) and dementia due to brain tumour (according to DSM-IV ) 1.4% (1 patient). The patients with VaD, DLB, PSP, semantic dementia and dementia due to brain tumour, were grouped as “MCI-other dementias”. The demographics of the different groups are shown in table 1. All CSF and cognitive test variables differed significantly between patients with MCI who subsequently developed AD (MCI-AD) and cognitively stable patients with MCI (stable MCI). Patients with MCI-other dementias had lower MMSE score, but not MMSE (orientation & recall) score, compared to stable MCI. Sex, MMSE, MMSE (orientation & recall), tau, Aβ42, P-tau and Aβ42/tau differed significantly between MCI-AD and MCI-other dementias (Table 1).
Table 1. Baseline variables.doi:10.1371/journal.pone.0038639.t001
Prediction of AD with ROC Curve Analysis
The sensitivity and specificity of each CSF and cognitive test variable are shown in Table 2. The variable with the best AUC to differentiate MCI-AD from stable MCI and MCI-other dementias was Aβ42 (AUC 0.84, 95% CI 0.77–0.90), followed by MMSE (orientation & recall) (AUC 0.82, 95% CI 0.74–0.88). The MMSE, MMSE (orientation & recall) and all CSF variables had a significantly better AUC than the clock drawing test. Otherwise there were no significant differences between the variables.
Table 2. Comparison of single variables for predicting follow-up diagnoses (ROC curve analysis).doi:10.1371/journal.pone.0038639.t002
The best combination of CSF biomarkers was the tau/Aβ42 ratio. At <1.6 the sensitivity was 74% and the specificity 92% (AUC 0.88, 95% CI 0.81–0.93). A combined MMSE (orientation & recall) score and clock drawing score of less than 15 points produced a sensitivity of 71% and a specificity of 84% (AUC 0.84, 95% CI 0.77–0.90). These two combinations did not differ significantly (p = 0.44).
Prediction of AD with Logistic Regression Analysis
When predicting AD compared with stable MCI and MCI-other dementias, the MMSE (orientation & recall), clock drawing (dichotomised at <4 points) and age classified 81% of the cases correctly (AUC 0.85, 95% CI 0.77–0.90). Aβ42, tau and age classified 83% correctly (AUC 0.89, 95% CI 0.82–0.94). No significant difference was found between the AUCs obtained using cognitive tests or CSF biomarkers (p = 0.36, Table 3). In the combined model, MMSE (orientation & recall), Aβ42 (dichotomised at <208), tau and clock drawing (dichotomised at <4 points) classified 85% of the patients correctly (AUC 0.93, 95% CI 0.87–0.96). The AUC of the combined model was significantly greater than the AUC of the CSF model (p = 0.04) and the cognitive test model (p = 0.01). Therefore, the combination of cognitive tests and CSF analysis contributed significant added diagnostic value to using CSF biomarkers or cognitive tests separately, when predicting AD (Table 3, Fig. 1).
Table 3. Comparison of cognitive tests and CSF biomarkers (logistic regression analysis).doi:10.1371/journal.pone.0038639.t003
Figure 1. AUCs for MCI-AD compared with stable MCI and MCI-other dementias.
The AUCs were derived from the logistic regression models (Table 3). The AUC from the combined model with both cognitive tests and CSF biomarkers was significantly better than that of the CSF model (p = 0.04) and the cognitive test model (p = 0.01). MMSE (O & R) = the orientation and delayed word recall parts of the MMSE.doi:10.1371/journal.pone.0038639.g001
In this study, we found that there was no significant difference between the brief cognitive tests and the CSF biomarkers in predicting progression to AD. The combination of cognitive tests and CSF biomarkers was significantly better than both CSF biomarkers and cognitive tests used separately, thus providing a small added diagnostic value in predicting AD (Table 3, Fig. 1).
The Cognitive Tests
In agreement with our results, previous studies have also found that the orientation and delayed recall parts of the MMSE are good at predicting specifically AD , , . The reason MMSE (orientation & recall) can identify specifically MCI-AD among MCI-other dementias and stable MCI is that patients with subcortical dementias tend to produce relatively high scores on these parts of the MMSE, while AD deteriorate early in orientation and memory , .
Clock drawing has generally produced low predictive accuracies, consistent with our results, which have been significant in some studies ,  but not in others , , . It is possible that the clock drawing test would have performed better if a clock copying task had been used, since clock copying compared to clock drawing can discriminate between AD and subcortical dementias such as DLB and VaD –.
The CSF Biomarkers
A meta-analysis has investigated the ability of P-tau to separate stable MCI from MCI-AD. The pooled data from six studies indicated a sensitivity of 81% and a specificity of 65% , which are slightly lower predictive accuracies compared to the present study (sensitivity 67%, specificity 86%; Table 2). There is no meta-analysis for Aβ42 and Tau that examines progression of MCI, but Bloudek et al. pooled data from 15–24 studies to compare AD with other dementias and stable MCI. They found a sensitivity and specificity to be 73% and 72%, respectively, for Aβ42, and 77% and 74%, respectively, for tau. Both results are lower compared to the present study (Table 2). The better predictive accuracies in our study might be explained by the long follow-up period, which increases the likelihood of a correct diagnosis, and by the fact that the cut-offs were optimised for the present population.
Logistic Regression Analyses
When comparing the AUCs of the CSF and cognitive tests models, no significant difference was found (p = 0.36). Thus, in this study the MMSE and the clock drawing test were about equally as good as the CSF biomarkers at identifying MCI-AD and differentiating it from MCI-other dementias and stable MCI.
When combining the cognitive tests and the CSF biomarkers, 85% of the cases were classified correctly and the AUC of 0.93 was significantly better than the cognitive test model (p = 0.01) and the CSF model (p = 0.04). Therefore, the combination of the MMSE, the clock drawing test and CSF biomarkers provided significant additional diagnostic value compared to using either method alone (Table 3; Fig. 1). Although statistically significant, it should be noted that the combined model only classified additionally 4% (5 patients) correctly compared to the cognitive tests and 2% (3 patients) compared to the CSF biomarkers.
In terms of clinical usage, CSF markers and cognitive tests should of course never be used alone to diagnose AD, but as a complement to strengthen the diagnosis. For this purpose, both instruments have been incorporated in the new clinical criteria for AD , .
Comparison of Cognitive Tests and Biomarkers in Other Studies
To the best of our knowledge, only three previous papers have examined both CSF analysis and cognitive tests to predict the follow-up diagnoses of MCI , , . In one of the papers, it was not investigated statistically if the combination provided significant added value for predicting AD . The other two papers are from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) study. In one of them, Llano et al. followed MCI patients during 12 months and found that the ADAS-cog (a 30–40 minutes long cognitive test battery) was equal to MRI of the brain and CSF analysis . In the other, Ewers et al. found that the combination of different independent variables provided no significant added value . In fact, they found that any one single variable was just as good as any combination of CSF, cognitive test and volumetric atrophy measurements. Although we had enough power in our study to detect a significant added value when combining cognitive tests and CSF biomarkers, the difference was quite small and our results corresponds well to that of Ewers et al. These findings suggest that roughly the same patients are identified regardless of the investigative method used.
An advantage of this study was the long follow-up period for patients with stable MCI (mean 5.9 years, range 3.2–8.8), which makes it the world’s second-longest follow-up study of CSF biomarkers in MCI patients . Because most MCI patients convert to dementia within three years, this follow-up should suffice to ensure reliable diagnostic results . The incidence of dementia was 13.8% and the incidence of AD was 10.1%, which is similar to that reported in other studies . Unfortunately, we lacked some demographic data such as education, family history and mood disorders, which might have been of value to adjust for in the regression analyses.
The consensus group of physicians were blinded to the cognitive test results and CSF data from the initial visit, thus avoiding circular reasoning during the later analysis of the data. However, a possible confounder when evaluating cognitive tests as predictors of AD is that such tests give a measure of cognitive impairment, which is one of the criteria later used for the diagnosis. This means that the closer the MCI patients are to dementia (or to more obvious cognitive impairment), the better the cognitive tests should be in predicting conversion. If the patients were investigated, say, two years earlier, it is likely that the prediction accuracy of the tests would be worse whereas the CSF biomarkers would probably produce the same results.
The types of dementia diagnosed among the patients with MCI who developed dementia during follow-up correspond roughly to the prevalence of different dementia disorders in the community –. The result is also consistent with post-mortem studies, which have shown that a significant subset of patients with MCI exhibit neuropathological features associated with non-AD dementias –. To develop instruments that predict AD with high specificity in a clinical population, it is therefore important to include heterogeneous MCI populations, which include other prodromal dementias than AD.
In this six-year follow-up study of MCI patients, we found that the MMSE and the clock drawing test were as accurate as the best combination of CSF biomarkers in identifying patients who will develop AD. This is the first study to compare these cognitive tests with CSF biomarkers, and it provides important information about the predictive value of brief cognitive tests, especially for those clinics in which CSF analysis is unavailable. The combination of CSF and cognitive tests showed significantly greater accuracy than CSF biomarkers or cognitive tests alone when predicting AD. The combination therefore provides a small added diagnostic value.
Conceived and designed the experiments: LM EL OH JH SP. Performed the experiments: JH EL. Analyzed the data: SP CW KB HZ OH. Contributed reagents/materials/analysis tools: KB HZ. Wrote the paper: SP OH. Revised the manuscript: JH LM KB HZ CW EL.
- 1. Leifer BP (2003) Early diagnosis of Alzheimer's disease: clinical and economic benefits. J Am Geriatr Soc 51: S281–288.
- 2. Modrego PJ (2006) Predictors of conversion to dementia of probable Alzheimer type in patients with mild cognitive impairment. Curr Alzheimer Res 3: 161–170.
- 3. Carter MD, Simms GA, Weaver DF (2010) The development of new therapeutics for Alzheimer's disease. Clin Pharmacol Ther 88: 475–486.
- 4. Sperling RA, Aisen PS, Beckett LA, Bennett DA, Craft S, et al. (2011) Toward defining the preclinical stages of Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 7: 280–292.
- 5. Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, et al. (2011) The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 7: 270–279.
- 6. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR Jr, et al. (2011) The diagnosis of dementia due to Alzheimer's disease: Recommendations from the National Institute on Aging and the Alzheimer's Association workgroup. Alzheimers Dement.
- 7. Hampel H, Burger K, Teipel SJ, Bokde AL, Zetterberg H, et al. (2008) Core candidate neurochemical and imaging biomarkers of Alzheimer's disease. Alzheimers Dement 4: 38–48.
- 8. Hansson O, Zetterberg H, Buchhave P, Londos E, Blennow K, et al. (2006) Association between CSF biomarkers and incipient Alzheimer's disease in patients with mild cognitive impairment: a follow-up study. Lancet Neurol 5: 228–234.
- 9. Mattsson N, Zetterberg H, Hansson O, Andreasen N, Parnetti L, et al. (2009) CSF biomarkers and incipient Alzheimer disease in patients with mild cognitive impairment. JAMA 302: 385–393.
- 10. Ismail Z, Rajji TK, Shulman KI (2010) Brief cognitive screening instruments: an update. Int J Geriatr Psychiatry 25: 111–120.
- 11. Buchhave P, Stomrud E, Warkentin S, Blennow K, Minthon L, et al. (2008) Cube copying test in combination with rCBF or CSF A beta 42 predicts development of Alzheimer's disease. Dement Geriatr Cogn Disord 25: 544–552.
- 12. Chen P, Ratcliff G, Belle SH, Cauley JA, DeKosky ST, et al. (2000) Cognitive tests that best discriminate between presymptomatic AD and those who remain nondemented. Neurology 55: 1847–1853.
- 13. Chen P, Ratcliff G, Belle SH, Cauley JA, DeKosky ST, et al. (2001) Patterns of cognitive decline in presymptomatic Alzheimer disease: a prospective community study. Arch Gen Psychiatry 58: 853–858.
- 14. Jungwirth S, Zehetmayer S, Bauer P, Weissgram S, Tragl KH, et al. (2009) Prediction of Alzheimer dementia with short neuropsychological instruments. J Neural Transm 116: 1513–1521.
- 15. Small BJ, Fratiglioni L, Viitanen M, Winblad B, Backman L (2000) The course of cognitive impairment in preclinical Alzheimer disease: three- and 6-year follow-up of a population-based sample. Arch Neurol 57: 839–844.
- 16. Tierney MC, Herrmann N, Geslani DM, Szalai JP (2003) Contribution of informant and patient ratings to the accuracy of the mini-mental state examination in predicting probable Alzheimer's disease. J Am Geriatr Soc 51: 813–818.
- 17. Cui Y, Liu B, Luo S, Zhen X, Fan M, et al. (2011) Identification of conversion from mild cognitive impairment to Alzheimer's disease using multivariate predictors. PLoS One 6: e21896.
- 18. Ewers M, Walsh C, Trojanowski JQ, Shaw LM, Petersen RC, et al. (2010) Prediction of conversion from mild cognitive impairment to Alzheimer's disease dementia based upon biomarkers and neuropsychological test performance. Neurobiol Aging.
- 19. Llano DA, Laforet G, Devanarayan V (2011) Derivation of a new ADAS-cog composite using tree-based multivariate analysis: prediction of conversion from mild cognitive impairment to Alzheimer disease. Alzheimer Dis Assoc Disord 25: 73–84.
- 20. Hertze J, Minthon L, Zetterberg H, Vanmechelen E, Blennow K, et al. (2010) Evaluation of CSF Biomarkers as Predictors of Alzheimer's Disease: A Clinical Follow-Up Study of 4.7 Years. J Alzheimers Dis.
- 21. Petersen RC (2004) Mild cognitive impairment as a diagnostic entity. J Intern Med 256: 183–194.
- 22. American Psychiatric Association (1987) Diagnostic and Statistical Manual of Mental Disorders, ed 3, rev. Arlington, USA: American Psychiatric Association.
- 23. McKhann G, Drachman D, Folstein M, Katzman R, Price D, et al. (1984) Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology 34: 939–944.
- 24. Roman GC, Tatemichi TK, Erkinjuntti T, Cummings JL, Masdeu JC, et al. (1993) Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop. Neurology 43: 250–260.
- 25. Erkinjuntti T, Inzitari D, Pantoni L, Wallin A, Scheltens P, et al. (2000) Research criteria for subcortical vascular dementia in clinical trials. J Neural Transm. pp. 23–30.
- 26. McKeith IG, Dickson DW, Lowe J, Emre M, O'Brien JT, et al. (2005) Diagnosis and management of dementia with Lewy bodies: third report of the DLB Consortium. Neurology 65: 1863–1872.
- 27. Folstein MF, Folstein SE, McHugh PR (1975) “Mini-mental state” J Psychiatr Res 12: 189–198. A practical method for grading the cognitive state of patients for the clinician.
- 28. Small BJ, Viitanen M, Backman L (1997) Mini-Mental State Examination item scores as predictors of Alzheimer's disease: incidence data from the Kungsholmen Project, Stockholm. J Gerontol A Biol Sci Med Sci 52: M299–304.
- 29. Shulman KI (2000) Clock-drawing: is it the ideal cognitive screening test? Int J Geriatr Psychiatry 15: 548–561.
- 30. Blennow K, Hampel H, Weiner M, Zetterberg H (2010) Cerebrospinal fluid and plasma biomarkers in Alzheimer disease. Nat Rev Neurol 6: 131–144.
- 31. Olsson A, Vanderstichele H, Andreasen N, De Meyer G, Wallin A, et al. (2005) Simultaneous measurement of beta-amyloid(1–42), total tau, and phosphorylated tau (Thr181) in cerebrospinal fluid by the xMAP technology. Clin Chem 51: 336–345.
- 32. DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44: 837–845.
- 33. Shulman KI, Gold DP, Cohen CA, Zucchero CA (1993) Clock-drawing and dementia in the community: A longitudinal study. International Journal of Geriatric Psychiatry 8: 487–496.
- 34. American Psychiatric Association (1994) Washington, DC, USA: American Psychiatric Association. (APA).
- 35. Jefferson AL, Cosentino SA, Ball SK, Bogdanoff B, Leopold N, et al. (2002) Errors produced on the mini-mental state examination and neuropsychological test performance in Alzheimer's disease, ischemic vascular dementia, and Parkinson's disease. J Neuropsychiatry Clin Neurosci 14: 311–320.
- 36. Palmqvist S, Hansson O, Minthon L, Londos E (2009) Practical suggestions on how to differentiate dementia with Lewy bodies from Alzheimer's disease with common cognitive tests. Int J Geriatr Psychiatry 24: 1405–1412.
- 37. Ehreke L, Luppa M, Konig HH, Riedel-Heller SG (2010) Is the Clock Drawing Test a screening tool for the diagnosis of mild cognitive impairment? A systematic review. Int Psychogeriatr 22: 56–63.
- 38. Zanetti M, Ballabio C, Abbate C, Cutaia C, Vergani C, et al. (2006) Mild cognitive impairment subtypes and vascular dementia in community-dwelling elderly people: a 3-year follow-up study. J Am Geriatr Soc 54: 580–586.
- 39. Griffith HR, Netson KL, Harrell LE, Zamrini EY, Brockington JC, et al. (2006) Amnestic mild cognitive impairment: diagnostic outcomes and clinical prediction over a two-year time period. J Int Neuropsychol Soc 12: 166–175.
- 40. Gnanalingham KK, Byrne EJ, Thornton A (1996) Clock-face drawing to differentiate Lewy body and Alzheimer type dementia syndromes. Lancet 347: 696–697.
- 41. Libon DJ, Malamut BL, Swenson R, Sands LP, Cloud BS (1996) Further analyses of clock drawings among demented and nondemented older subjects. Arch Clin Neuropsychol 11: 193–205.
- 42. Libon DJ, Swenson RA, Barnoski EJ, Sands LP (1993) Clock drawing as an assessment tool for dementia. Arch Clin Neuropsychol 8: 405–415.
- 43. Mitchell AJ (2009) CSF phosphorylated tau in the diagnosis and prognosis of mild cognitive impairment and Alzheimer's disease: a meta-analysis of 51 studies. J Neurol Neurosurg Psychiatry 80: 966–975.
- 44. Buchhave P, Minthon L, Zetterberg H, Wallin AK, Blennow K, et al. (2012) Cerebrospinal Fluid Levels of beta-Amyloid 1–42, but Not of Tau, Are Fully Changed Already 5 to 10 Years Before the Onset of Alzheimer Dementia. Arch Gen Psychiatry 69: 98–106.
- 45. Petersen RC (2007) Mild cognitive impairment: current research and clinical implications. Semin Neurol 27: 22–31.
- 46. Petersen RC (2011) Clinical practice. Mild cognitive impairment. N Engl J Med 364: 2227–2234.
- 47. Hodges JR, Patterson K (2007) Semantic dementia: a unique clinicopathological syndrome. Lancet Neurol 6: 1004–1014.
- 48. Nath U, Ben-Shlomo Y, Thomson RG, Morris HR, Wood NW, et al. (2001) The prevalence of progressive supranuclear palsy (Steele-Richardson-Olszewski syndrome) in the UK. Brain 124: 1438–1449.
- 49. Ott A, Breteler MM, van Harskamp F, Claus JJ, van der Cammen TJ, et al. (1995) Prevalence of Alzheimer's disease and vascular dementia: association with education. The Rotterdam study. BMJ 310: 970–973.
- 50. Zaccai J, McCracken C, Brayne C (2005) A systematic review of prevalence and incidence studies of dementia with Lewy bodies. Age Ageing 34: 561–566.
- 51. Bennett DA, Schneider JA, Bienias JL, Evans DA, Wilson RS (2005) Mild cognitive impairment is related to Alzheimer disease pathology and cerebral infarctions. Neurology 64: 834–841.
- 52. Jicha GA, Parisi JE, Dickson DW, Johnson K, Cha R, et al. (2006) Neuropathologic outcome of mild cognitive impairment following progression to clinical dementia. Arch Neurol 63: 674–681.
- 53. Schneider JA, Arvanitakis Z, Leurgans SE, Bennett DA (2009) The neuropathology of probable Alzheimer disease and mild cognitive impairment. Ann Neurol 66: 200–208.