Figures
Abstract
Background and Purpose
The aim of our study was to validate in an independent cohort the MRI-DRAGON score, an adaptation of the (CT-) DRAGON score to predict 3-month outcome in acute ischemic stroke patients undergoing MRI before intravenous thrombolysis (IV-tPA).
Methods
We reviewed consecutive (2009–2013) anterior circulation stroke patients treated within 4.5 hours by IV-tPA in the Lille stroke unit (France), where MRI is the first-line pretherapeutic work-up. We assessed the discrimination and calibration of the MRI-DRAGON score to predict poor 3-month outcome, defined as modified Rankin Score >2, using c-statistic and the Hosmer-Lemeshow test, respectively.
Results
We included 230 patients (mean ±SD age 70.4±16.0 years, median [IQR] baseline NIHSS 8 [5]–[14]; poor outcome in 78(34%) patients). The c-statistic was 0.81 (95%CI 0.75–0.87), and the Hosmer-Lemeshow test was not significant (p = 0.54).
Conclusions
The MRI-DRAGON score showed good prognostic performance in the external validation cohort. It could therefore be used to inform the patient's relatives about long-term prognosis and help to identify poor responders to IV-tPA alone, who may be candidates for additional therapeutic strategies, if they are otherwise eligible for such procedures based on the institutional criteria.
Citation: Turc G, Aguettaz P, Ponchelle-Dequatre N, Hénon H, Naggara O, Leclerc X, et al. (2014) External Validation of the MRI-DRAGON Score: Early Prediction of Stroke Outcome after Intravenous Thrombolysis. PLoS ONE 9(6): e99164. https://doi.org/10.1371/journal.pone.0099164
Editor: Mathias Gelderblom, University Hospital-Eppendorf, Germany
Received: February 24, 2014; Accepted: May 12, 2014; Published: June 4, 2014
Copyright: © 2014 Turc et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Intravenous thrombolysis (IV-tPA) is the only licensed treatment for acute ischemic stroke. However, about half of the treated patients will not achieve functional independence at 3 months, mostly due to delayed or lack of recanalization [1]–[2]. Therefore, it would be useful to quickly identify patients unlikely to respond to IV-tPA, who may be candidates for complementary treatment strategies, such as endovascular therapy. The DRAGON score (“CT-DRAGON”), which incorporates clinical and radiological parameters easily available at admission, has shown good performance to predict 3-month poor outcome after IV-tPA [3]–[4]. We have recently adapted this score for anterior circulation stroke patients undergoing MRI as the first-line diagnostic tool (MRI-DRAGON score, Table 1), and performed an internal cross-validation [5]. Our aim was to perform the first validation of this score in an independent population.
Methods
Study setting
The validation cohort consisted of consecutive patients included in the Lille University Hospital registry of strokes treated with IV-tPA between May 2009 and August 2013. Since May 2009, MRI has been the first-line pretherapeutic imaging modality in candidates for thrombolysis in this center. Inclusion criteria were: (a) anterior circulation stroke, (b) prestroke modified Rankin Scale (mRS) score ≤2, (c) MRI at baseline, (d) treatment exclusively by IV-tPA within 4.5 hours after stroke onset. Clinical variables of the MRI-DRAGON model were prospectively collected. Poor outcome was defined as 3-month mRS >2 [3], [5]. Miserable outcome was defined as 3-month mRS >4.
Imaging
Pretreatment MRI (1.5-T Philips Achieva) included diffusion-weighted imaging (DWI), FLAIR, T2* and intracranial time-of-flight MR angiography (MRA). The imaging parameters of the MRI-DRAGON score were retrospectively assessed by neuroradiologists (P.A., O.N., C.O., X.L.) blinded to clinical data. Any proximal (M1) middle cerebral artery (MCA) occlusion on admission MRA was considered, irrespective of the status of the other arteries. DWI-ASPECTS was scored on pretreatment MRI and dichotomized into >5 vs. ≤5 (primary analysis) [5]–[6]. However, because the best DWI-ASPECTS cut-off for poor outcome prediction is currently debated [5], [7], [8], we performed a sensitivity analysis using the ≤7 DWI-ASPECTS cut-off instead of ≤5.
Statistical analysis
The derivation of the MRI-DRAGON score has been described in the original publication [5]. In the present study, continuous variables with a normal distribution were described as mean ± standard deviation (SD) and non-normally distributed variables were described as median and interquartile range (IQR). Univariate and multivariate binary logistic regression analysis was performed with poor outcome (or miserable outcome in supplemental analysis) as the dependent variable. All variables of the MRI-DRAGON score were included in the multivariate model. Discrimination of the MRI-DRAGON score was assessed using c-statistic (i.e. Area Under the ROC curve) with 95% confidence interval. Calibration was assessed using the Hosmer-Lemeshow test to check for significant differences between the observed and predicted risks of poor outcome [9]. Statistical analysis was performed using SAS 9.3 (SAS institute, Cary, NC).
Ethics statement
The stroke registry of the present study was declared at the institutional data protection board (“Comité consultatif sur le traitement de l'information en matière de recherche dans le domaine de la santé”). In accordance with the French legislation, the study did not need approval by an Ethics Committee, because it implied only retrospective analysis of anonymized data collected prospectively as part of routine clinical care. The study has been performed in accordance with the ethical standards laid down in the 1964 declaration of Helsinki and its later amendments. Patients or their relatives gave a verbal informed consent (documented within the patient's medical record) for the inclusion of their data in a registry, in accordance with the French law concerning research in Human.
Results
Among 479 patients included in the registry during the study period, 230 fulfilled the inclusion criteria (Table 2); 249 patients were not eligible because of CT scanner as admission imaging (n = 65), prestroke mRS >2 (n = 49), unknown or >4.5 hours onset-to-treatment time (OTT) (n = 46), posterior circulation stroke (n = 42), additional endovascular therapy (n = 20), missing data (n = 17), incomplete MRI protocol (n = 8), or stroke mimics (n = 2). Patients not eligible because they underwent CT scan or bridging therapy, had significantly higher baseline NIHSS scores than included patients (p<0.001). When compared to the derivation cohort [5], patients in this validation cohort were significantly older, had lower admission NIHSS scores, lower rates of M1 occlusion, and better outcome (Table 2). In univariate analysis, all parameters of the MRI-DRAGON score, except OTT, were significantly associated with poor outcome (Table 3). In multivariate analysis, NIHSS score on admission and age remained significantly associated with poor outcome.
The distribution of the 3-month outcomes per increasing point of MRI-DRAGON score is shown in Figure 1. The c-statistic for poor outcome prediction was 0.81 (95%CI = 0.75–0.87). The Hosmer-Lemeshow test showed no significant difference between the observed and predicted risks of poor outcome (Chi-square = 7.0, p = 0.54). Using the ≤7 DWI-ASPECTS cut-off in sensitivity analysis led to similar results (c-statistic = 0.81, 95%CI 0.76–0.87). In supplemental analysis, the c-statistic of the MRI-DRAGON score (using the DWI-ASPECTS ≤5 cut-off) to predict miserable outcome was 0.89 (95%CI 0.84–0.95); the Hosmer-Lemeshow test was non-significant (p = 0.52).
mRS: modified Rankin Scale.
Discussion
The ability of the MRI-DRAGON score to predict poor outcome was good (c-statistic = 0.81) and similar to that reported in the derivation cohort (0.83) or in the CT-DRAGON score publications (0.79 to 0.85) [3]–[5], [10], [11]. The DRAGON score can quickly be assessed by a stroke specialist at admission, is straightforward, and cost-free. It could help to inform relatives about the patient's 3-month prognosis. In addition, by identifying poor responders to IV-tPA, the CT- or MRI-DRAGON score could be used, irrespective of the imaging screening method, to select patients for future therapeutic trials or to help clinical decision-making in patients who cannot be included in a randomized trial of bridging therapy [4]. Importantly, despite a high probability of poor outcome according to the MRI-DRAGON score, there is currently no rational to withhold IV-tPA if indicated.
While the derivation cohort was similar to the Safe Implementation of Thrombolysis (SITS) registry's data regarding age, stroke severity and outcome, patients in the validation cohort had less severe strokes, consistent with a lower occurrence of M1 occlusion [1]. We acknowledge that the validation population was potentially selected, since patients imaged by MRI had less severe strokes than those imaged by CT, and 18/20 (90%) patients who underwent additional endovascular therapy had an M1 occlusion. However, despite differences in stroke severity in the derivation and validation cohort, the MRI-DRAGON score showed good prognostic performances in both settings, which could strengthen the generalizability of our results [9].
The monocenter design may raise some concerns. However, our score is an adaptation of the widely validated CT-DRAGON score, rather than a novel prognostic tool [3], [4], [10], [11]. Besides, several parameters of the MRI-DRAGON score, notably MRI-based parameters, did not reach significance in multivariate analysis in the validation cohort. Yet, M1 occlusion and DWI-ASPECTS have been shown by others to be independent predictors of outcome[12], [13] and were significantly associated with poor outcome in our univariate analysis. We may have lacked statistical power for these parameters, given the low prevalence of M1 occlusion and low DWI-ASPECTS in the validation cohort. Although our main multivariate logistic model (poor outcome prediction) is unlikely to be overfitted [14], [15], this concern remains for the supplemental analysis, given the small number of patients who experienced miserable outcome. Therefore, the c-statistic of the MRI-DRAGON score to predict miserable outcome might be overestimated in our study, and should be interpreted with caution. Finally, as we included only anterior circulation strokes, our findings cannot apply to posterior circulation stroke patients. Further data would be needed to determine if our score can be adapted for posterior circulation stroke prediction, for example using the Posterior DWI ASPECTS score [16].
In conclusion, the MRI-DRAGON score showed good prognostic performance in the external validation cohort. It could help identifying patients unlikely to respond to IV-tPA alone and may be candidates for additional therapeutic strategies, if they are otherwise eligible for such procedures based on the institutional criteria.
Author Contributions
Conceived and designed the experiments: GT. Performed the experiments: GT PA NPD HH ON XL CC CO DL. Analyzed the data: GT PA CO ON XL. Contributed reagents/materials/analysis tools: JLM DL CO. Wrote the paper: GT CO JLM.
References
- 1. Wahlgren N, Ahmed N, Dávalos A, Hacke W, Millán M, et al. (2008) Thrombolysis with alteplase 3–4.5 h after acute ischaemic stroke (SITS-ISTR): an observational study. Lancet 372: 1303–1309.
- 2. Rha JH, Saver JL (2007) The impact of recanalization on ischemic stroke outcome: a meta-analysis. Stroke 38: 967–973.
- 3. Strbian D, Meretoja A, Ahlhelm FJ, Pitkäniemi J, Lyrer P, et al. (2012) Predicting outcome of IV thrombolysis-treated ischemic stroke patients: the DRAGON score. Neurology 78: 427–432.
- 4. Strbian D, Seiffge DJ, Breuer L, Numminen H, Michel P, et al. (2013) Validation of the DRAGON score in 12 stroke centers in anterior and posterior circulation. Stroke 44: 2718–2721.
- 5. Turc G, Apoil M, Naggara O, Calvet D, Lamy C, et al. (2013) Magnetic Resonance Imaging-DRAGON score: 3-month outcome prediction after intravenous thrombolysis for anterior circulation stroke. Stroke 44: 1323–1328.
- 6. Barber PA, Hill MD, Eliasziw M, Demchuk AM, Pexman JHW, et al. (2005) Imaging of the brain in acute ischaemic stroke: comparison of computed tomography and magnetic resonance diffusion-weighted imaging. J Neurol Neurosurg Psychiatry 76: 1528–1533.
- 7. De Margerie-Mellon C, Turc G, Tisserand M, Naggara O, Calvet D, et al. (2013) Can DWI-ASPECTS Substitute for Lesion Volume in Acute Stroke? Stroke 44: 3565–3567.
- 8. Nezu T, Koga M, Kimura K, Shiokawa Y, Nakagawara J, et al. (2010) Pretreatment ASPECTS on DWI predicts 3-month outcome following rt-PA: SAMURAI rt-PA Registry. Neurology 75: 555–561.
- 9. Moons KGM, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, et al. (2012) Risk prediction models: II. External validation, model updating, and impact assessment. Heart 98: 691–698.
- 10. Giralt-Steinhauer E, Rodríguez-Campello A, Cuadrado-Godia E, Ois Á, Jiménez-Conde J, et al. (2013) External validation of the DRAGON score in an elderly Spanish population: prediction of stroke prognosis after IV thrombolysis. Cerebrovasc Dis 36: 110–114.
- 11. Ovesen C, Christensen A, Nielsen JK, Christensen H (2013) External validation of the ability of the DRAGON score to predict outcome after thrombolysis treatment. J Clin Neurosci 20: 1635–1636.
- 12. Aries MJH, Uyttenboogaart M, Koopman K, Rödiger LA, Vroomen PC, et al. (2009) Hyperdense middle cerebral artery sign and outcome after intravenous thrombolysis for acute ischemic stroke. J Neurol Sci 285: 114–117.
- 13. Tei H, Uchiyama S, Usui T, Ohara K (2011) Diffusion-weighted ASPECTS as an independent marker for predicting functional outcome. J Neurol 258: 559–565.
- 14. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR (1996) A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol 49: 1373–1379.
- 15. Vittinghoff E, McCulloch CE (2007) Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol 165: 710–718.
- 16. Tei H, Uchiyama S, Usui T, Ohara K (2010) Posterior circulation ASPECTS on diffusion-weighted MRI can be a powerful marker for predicting functional outcome. J Neurol 257: 767–773.