Figures
Abstract
Objective
To investigate the reproducibility of diffusion-weighted magnetic resonance imaging (DW-MRI) in assessing tumor response early in the course of neoadjuvant chemoradiotherapy in patients with operable esophageal cancer.
Methods
Eleven male patients (mean age 54.8 years) with newly diagnosed esophageal cancer underwent DW-MRI before and 10 days after start of chemoradiotherapy. Reproducibility of apparent diffusion coefficient (ADC) measurements by manual (freehand) and semi-automated volumetric methods was assessed.
Results
Interobserver reproducibility for the assessment of mean tumor ADC by the manual measurement method was good, with an ICC of 0.69 (95% CI, 0.36 to 0.85; P = 0.001). Interobserver reproducibility for the assessment of mean tumor ADC by the semi-automated volumetric measurement method was very good, with an ICC of 0.96 (95% CI, 0.91 to 0.98; P<0.001).
Citation: Kwee RM, Dik AK, Sosef MN, Berendsen RCM, Sassen S, Lammering G, et al. (2014) Interobserver Reproducibility of Diffusion-Weighted MRI in Monitoring Tumor Response to Neoadjuvant Therapy in Esophageal Cancer. PLoS ONE 9(4): e92211. https://doi.org/10.1371/journal.pone.0092211
Editor: Domenico Coppola, H. Lee Moffitt Cancer Center & Research Institute, United States of America
Received: October 12, 2013; Accepted: February 20, 2014; Published: April 4, 2014
Copyright: © 2014 Kwee et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: These authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Esophageal cancer is a disease with a poor prognosis and high mortality. There were an estimated 482,000 new cases and 407,000 patients died of the disease worldwide in 2008 [1]. Preoperative chemoradiotherapy has shown to improve survival compared with surgery alone [2], [3]. However, not all patients benefit from preoperative chemoradiotherapy. In the Chemoradiotherapy for Oesophageal Cancer Followed by Surgery Study trial, as much as 39% of patients had no histopathological tumor regression (tumor regression defined as <10% viable tumor cells in the resected specimen) [3]. Yet, toxicity due to chemotherapy occurs in 11%–90% and there is a risk of radiation-induced complications [3], [4]. In patients who respond insufficiently, inefficient neoadjuvant therapy should be discontinued, and surgery should not be delayed. On the other hand, patients who respond favorably may benefit from additional preoperative treatment and surgery may be delayed or even refrained from. Therefore, there is a need for a method which can differentiate responders from nonresponders early in the course of neoadjuvant treatment. Studies investigating the value of Fluorine 18 (18F) fluorodeoxyglucose positron emission tomography (18F FDG PET) in assessing response to neoadjuvant treatment show heterogeneous results [5]. Diffusion-weighted magnetic resonance imaging (DW-MRI) may be an attractive alternative to 18F FDG PET, because patients do not need to fast before the examination, no exogenous contrast material is required, and acquisition time is much shorter. Therefore, the objective of the present study was to investigate the reproducibility of DW-MRI in assessing tumor response early in the course of neoadjuvant chemoradiotherapy in patients with operable esophageal cancer. In addition, we also investigated the potential of DW-MRI in differentiating responders from nonresponders in a limited number of patients.
Materials and Methods
Patient selection
Patients with newly diagnosed esophageal cancer who were referred to our hospital, which is a regional referral center for the treatment of esophageal cancer, were eligible for inclusion. Only patients who were considered operable and who underwent preoperative chemoradiotherapy were eligible for inclusion. Neoadjuvant therapy regimen and timing are displayed in Figure 1. Patients who already started neoadjuvant therapy before inclusion and patients with standard contraindications for MRI [6] were excluded. This study was approved by the institutional review board of our hospital (Medisch Ethische Toetsingscommissie Atrium-Orbis-Zuyd). All patients gave written informed consent.
MRI protocol and image review
All MRI scans were performed on one 1.5 Tesla scanner (MAGNETOM Avanto, Siemens AG, Healthcare Sector, Erlangen, Germany). For signal reception, a total of 12 elements of an anteriorly placed body matrix coil and a posteriorly placed spine matrix coil (total imaging matrix system, Siemens AG, Healthcare Sector, Erlangen, Germany), were used. Sagittal and transverse T2-weighted images and DW images were obtained under free breathing so that the entire tumor was imaged. Scan parameters are displayed in Table 1. Total imaging time, including acquisition of scout images, was 10 minutes and 4 seconds. Patients underwent two MRI scans. The first MRI scan was performed within 2 weeks before start of neoadjuvant therapy; the second MRI scan was performed on the 10th day after initiation of neoadjuvant therapy. Time interval between the two scans varied from 12 to 21 days.
Quantitative apparent diffusion coefficient (ADC) measurements of the primary esophageal tumor, before and after initiation of neoadjuvant therapy, were performed using a manual and a semi-automated volumetric method, as described below.
For the manual method, measurements were performed on a Picture Archiving and Communications System (Sienet Magic v50 2004, Siemens, Germany). For each tumor, 2 circular regions of interest (ROIs) were manually drawn on the ADC images, which corresponded to the location of the primary tumor on the coregistered transverse T2-weighted and DW images. Subsequently, mean ADC value of the 2 ROIs (corrected for ROI size) was calculated. Figure 2 gives an example. Measurements were performed by a board-certified radiologist with 13 years of experience in cross-sectional imaging (R.F.A.V.), who was blinded to the histopathological results. To assess interobserver reproducibility, measurements were also performed by a fourth-year radiology resident (S.S.) who was blinded to the results of the first reader and to the histopathological results. For further statistical analyses, the average value of the two readers was used.
T2-weighted (A) and b1000 DW (B) images, and corresponding ADC map (C and D). An esophageal tumor can be depicted as thickening of the esophageal wall (arrow in (A) with high signal intensity on the corresponding b1000 DW image (arrow in B) and low signal intensity on the corresponding ADC map (arrow in C). An ROI was manually drawn in the tumor on the ADC map (red circular region in D) to calculate the tumor ADC value.
For the semi-automated volumetric method, measurements were performed using a dedicated open source image processing package (Fiji [7]), based on ImageJ (Rasband, National Institute of Mental Health, Bethesda, USA). The healthy esophagus does not show any high signal on DW-MRI [8]. Therefore, any high signal in the esophagus that exceeded the signal intensity of the surrounding background (lung or air) was considered positive for the presence of tumor. A visually set threshold was applied to the b1000 DW images to generate strictly black and white images, with all the white pixels representing tumor. An image filter called “Particle Analyser” then constructed groups of pixels, i.e. ROIs. Only ROIs which were located around the primary tumor were manually selected and copied to the coregistered ADC maps. ADC values of the ROIs in each slice were assessed, resulting in a volumetric measurement. Mean ADC value of the entire tumor was then calculated. Figure 3 gives an example. Measurements were performed by a fifth-year radiology resident (A.K.D.), who was blinded to the histopathological results. To assess interobserver reproducibility, measurements were also performed by a third-year radiology resident (R.M.K.) who was blinded to the results of the first reader and to the histopathological results. For further statistical analyses, the average value of the two readers was used.
An esophageal tumor can be depicted as an area of high signal intensity centrally at the b1000 DW image (arrow in A) and as an area of low signal intensity centrally at the corresponding ADC map (arrow in B). After visually selecting a threshold, the software automatically placed an ROI (area bordered by a yellow line in C) around the tumor at the b1000 DW image, which was then copied to the corresponding ADC map (D) to calculate the tumor ADC value.
Histopathological response assessment
The surgical specimens were examined by experienced pathologists and scored according to the tumor regression grade scoring system (TRG) as described by Mandard et al. [9]. TRG was quantified in five grades: TRG 1 (complete regression) showed absence of residual cancer and fibrosis extending through the different layers of the esophageal wall; TRG 2 was characterized by the presence of rare residual cancer cells scattered through the fibrosis; TRG 3 was characterized by an increase in the number of residual cancer cells, but fibrosis still predominated; TRG 4 showed residual cancer outgrowing fibrosis; and TRG 5 was characterized by absence of regressive changes [9]. TRG score was considered the reference standard for tumor response, with TRG scores 1–2 defined as responding and TRG scores 3–5 defined as nonreponding to neoadjuvant chemoradiotherapy.
Statistical analysis
Statistical analyses were performed by using Statistical Package for the Social Sciences software, version 18.0 (SPSS Inc, Chicago, IL, USA), and MedCalc software (MedCalc, Mariakerke, Belgium). The intraclass correlation coefficient (ICC) was calculated and Bland-Altman plots [10] were constructed to determine interobserver variation in assessing tumor ADC values by the manual and semi-automated volumetric method. Accordingly, agreement in ADC measurements between the manual and semi-automated volumetric method was also determined. ICC values <0.20, 0.21–0.40, 0.41–0.60, 0.61–0.80, and 0.81–1.00 were considered to indicate poor, fair, moderate, good, and very good agreement, respectively. Differences in mean pretreatment ADC and percentage change in ADC between patients with (TRG grade 1–2) and without (TRG grade 3–5) tumor response were assessed by the Mann-Whitney U test and graphically displayed by boxplots. This was done both for the manual and semi-automated volumetric ADC measurements. Correlations between mean pretreatment tumor ADC and TRG score, and correlations between percentage change in mean tumor ADC after start of neoadjuvant therapy and TRG score, were assessed by Pearson rank correlation tests. This was also done both for the manual and semi-automated volumetric measurement methods. Very weak, weak, moderate, strong, and very strong correlation were defined as Pearson ρ's of 0–0.19, 0.20–0.39, 0.40–0.59, 0.60–0.79, and 0.80–1.00, respectively. Scatter plots were constructed to graphically display the correlations. All levels of statistical significance were set at 0.05.
Results
Between February 2010 and July 2012, 105 patients with newly diagnosed esophageal cancer were referred to our hospital. Sixty of these patients were considered operable, of which 17 were prepared to participate in the present study. All 17 included patients were men, with a mean age of 54.8 years (range 40–71 years). Their characteristics are displayed in Table 2. All tumors were located in the distal third of the esophagus. There were 16 adenocarcinomas and one squamous cell carcinoma. In two adenocarcinomas some degree of signet ring cell differentiation was encountered. Initial clinical tumor stage, based on 18F FDG PET/CT and endoscopic ultrasonography findings, varied from cT1N1 to cT4aN3. Of the 17 included patients, three did not undergo the second MRI scan, because of illness during chemoradiotherapy (n = 2) and because not showing up (n = 1). Two of these patients were not operated on because of death before surgery and because 18F FDG PET/CT after neoadjuvant therapy revealed distant metastases. Two other patients were also not operated on because 18F FDG PET/CT after neoadjuvant therapy also revealed distant metastases and because liver metastases were detected at the first MRI scan, respectively. In one patient, no tumor was resected because peritoneal metastases were discovered peroperatively. Eventually, there were 11 patients who underwent two preoperative MRI scans (before and during neoadjuvant therapy) and surgical resection of the tumor.
Of the aforementioned 11 patients, 3 had a tumor which was not visible on the DW images. These 3 patients were only included in the manual measurement method, because their tumors could be seen on the coregistered T2-weighted images from which an ROI could be copied to the location of the tumor on the ADC images. Tumor ADC values obtained by manual and semi-automated volumetric measurements before and after start of chemoradiotherapy and percentage change are displayed in Table 3. Interobserver reproducibility for the assessment of mean tumor ADC by the manual measurement method was good (see Figure 4), with an ICC of 0.69 (95% CI, 0.36 to 0.85; P = 0.001). Interobserver reproducibility for the assessment of mean tumor ADC by the semi-automated volumetric measurement method was very good (see Figure 5), with an ICC of 0.96 (95% CI, 0.91 to 0.98; P<0.001). Agreement between the manual and semi-automated volumetric method for measurement of mean tumor ADC was good (see Figure 6), with an ICC of 0.73 (95% CI, 0.39 to 0.88; P<0.001). There were no significant differences in mean pretreatment ADC and ADC change between patients with and without tumor response, neither for the manual (Figure 7A and B) nor for semi-automated volumetric method (Figure 8A and B). We also did not find a correlation between mean pretreatment tumor ADC and TRG score, neither for the manual nor for the semi-automated volumetric measurement method (Figure 9A and B). We also did not find a correlation between change in mean tumor ADC between the first and second MRI scan and TRG score, neither for the manual nor for semi-automated volumetric method (Figure 10A and B). Of note, the interested reader who wishes to see all original data may contact the corresponding author.
Measurements from both the first and second MRI scan were included in this analysis. Bland-Altman plot shows the difference between measurements of two observers (R.F.A.V. and S.S.) against the average measurement, with mean absolute difference (continuous line) and 95% CI of the mean difference (dashed lines).
Measurements from both the first and second MRI scan were included in this analysis. Bland-Altman plot shows the difference between measurements of two observers (A.D.K. and R.M.K.) against the average measurement, with mean absolute difference (continuous line) and 95% CI of the mean difference (dashed lines).
Measurements from both the first and second MRI scan were included in this analysis. Bland-Altman plot shows the difference between the manual and semi-automated measurements against the average measurement, with mean absolute difference (continuous line) and 95% CI of the mean difference (dashed lines).
Discussion
As diffusion within tumors is impeded by the presence of cellular membranes and macromolecular structures, treatment with chemotherapy and radiation therapy can result in the loss of cell membrane integrity which can be detected as an increase in mean tumor ADC [11]. DW-MRI for monitoring neoadjuvant therapy has already been applied in a wide variety of cancer types and organ sites, including the liver, breast, bone, soft tissue tumors, cervical tumors, head and neck tumors, as well as rectal cancer [11]. To date, there are only few published studies investigating the clinical value of DW-MRI in evaluating esophageal cancer. An initial study by Sakurada et al. [8] in 24 patients showed that DW-MRI only has a limited role in detecting esophageal cancer and nodal staging. Another study in 123 patients with esophageal squamous cell cancer found that ADC values of primary tumors were lower as clinical T and N stages were more advanced [12]. Aoyagi et al. [13] showed that tumors with lower ADC values had more stromal collagen and higher amount of vascular endothelial growth receptor expression (a marker for tumor neoangiogenesis). A study by the same research group [14], in 80 patients with esophageal squamous cell carcinoma who were treated with chemoradiotherapy, showed that higher mean pretreatment tumor ADC values were associated with longer overall survival. However, the association between change in tumor ADC value after start of chemoradiotherapy and overall survival was not investigated [14]. Sun et al. [15] assessed tumor ADC values before and after start of radiotherapy in 12 patients with esophageal cancer. They showed that patients with a higher increase in tumor ADC value had longer overall survival [15]. However, patients from their study [15] did not receive concurrent chemotherapy and radiotherapy, which is now the standard treatment [2], [3]. In addition, in both Aoyagi et al.'s study [14] and Sun et al.'s study [15], no correlation between ADC measurements and histopathological tumor response or disease-free survival was performed. To our knowledge, our study is the first to perform serial DW-MRI in assessing tumor response to neoadjuvant chemoradiotherapy in patients with operable esophageal cancer.
The deep location of the esophagus, movement related to respiration, peristalsis and cardiac motion, and the presence of local field inhomogeneities caused by susceptibility changes at tissue interface make DW-MRI of esophageal cancer challenging. There are no established protocols for performing DW-MRI of esophageal cancer. The final scanning protocol we used was based on our experience in the use of DW-MRI in other tumors (such as rectal cancer), published literature [8], [12], and test scanning in cooperation with the medical physics department. In three patients of our study (two with initial T2 disease and one with initial T3 disease), the primary tumor could not be detected on the DW-images. This is in conformity with Sakurada et al.'s study [8], where the primary tumor could not be detected in as much as 50.6%. In their study [8], the majority of early esophageal cancers (T1 and T2 tumors) were not detected, while almost all of the T3 and T4 tumors were detected. Thus, it is likely that the low detection rate of DW-MRI is due to the relatively small size of early cancers. Imaging at higher field strength, the use of stronger and faster gradients, and the use of more sophisticated multichannel coils (which enable accelerated parallel imaging) can improve spatial resolution and may increase visibility of smaller esophageal cancers.
We showed that reproducibility of semi-automated volumetric ADC measurements was higher than that of ADC measurements based on the manual placement of ROIs on two slices. This may be expected, as the semi-automated volumetric measurement method leaves less room for variation; the only manual steps to be undertaken are selection of a threshold and selection of ROIs which are within tumor.
In addition, heterogeneity within a tumor may require analysis of the entire tumor volume to obtain reproducible results. Accordingly, a previous study in rectal cancer patients also showed that ADC values obtained from the entire tumor volume were more reproducible than ADC values obtained from an ROI on a single slice or small sample ROIs [16]. Improvements to MRI scanner hardware, as described above, can enhance the resolution of MRI images which may further improve reproducibility of tumor ADC value measurements. A voxel-based analytical method, where changes in individual voxels can be monitored [11], may also improve reproducibility and may provide more reliable results. However, such an approach is challenging, since the esophagus is not a rigid and fixed structure, making spatial registration of DW images obtained before and after start of neoadjuvant therapy difficult.
In the present study, there were 12 and 9 patients for whom pretreatment ADC values (as assessed by the manual and semi-automated volumetric method, respectively) could be correlated to histopathological tumor response. We did not find a significant difference in mean pretreatment tumor ADC between responders and nonresponders. There were 11 and 8 patients for whom change in tumor ADC (as assessed by the manual and semi-automated volumetric method, respectively) could be correlated to histopathological tumor response. As expected, average mean tumor ADC, as measured by both manual and semi-automated methods, increased after neoadjuvant therapy (see Table 3). However, we found no significant difference in change in mean tumor ADC between responders and nonresponders. Although there may truly be no difference, sample size may have been insufficient to detect a significant correlation. Yet, the scatter plots also did not show any trend in relation to TRG score.
The present study has several limitations. First, as already addressed, our study population was relatively small. Most patients who were eligible for inclusion did not want to participate in our study, because they were already facing a difficult time with frequent visits to the hospital and radiation therapy clinic ahead. Because of the low statistical power of the present study, a false-negative result (type II error) cannot be excluded. Further research is needed to confirm or refute our findings. Second, we included mainly patients with adenocarcinoma, which is the most frequent type of esophageal cancer in the Western World [17]. The use of DW-MRI in assessing tumor response to neoadjuvant therapy in patients with squamous cell carcinoma needs to be further investigated. Third, we only performed one MRI scan after start of neoadjuvant therapy. In all patients, this MRI scan was obtained at the 10th day after start of neoadjuvant therapy. This may have been too early or too late to demonstrate significant effect of neoadjuvant treatment. If scanning is performed too early or too late, there may be a decrease in tumor ADC due to either cell swelling or due to the formation of tumor fibrosis, respectively. Future studies need to perform serial DW-MRI scans after start of neoadjuvant therapy to assess whether there is an optimal time point at which change in mean tumor ADC should be assessed. Fourth, we only correlated ADC measurements to histopathological tumor response. The correlation between ADC measurements and clinical endpoints, such as disease-free and overall survival, was not investigated. However, it has been shown that histopathological tumor response after neoadjuvant therapy is strongly related to disease-free and overall survival in patients with esophageal cancer [9], [18]–[20].
In conclusion, the results of the present study show that semi-automated volumetric ADC measurements have higher reproducibility than manual ADC measurements in monitoring response to neoadjuvant chemoradiotherapy in patients with esophageal adenocarcinoma. Our results, although they should be interpreted with care because of small sample size, suggest that pretreatment tumor ADC and change in tumor ADC 10 days after start of chemoradiotherapy do not correlate to tumor response.
Author Contributions
Conceived and designed the experiments: RMK AKD MNS RCMB SS GL RC LEO RLGMB RFAV. Performed the experiments: RMK AKD SS GL RC RFAV. Analyzed the data: RMK AKD RFAV. Wrote the paper: RMK AKD. Revising the article critically for important intellectual content: MNS RCMB SS GL RC LEO RLGMB RFAV.
References
- 1. Ferlay J, Shin HR, Bray F, Forman D, Mathers C, et al. (2008) Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008. Int J Cancer 127: 2893–2917.
- 2. Sjoquist KM, Burmeister BH, Smithers BM, Zalcberg JR, Simes RJ, et al. (2011) Australasian Gastro-Intestinal Trials Group. Survival after neoadjuvant chemotherapy or chemoradiotherapy for resectable oesophageal carcinoma: an updated meta-analysis. Lancet Oncol 12: 681–692.
- 3. van Hagen P, Hulshof MC, van Lanschot JJ, Steyerberg EW, van Berge Henegouwen MI, et al. (2012) CROSS Group (2012) Preoperative chemoradiotherapy for esophageal or junctional cancer. N Engl J Med 366: 2074–2084.
- 4. Malthaner RA, Collin S, Fenlon D (2006) Preoperative chemotherapy for resectable thoracic esophageal cancer. Cochrane Database Syst Rev 3: CD001556.
- 5. Kwee RM (2010) Prediction of tumor response to neoadjuvant therapy in patients with esophageal cancer with use of 18F FDG PET: a systematic review. Radiology 254: 707–717.
- 6.
MRIsafety.com. Available: http://www.mrisafety.com. Accessed 2013 Oct 5.
- 7. Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair Mr, et al. (2012) Fiji: an open-source platform for biological-image analysis. Nat Methods 9: 676–682.
- 8. Sakurada A, Takahara T, Kwee TC, Yamashita T, Nasu S, et al. (2009) Diagnostic performance of diffusion-weighted magnetic resonance imaging in esophageal cancer. Eur Radiol 19: 1461–1469.
- 9. Mandard AM, Dalibard F, Mandard JC, Marnay J, Henry-Amar M, et al. (1994) Pathologic assessment of tumor regression after preoperative chemoradiotherapy of esophageal carcinoma. Clinicopathologic correlations. Cancer 73: 2680–2686.
- 10. Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1: 307–310.
- 11. Thoeny HC, Ross BD (2010) Predicting and monitoring cancer treatment response with diffusion-weighted MRI. J Magn Reson Imaging 32: 2–16.
- 12. Aoyagi T, Shuto K, Okazumi S, Shimada H, Nabeya Y, et al. (2010) Evaluation of the clinical staging of esophageal cancer by using diffusion-weighted imaging. Exp Ther Med 1: 847–852.
- 13. Aoyagi T, Shuto K, Okazumi S, Hayano K, Satoh A, et al. (2012) Apparent diffusion coefficient correlation with oesophageal tumour stroma and angiogenesis. Eur Radiol 22: 1172–1177.
- 14. Aoyagi T, Shuto K, Okazumi S, Shimada H, Kazama T, et al. (2011) Apparent diffusion coefficient values measured by diffusion-weighted imaging predict chemoradiotherapeutic effect for advanced esophageal cancer. Dig Surg 28: 252–257.
- 15. Sun YS, Cui Y, Tang L, Qi LP, Wang N, et al. (2011) Early evaluation of cancer response by a new functional biomarker: apparent diffusion coefficient. AJR Am J Roentgenol 197: W23–29.
- 16. Lambregts DM, Beets GL, Maas M, Curvo-Semedo L, Kessels AG, et al. (2011) Tumour ADC measurements in rectal cancer: effect of ROI methods on ADC values and interobserver variability. Eur Radiol 21: 2567–2574.
- 17. Enzinger PC, Mayer RJ (2003) Esophageal cancer. N Engl J Med 349: 2241–2252.
- 18. Ancona E, Ruol A, Santi S, Merigliano S, Sileni VC, et al. (2001) Only pathologic complete response to neoadjuvant chemotherapy improves significantly the long term survival of patients with resectable esophageal squamous cell carcinoma: final report of a randomized, controlled trial of preoperative chemotherapy versus surgery alone. Cancer 91: 2165–2174.
- 19. Donington JS, Miller DL, Allen MS, Deschamps C, Nichols FC 3rd, et al. (2003) Tumor response to induction chemoradiation: influence on survival after esophagectomy. Eur J Cardiothorac Surg 24: 631–636.
- 20. Chirieac LR, Swisher SG, Ajani JA, Komaki RR, Correa AM, et al. (2005) Posttherapy pathologic stage predicts survival in patients with esophageal carcinoma receiving preoperative chemoradiation. Cancer 103: 1347–1355.