Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Comparison of Inter Subject Variability and Reproducibility of Whole Brain Proton Spectroscopy

  • Tonny V. Veenith,

    Affiliations Department of Critical Care Medicine, University hospitals of Birmingham NHS trust, Queen Elizabeth Hospital, Edgbaston, Birmingham, United Kingdom, B15 2TH, Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Marius Mada,

    Affiliation Wolfson Brain Imaging Centre, Department of Clinical Neurosciences, University of Cambridge, Addenbrooke's Hospital, Cambridge, United Kingdom, CB2 0QQ

  • Eleanor Carter,

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Julia Grossac,

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Virginia Newcombe,

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Joanne Outtrim,

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Victoria Lupson,

    Affiliation Wolfson Brain Imaging Centre, Department of Clinical Neurosciences, University of Cambridge, Addenbrooke's Hospital, Cambridge, United Kingdom, CB2 0QQ

  • Sridhar Nallapareddy,

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Guy B. Williams,

    Affiliation Wolfson Brain Imaging Centre, Department of Clinical Neurosciences, University of Cambridge, Addenbrooke's Hospital, Cambridge, United Kingdom, CB2 0QQ

  • Sulaiman Sheriff,

    Affiliation Department of Radiology, Miller School of Medicine, University of Miami, Miami, Florida, United States of America

  • David K. Menon,

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

  • Andrew A. Maudsley,

    Affiliation Department of Radiology, Miller School of Medicine, University of Miami, Miami, Florida, United States of America

  • Jonathan P. Coles

    jpc44@wbic.cam.ac.uk

    Affiliation Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Hills Road, Cambridge, Cambridgeshire, United Kingdom, CB2 0QQ

Abstract

The aim of these studies was to provide reference data on intersubject variability and reproducibility of metabolite ratios for Choline/Creatine (Cho/Cr), N-acetyl aspartate/Choline (NAA/Cho) and N-acetyl aspartate/Creatine (NAA/Cr), and individual signal-intensity normalised metabolite concentrations of NAA, Cho and Cr. Healthy volunteers underwent imaging on two occasions using the same 3T Siemens Verio magnetic resonance scanner. At each session two identical Metabolic Imaging and Data Acquisition Software (MIDAS) sequences were obtained along with standard structural imaging. Metabolite maps were created and regions of interest applied in normalised space. The baseline data from all 32 volunteers were used to calculate the intersubject variability, while within session and between session reproducibility were calculated from all the available data. The reproducibility of measurements were used to calculate the overall and within session 95% prediction interval for zero change. The within and between session reproducibility data were lower than the values for intersubject variability, and were variable across the different brain regions. The within and between session reproducibility measurements were similar for Cho/Cr, NAA/Choline, Cho and Cr (11.8%, 11.4%, 14.3 and 10.6% vs. 11.9%, 11.4%, 13.5% and 10.5% respectively), but for NAA/Creatine and NAA between session reproducibility was lower (9.3% and 9.1% vs. 10.1% and 9.9%; p <0.05). This study provides additional reference data that can be utilised in interventional studies to quantify change within a single imaging session, or to assess the significance of change in longitudinal studies of brain injury and disease.

Introduction

Proton magnetic resonance spectroscopic imaging (1HMRS) can be used in the diagnosis, assessment of progression and prediction of outcome in a variety of neurological disorders such as brain tumours [1], traumatic brain injury [2][4], multiple sclerosis [5], [6], motor neuron disease [7], Alzheimer's dementia [8] and psychiatric disorders [9][11]. The metabolites reliably measured with proton spectroscopy (1HMRS) at medium to long echo times include N-acetyl aspartate (NAA), Creatine (Cr) and Choline (Cho) containing compounds. These provide a measure of neuronal integrity, metabolism and a marker of neuronal breakdown and turnover respectively [12][15]. While targeted imaging of regions of interest (with single voxel or two dimensional 1HMRS) allows evaluation of local neuronal loss and glial proliferation, whole brain imaging provides assessment of the global burden of neurological disease even in regions that appears structurally normal. 1HMRS has been used to non-invasively evaluate normal appearing brain in a variety of neurological disorders including multiple sclerosis and head injury [3], [6], [16]. Whole brain proton spectroscopy (WB 1HMRS) data acquired with Metabolic Imaging and Data Acquisition Software (MIDAS) [17][19] provides a fully automated pipeline for processing and interpreting WB 1HMRS data. Previous studies using MIDAS and other 1HMRS techniques have provided invaluable reference data regarding normal values within different brain regions and reproducibility of such data [20][24]. However, there are limited data comparing intersubject variability and reproducibility of WB 1HMRS measurements within the same imaging session (within session reproducibility) and those obtained during repeat imaging sessions on different days (between session reproducibility). This is of relevance for group comparisons with healthy controls, and longitudinal and interventional studies where WB 1HMRS is used as a biomarker of disease progression or response to therapy. The rational design and interpretation of such studies is hampered by lack of knowledge regarding how the variability of WB 1HMRS measurements in data obtained during the same scanning session differs when compared with similar data obtained during a different session or day. In studies where consecutive measurements are performed on each subject under resting and experimental conditions problems associated with variation between subjects due to individual differences (intersubject variability) can be limited. However, baseline MIDAS WB 1HMRS measurements may vary within an individual patient (intrasubject variability) and limit the ability to detect significant changes over time or following a therapeutic intervention. Where imaging is repeated after several days or weeks in different sessions the measurements may vary within an individual patient even in the absence of disease progression due to a combination of intrasubject and scanner variability [25]. Without knowledge of such differences it is difficult to accurately determine the clinical significance of pathophysiological changes, as they evolve following various causes of brain injury or disease.

The aim of these studies was to provide reference data on intersubject variability and reproducibility of commonly used metabolite ratios (Cho/Cr, NAA/Cho and NAA/Cr) and individual signal-intensity normalised metabolite concentrations (NAA, Cho and Cr) in a group of healthy volunteers using MIDAS. These data will inform the design of interventional studies, where repeated measurements are conducted within the same session, and longitudinal studies where assessments are repeated over time in several different imaging sessions.

Materials and Methods

Ethics statement

Ethical approval was obtained from the Cambridgeshire 2 Research Ethics Committee (reference number 97/290), and written informed consent was obtained from all volunteers in accordance with the Declaration of Helsinki.

Imaging data acquisition

Thirty two healthy volunteers without any history of neuropsychiatric disorder or substance abuse underwent imaging using a 3T Siemens Verio MRI scanner (Siemens AG, Erlangen, Germany) with 12 channel detection within the Wolfson Brain Imaging Centre (WBIC), University of Cambridge. All volunteers were right handed (fourteen males and eighteen females) with mean (range) age of 34 (25 – 50) years, and were employed by Cambridge University Hospitals NHS Trust. Twenty-two volunteers attended a second imaging session within a mean (range) of 33 (3 – 181) days. At each imaging session subjects were imaged twice with MIDAS along with standard structural imaging. Structural sequences included 3D T1-weighted magnetisation prepared rapid gradient echo (MPRAGE), fluid attenuated inversion recovery (FLAIR), gradient echo and dual spin echo (proton density/T2-weighted). Whole brain spectroscopy data were acquired using a volumetric spin echo (TR/TE 1710/70 milliseconds, flip angle of 73°, 50 phase encoding steps and a field of view of 280×280×180 mm3) covering the whole brain with an acquisition time of 26 minutes as described by Maudsley et al [17], [18], [26]. This sequence also included lipid inversion nulling and an unsuppressed water spectroscopy dataset acquired with 20° flip angle acquired in an interleaved fashion. The MIDAS and MPRAGE were acquired at an angulation of +15 to +20° to the AC-PC line to improve brain coverage and limit field inhomogenieties from the frontal and sphenoid air sinuses. The MPRAGE (TR/TE 2150/4.4 and flip angle 8°) was acquired within each imaging session with one millimetre isotropic resolution.

Spectroscopic data processing

Parametric maps were created using the automated pipeline of MIDAS and the data for NAA, Cho and Cr were individual signal-intensity normalised to institutional units (iu) based on the tissue water signal derived from the water reference dataset. Metabolite data were reconstructed using MIDAS and resulted in images composed of 64×64×32 voxels with an individual voxel volume of approximately 1 ml. Voxel data with line width greater than 12 Hz were excluded from further analysis as previously described by Maudsley et al [24]. The WB 1HMRS parametric maps were spatially normalised using a two-step approach using FSL [20], [27]. First, control T1 weighted images were coregistered to water spectroscopic images using FMRIB's Linear Image Registration Tool (FLIRT) [28][30]. This was followed by coregistration of control T1 weighted images to the MNI152 template using FMRIB's Non-linear Image Registration Tool (FNIRT) [29][31]. Combined transformation matrixes were then applied to all parametric images used in the analyses. Representative white matter, deep grey and mixed regions of interest (ROIs) from the Harvard Oxford subcortical and MNI structural probabilistic atlases available within FSL were then applied in normalised space (Fig. 1). All coregistered images were subsequently inspected to ensure that the ROIs were correctly aligned and corresponded to the regions specified. The ROI template was modified by erosion of a single voxel using FSL to improve spatial localisation and reduce the impact of coregistration, normalisation and partial volume errors. The mean values for metabolites for each ROI were calculated using in-house software written in Matlab (Mathworks, Natick, USA).

thumbnail
Figure 1. Region of interest template.

T1 weighted magnetic resonance image in MNI152 space (2mm resolution) showing frontal lobe left (L Frontal), frontal lobe right (R Frontal), anterior corpus callosum (ACC), thalamus left (L Thalamus), thalamus right (R Thalamus), occipital left (L Occipital), occipital right (R Occipital), putamen left (L Putamen) and putamen right (R Putamen). Additional regions not shown include body corpus callosum, posterior corpus callosum, dorsal mid brain, ventral mid brain and bilateral regions covering the corticospinal tract, anterior thalamic radiation, inferior longitudinal fasciculus, superior longitudinal fasciculus, pallidum, hippocampus, parietal lobe, temporal lobe, cerebral peduncle and pons.

https://doi.org/10.1371/journal.pone.0115304.g001

Analysis Strategy

Each of the 32 volunteers were invited to attend two separate imaging sessions where two MIDAS sequences were obtained. This resulted in a maximum of four independent sets of WB 1HMRS data (runs) for each subject, which could be used to assess the reproducibility of measurements. Twenty-two subjects underwent imaging in both sessions. The baseline data from all 32 volunteers were used to calculate intersubject variability. For the repeat MIDAS measurements obtained in the same subject the data were split into that obtained during the same imaging session and that obtained in two different imaging sessions to calculate within session and between session reproducibility respectively. Therefore, the available paired data from each session (run 1 & 2 and 3 & 4 respectively) were used to calculate within session reproducibility, and the available combinations of the four datasets from the different sessions were used to calculate between session reproducibility (runs 1 & 3, 1 & 4, 2 & 3, and 2 & 4). The inclusion of all potential combinations ensures that any variation in the order of the individual sequences obtained within each particular session is accounted for within the calculated average measurement of between session reproducibility and reflects clinical practice.

In order to help design any future interventional study using proton spectroscopy we need to know how much deviation in a repeat measurement we would accept as no or zero change. We used the SD of measurements obtained in this healthy volunteer study to calculate a ‘confidence interval’ for zero change of a repeat measurement in the same subject. We used the average SD for all measurements obtained in 32 volunteers in both sessions to calculate the population 95% prediction interval (PI) for zero change (using two SD values) [25], [32], [33]. These calculated thresholds are prediction intervals for assuming no changes from zero with the repeat WB 1HMRS measurement rather than confidence intervals for variability of the measurement. This estimate for the variation in repeat measurements means that we would accept a positive or negative change in a patient as being indicative of zero change as long as it were less than 2 times the standard deviation of the repeat measurement obtained in our healthy volunteer group. Although these average data are extremely useful, the calculated SD could vary within different sessions and particular ROIs within subjects. It would therefore be helpful to have a more specific measure of variability within a session (within session reproducibility), and preferably for each ROI. While this is possible, the small sample numbers (two readings obtained in each of the two sessions) means that a conventional threshold of change greater than 2SD cannot be used to assess the statistical significance of changes in this context. For a t distribution with two degrees of freedom, statistical theory suggests that an estimate of the 95% prediction interval for zero change may be provided by a threshold of 4.3 SDs. These within session measurements could therefore be used to assess the significance of the changes in WB 1HMRS parameters following a therapeutic intervention within the same imaging session. We have previously published this analysis strategy for diffusion tensor imaging and 15O positron emission tomography [25], [34].

Statistical analysis

Statistical analyses were conducted using Statview (Version 5, 1998, SAS Institute Inc., Cary, North Carolina, USA) and SPSS Statistics Version 21 (IBM Corporation, New York, United States). All data are expressed and displayed as mean and standard deviation (SD), unless otherwise stated. To compare the reproducibility of WB 1HMRS measurements the SD and coefficient of variation (CoV) (CoV  =  SD/mean) of measurements were calculated within each ROI. Data were compared using paired t-tests, factorial analysis of variance (ANOVA) and intraclass correlation (ICC) as appropriate. Using ANOVA the residual standard deviation was used to calculate the 95% prediction interval for zero change of repeat WB 1HMRS studies. All p values are quoted after Bonferroni corrections for multiple comparisons (where appropriate).

Results

Intersubject variability for whole brain proton spectroscopic imaging (WB 1HMRS)

The intersubject variability of the metabolite ratios (Cho/Cr, NAA/Cr and NAA/Cho) and concentrations (NAA, Cho and Cr) using the ROI template (Fig. 1) are displayed in Table 1 and 2 respectively. In Fig. 2 NAA, Cr and Cho signal-intensity normalised metabolite concentration parametric maps are displayed in comparison with a structural image. The intersubject variability was high with a mean (range) CoV across the ROIs for Cho/Cr of 21 (11 – 62%), NAA/Cho 17 (11 – 55%), NAA/Cr 13 (8 – 37%), NAA 12 (6 – 23%), choline of 31 (13 – 69%) and creatine 19 (7 – 61%).

thumbnail
Figure 2. Metabolite parametric maps.

T1 weighted magnetic resonance image in MNI152 space (2mm resolution) with a representative spectra from the right thalamus and N-acetyl aspartate (NAA), Creatine (Cr) and Choline (Cho) signal-intensity normalised metabolite concentration parametric maps. PPM (parts per million).

https://doi.org/10.1371/journal.pone.0115304.g002

thumbnail
Table 1. Intersubject variability of metabolite ratios for whole brain proton spectroscopy.

https://doi.org/10.1371/journal.pone.0115304.t001

thumbnail
Table 2. Intersubject variability of metabolite concentrations for whole brain proton spectroscopy.

https://doi.org/10.1371/journal.pone.0115304.t002

Within session and between session reproducibility of WB 1HMRS

The individual ROI data for within and between session reproducibility were variable across the different brain regions, but lower than the values for intersubject variability (Tables 3, 4, 5, 6). The within and between session reproducibility measurements were similar for Cho/Cr, NAA/Choline, Cho and Cr (11.8%, 11.4%, 14.3 and 10.6% vs. 11.9%, 11.4%, 13.5% and 10.5%, and p  =  0.44, 0.87, 0.08 and 0.86 respectively, paired ‘t’ tests), but for NAA/Creatine and NAA between session reproducibility was lower than within session reproducibility (9.3% and 9.1% vs. 10.1% and 9.9%, p <0.05 paired ‘t’ test with Bonferroni correction). The difference between intersubject variability, within and between session reproducibility is displayed for a selection of ROIs for the metabolite ratios and concentrations in Figs. 3 and 4 respectively.

thumbnail
Figure 3. Variability in N Acetyl Aspartate/Creatine ratio measurements.

Box and whisker plot for N Acetyl Aspartate/Creatine ratio for a selection of the regions of interest (ROI), including right (R) and left (L) corticospinal (CST), anterior thalamic radiation (ATR), thalamus, putamen, frontal lobe, hippocampus and temporal lobe. The spread of data within each ROI reflects inter subject variation, while the difference between runs 1 – 2 and 3 – 4 reflects within session reproducibility, and the change from first to second sessions reflects between session reproducibility. The central lines in each box denote median values, the lower and upper boundaries the 25th and 75th centile, the error bars the 10th and 90th centile, and the closed circles outlying data points.

https://doi.org/10.1371/journal.pone.0115304.g003

thumbnail
Figure 4. Variability in N Acetyl Aspartate concentration.

Box and whisker plot for N Acetyl Aspartate for a selection of the regions of interest (ROI), including right (R) and left (L) corticospinal (CST), anterior thalamic radiation (ATR), thalamus, putamen, frontal lobe, hippocampus and temporal lobe. The spread of data within each ROI reflects inter subject variation, while the difference between runs 1 – 2 and 3 – 4 reflects within session reproducibility, and the change from first to second sessions reflects between session reproducibility. The central lines in each box denote median values, the lower and upper boundaries the 25th and 75th centile, the error bars the 10th and 90th centile, and the closed circles outlying data points.

https://doi.org/10.1371/journal.pone.0115304.g004

thumbnail
Table 3. Within session and between session variability of metabolites for whole brain proton spectroscopy.

https://doi.org/10.1371/journal.pone.0115304.t003

thumbnail
Table 4. Within session and between session variability of metabolites for whole brain proton spectroscopy.

https://doi.org/10.1371/journal.pone.0115304.t004

thumbnail
Table 5. Within session and between session variability of metabolites for whole brain proton spectroscopy.

https://doi.org/10.1371/journal.pone.0115304.t005

thumbnail
Table 6. Within session and between session variability of metabolites for whole brain proton spectroscopy.

https://doi.org/10.1371/journal.pone.0115304.t006

The intraclass correlation coefficient (ICC) for within and between session reproducibility within brain regions of mixed cortical and deep grey, and white matter are displayed in table 7.

thumbnail
Table 7. Within session and between session intraclass correlation coefficient for metabolites.

https://doi.org/10.1371/journal.pone.0115304.t007

Calculation of 95% prediction interval for zero change

Using the four WB 1HMRS measurements obtained from both sessions we used ANOVA to determine the significance of the differences (Tables 8 and 9). These confirm that there is a significant difference between regions and subjects, and that there is a significant interaction between brain region and subject. The residual variance of the measurements that cannot be accounted for by the known independent variables is shown in Tables 8 and 9. The calculated SD values were 0.10, 1.03 and 0.28 for Cho/Cr, NAA/Cho, NAA/Cr and 1709.7, 913.2 and 1521.4 iu for NAA, Cho and Cr respectively. The overall population 95% prediction interval for zero change (based on two SD values) were therefore 0.20, 2.06 and 0.56 for Cho/Cr, NAA/Cho and NAA/Cr and 3419.4, 1826.4 and 3042.8 iu for NAA, Cho and Cr respectively. For the within session measurements the calculated SD values were 0.10, 1.11 and 0.23 for Cho/Cr, NAA/Cho, NAA/Cr and 1399.7, 1115.9 and 1292.8 iu for NAA, Cho and Cr respectively and were similar to the data obtained from all four sessions. These data can be used to calculate prediction intervals within individual ROIs. For the within session data (Table 3 & 5) an estimate of the 95% prediction intervals for zero change within individual ROIs should be based on 4.3 SD values. As an example, this results in a 95% prediction interval for zero change for NAA, Cho and Cr within a single imaging session of 3839.5, 844.5 and 2345.2 iu for the left temporal, and 3557.0, 1815.9 and 3081.0 iu for the right anterior thalamic radiation respectively. These prediction intervals can be used to assess the impact of therapeutic interventions within a single session, but also to assess the impact of treatment and disease progression over time within different imaging sessions.

thumbnail
Table 8. Analysis of variance table for metabolite ratios.

https://doi.org/10.1371/journal.pone.0115304.t008

thumbnail
Table 9. Analysis of variance table for metabolite ratios.

https://doi.org/10.1371/journal.pone.0115304.t009

Discussion

This study provides additional reference data concerning intersubject variability and reproducibility of metabolite ratios and individual signal-intensity normalised metabolite concentrations obtained using WB 1HMRS conducted within the same imaging session (within session) and different imaging sessions (between session) in a group of healthy volunteers. As reported previously, we found that intersubject variability was high [21]. The reproducibility of metabolite ratios and concentrations were lower than intersubject variability (10 – 15% vs. 15 – 30%) but there was substantial variability across the brain for all the calculated parameters. The within and between session reproducibility measurements were similar for Cho/Cr, NAA/Cho, Cho and Cr but for NAA/Creatine and NAA between session reproducibility was lower than within session reproducibility. The calculated overall population 95% prediction intervals for zero change of repeat MIDAS measurements were 0.20, 2.06 and 0.56 for metabolite ratios (Cho/Cr, NAA/Cho and NAA/Cr) and 3419.4, 1826.4 and 3042.8 iu for metabolite concentrations (NAA, Cho and Cr) respectively. These prediction intervals can be calculated for individual ROIs and utilised in interventional studies where response to therapy can be assessed, or to assess the significance of change from disease progression within longitudinal studies of nervous system disorders.

The factors affecting the reproducibility of WB 1HMRS parameters include changes within the MR scanner or individual subjects. Features related to the scanner include B0 field inhomogeneities (heating during the long acquisition process), scanner drift, gradient coil stability, signal to noise ratio and software upgrades. Such factors may be more significant when imaging is acquired within different imaging sessions, rather than repeat acquisitions within the same session where such parameters are more likely to be similar. Regular servicing and daily quality assurance measurements seek to ensure that an MR scanner is operating normally. It is obviously necessary to monitor such changes, and where possible, take steps to limit their impact on the spectroscopic data obtained. Importantly, there were no upgrades or changes in MR scanner hardware or software during the period of this study. While scanner variability is important there are individual subject factors that can induce substantial variability in WB 1HMRS. These include head movements and positioning within the scanner field of view. In particular, data acquisition within the volume of interest is sensitive to inhomogeneities that can result from proximity to the sphenoid and frontal sinuses. We undertook standard procedures to limit such variability. All subjects were positioned within the head coil according to standard operating procedures within our institution and the alignment confirmed prior to commencing imaging. Following standard imaging for localisation we monitored subject movement, and all data were checked during processing for movement artefact. No data sets were excluded in these analyses due to subject motion during the scan. In addition, we performed all analyses following image coregistration and spatial normalisation to MNI standard space. We used a standard ROI template covering the whole brain from the Harvard Oxford subcortical and MNI structural probabilistic atlases available within FSL. While the use of this analysis strategy sought to reduce variability within our comparisons, we eroded the ROI template by a single voxel within FSL in order to improve spatial localisation and reduce the impact of coregistration, normalisation and partial volume errors. Finally, all ROIs were manually inspected to ensure that they were correctly aligned with the imaging data and corresponded to the regions specified. In summary, we considered possible sources of WB 1HMRS variability within our centre and attempted to limit their impact and ensure that the data we acquired were comparable within and between the different imaging sessions.

Whilst our results for WB 1HMRS reproducibility are in line with published data, we report data specifically concerning the difference between intersubject variability, within session and between session reproducibility. It is useful to consider the sources of variability in WB 1HMRS data in the setting where we are trying to address the significance of changes between normal physiology and disease states, or changes that are the consequence of a therapeutic intervention. In the first case, the relevant sources of error are the intersubject variability in the patient and volunteer groups. Our data for healthy volunteers are broadly concordant with results from other groups [24], and show that these are high, with mean (range) CoV for Cho/Cr 21 (11 – 62%), NAA/Cho 17 (11 – 55%), NAA/Cr 13 (8 – 37%), NAA 12 (6 – 23%), Cho 31 (13 – 69%) and Cr 19 (7 – 61%). To be certain that 1HMRS values derived from an individual patient are significantly lower, with a confidence of 95%, these figures suggest that we need to have mean ROI NAA values (for example) that are at least 23% lower than volunteer means. This estimate and the secure distinction of a patient group as abnormal is confounded by the fact that intersubject CoV in patients with neurological disorders is likely to be larger than controls, and variable across different brain regions. These figures underline the difficulty of using WB 1HMRS in small groups of patients with different causes of neurological disease who have variable pathophysiology. In practice, the estimated study sample size is moderated by the dramatic changes in metabolite concentration that occur in patients. For example, following mild traumatic brain injury there is approximately a 20% reduction in NAA and increase in Cho even where structural imaging appears normal, and in severe traumatic brain injury changes of up to a 50% can occur [35], [36]. Hence the significance of metabolite change is often detected with manageable numbers, despite the large intersubject variability in volunteer and patients groups.

However, it is important to point out that these figures are largely irrelevant when considering the power and design of clinical studies, when WB 1HMRS is being used to monitor changes within the same subject in the same scanning session (within session reproducibility) or during longitudinal assessments over time in several different imaging sessions (between session reproducibility). In such settings, the subject is his or her own control, and the relevant parameter is intrasubject variability or reproducibility. Our data show that these figures for CoV are smaller than those obtained from the discussion in the previous paragraph. In addition, we provide reference data for metabolites in healthy volunteers demonstrating that the CoV for within session reproducibility is broadly comparable to that obtained in different imaging sessions (Tables 3, 4, 5, 6, 7). While the reproducibility of NAA/Creatine and NAA was significantly lower for between session compared to within session measurements the absolute differences were small. This finding is not consistent with the lack of difference for the other metabolites and is unlikely to be clinically relevant. We found no evidence to suggest that within session reproducibility was smaller than between session reproducibility measurements. These data provide helpful guidance for designing clinical studies, and suggest that for NAA or NAA/Cr it should be possible to detect differences of 20% with confidence. For example, although the reproducibility of measurements is variable for the different brain regions we can use these data to calculate sample sizes for interventional and longitudinal clinical studies. For a lobar ROI such as the right frontal region the between session CoV was 8% for NAA and we should be able to detect a 20% change with 95% power at a significance level of 1% within a group of 10 subjects within a single interventional or longitudinal study design [37]. Clearly, such estimates only strictly apply to our scanner and institution, but they provide a useful starting point for any spectroscopic study design. There are a number of factors particular to our scanning protocols and institutional setup that limit the use of the reproducibility measurements that we provide. These include, but might not be limited to, scanner, acquisition protocols, data correction and reconstruction, and processing. Despite these variations, it should be possible for other groups to use the methodology that we describe to derive ‘in house’ data for their studies. In addition, although these data provide guidance for designing clinical studies, particular groups of subjects (including those with brain injury) may require sedation and control of ventilation as part of clinical care. While such patient groups may appear complex and difficult to manage within the context of an imaging study the fact that they remain completely immobile and have stable physiology should result in lower CoV for reproducibility measurements and an increase in the sensitivity of interventional studies[34].

Methodological limitations

The volunteers included in this study ranged in aged from 25 – 50 years, and since metabolite levels are associated with age [23], this may account for some of the variability in the intersubject analysis. While we were able to obtain multiple WB 1HMRS datasets on up to two occasions in this group of volunteers, scanner availability and subject tolerance (duration and noise) prevented us from acquiring further WB 1HMRS datasets within the same session and additional scanning sessions. A repeat imaging session was performed within a mean (range) of 33 (3 – 181) days, and variation in this interval could result in biological differences between the datasets obtained within a few days compared to those obtained after several months. However, any expected change in WB 1HMRS in healthy volunteers of a similar age over a period of up to six months is small and unlikely to have resulted in the differences we have found [23], [38]. In addition, we found no relationship between scan reproducibility and the interval between the two imaging sessions.

We found variability in the 1HMRS measurements and their reproducibility across the different brain regions. In addition, there was more variability in metabolite data involving choline, which probably reflects the lower concentration of choline within the brain [39]. These differences are demonstrated in Tables 1, 2, 3, 4, 5, 6, and Figs. 3 and 4 and were particularly relevant for the corpus callosum, deep grey matter, midbrain, frontal, occipital and some white matter regions. We found no relationship between the ROI volume and intersubject variability and reproducibility of 1HMRS for any of the metabolites (data not shown). Despite this, the cause of these differences may in part be related to inhomogeneities in the B0 field induced by the frontal and sphenoidal air sinuses, partial volume errors within relatively small regions, locally variant metabolite concentrations, and variation in the quality of coregistration and spatial normalisation within individual subjects. We tried to limit these errors through careful review of all the transformed imaging datasets, shimming the scanner before each MIDAS data acquisition, and eroding the ROI template by a single voxel to improve accuracy. Despite this, errors remain within some ROIs where 1HMRS values differ in closely adjacent brain regions. However, the purpose of this study was to determine the variability of measurements using an ROI template and standard processing pipeline. While variability in the fitting of template ROIs in individual subjects may result in higher intersubject variability for particular brain regions this should be less likely for measurements of reproducibility within the same subject. Here any differences in ROI template fitting between the sessions should be small. These regional differences underline that 1HMRS studies should compare data within the same brain region using the same data processing technique. Our figures for reproducibility are higher than that reported by Maudsley et al using the same acquisition sequence [20]. This reflects our inclusion of a larger study group and that we utilised a standard processing pipeline and ROI template covering the whole brain within normalised space that we would typically apply to patient studies. While the data we report are specific to our methods the reproducibility measurements that we report provide a useful starting point for study design.

Conclusions

This study provides additional reference data concerning intersubject variability and reproducibility of WB 1HMRS conducted in a group of healthy volunteers. The CoV for repeat WB 1HMRS measurements obtained during the same session were similar to that obtained from measurements obtained in a different imaging session separated by up to six months. These data can be used to calculate the 95% prediction interval for zero change and may inform the design of interventional studies to quantify change within a single imaging session, or to assess the significance of change in longitudinal studies.

Author Contributions

Conceived and designed the experiments: TVV MM EC JG VN JO VL SN GBW SS DKM AAM JPC. Performed the experiments: TVV MM EC JG VN JO VL SN GBW SS. Analyzed the data: TVV MM EC JG VN JO VL SN GBW SS DKM AAM JPC. Contributed reagents/materials/analysis tools: TVV MM GBW SS DKM AAM JPC. Wrote the paper: TVV MM EC JG VN JO VL SN GBW SS DKM AAM JPC.

References

  1. 1. Price SJ, Gillard JH (2011) Imaging biomarkers of brain tumour margin and tumour invasion. Br J Radiol 84 Spec No 2:S159–S167.
  2. 2. Govind V, Gold S, Kaliannan K, Saigal G, Falcone S, et al. (2010) Whole-Brain Proton MR Spectroscopic Imaging of Mild-to-Moderate Traumatic Brain Injury and Correlation with Neuropsychological Deficits. J Neurotrauma 27:483–496.
  3. 3. Govindaraju V, Gauger GE, Manley GT, Ebel A, Meeker M, et al. (2004) Volumetric proton spectroscopic imaging of mild traumatic brain injury. AJNR Am J Neuroradiol 25:730–737.
  4. 4. Holshouser BA, Tong KA, Ashwal S (2005) Proton MR spectroscopic imaging depicts diffuse axonal injury in children with traumatic brain injury. AJNR Am J Neuroradiol 26:1276–1285.
  5. 5. Gonen O, Catalaa I, Babb JS, Ge Y, Mannon LJ, et al. (2000) Total brain N-acetylaspartate: a new measure of disease load in MS. Neurology 54:15–19.
  6. 6. Ruiz-Peña JL, Piñero P, Sellers G, Argente J, Casado A, et al. (2004) Magnetic resonance spectroscopy of normal appearing white matter in early relapsing-remitting multiple sclerosis: correlations between disability and spectroscopy. BMC Neurol 4:8.
  7. 7. Govind V, Sharma KR, Maudsley AA, Arheart KL, Saigal G, et al. (2012) Comprehensive evaluation of corticospinal tract metabolites in amyotrophic lateral sclerosis using whole-brain 1H MR spectroscopy. PloS one 7:e35607.
  8. 8. Watanabe T, Shiino A, Akiguchi I (2012) Hippocampal metabolites and memory performances in patients with amnestic mild cognitive impairment and Alzheimer's disease. Neurobiol Learn Mem 97:289–293.
  9. 9. Kraguljac NV, Reid M, White D, Jones R, den Hollander J, et al. (2012) Neurometabolites in schizophrenia and bipolar disorder - a systematic review and meta-analysis. Psychiatry Res 203:111–125.
  10. 10. Szulc A, Waszkiewicz N, Bibulowicz D, Konarzewska B, Tarasow E (2012) Proton magnetic resonance spectroscopy changes after antipsychotic treatment. Curr Med Chem
  11. 11. Steen RG, Hamer RM, Lieberman JA (2005) Measurement of brain metabolites by 1H magnetic resonance spectroscopy in patients with schizophrenia:a systematic review and meta-analysis. Neuropsychopharmacology 30:1949–1962.
  12. 12. Moffett JR, Ross B, Arun P, Madhavarao CN, Namboodiri AMA (2007) N-Acetylaspartate in the CNS: from neurodiagnostics to neurobiology. Prog Neurobiol 81:89–131.
  13. 13. Klein J (2000) Membrane breakdown in acute and chronic neurodegeneration: focus on choline-containing phospholipids. J Neural Transm 107:1027–1063.
  14. 14. Tumati S, Martens S, Aleman A (2013) Magnetic resonance spectroscopy in mild cognitive impairment: Systematic review and meta-analysis. Neurosci Biobehav Rev
  15. 15. Miller BL, Chang L, Booth R, Ernst T, Cornford M, et al. (1996) In vivo 1H MRS choline: correlation with in vitro chemistry/histology. Life Sci 58:1929–1935.
  16. 16. Wylezinska M, Cifelli A, Jezzard P, Palace J, Alecci M, et al. (2003) Thalamic neurodegeneration in relapsing-remitting multiple sclerosis. Neurology 60:1949–1954.
  17. 17. Maudsley AA, Darkazanli A, Alger JR, Hall LO, Schuff N, et al. (2006) Comprehensive processing, display and analysis for in vivo MR spectroscopic imaging. NMR Biomed 19:492–503.
  18. 18. Ebel A, Soher BJ, Maudsley AA (2001) Assessment of 3D proton MR echo-planar spectroscopic imaging using automated spectral analysis. Magn Reson Med 46:1072–1078.
  19. 19. Maudsley AA, Wu Z, Meyerhoff DJ, Weiner MW (1994) Automated processing for proton spectroscopic imaging using water reference deconvolution. Magn Reson Med 31:589–595.
  20. 20. Maudsley AA, Domenig C, Sheriff S (2010) Reproducibility of serial whole-brain MR spectroscopic imaging. NMR Biomed 23:251–256.
  21. 21. Maudsley AA, Domenig C, Govind V, Darkazanli A, Studholme C, et al. (2009) Mapping of brain metabolite distributions by volumetric proton MR spectroscopic imaging. Magn Reson Med 61:548–559 (MRSI).
  22. 22. Langer DL, Rakaric P, Kirilova A, Jaffray DA, Damyanovich AZ (2007) Assessment of metabolite quantitation reproducibility in serial 3D-(1)H-MR spectroscopic imaging of human brain using stereotactic repositioning. Magn Reson Med 58:666–673.
  23. 23. Maudsley AA, Govind V, Arheart KL (2012) Associations of age, gender and body mass with 1H MR-observed brain metabolites and tissue distributions. NMR Biomed 25:580–593.
  24. 24. Li BSY, Babb JS, Soher BJ, Maudsley AA, Gonen O (2002) Reproducibility of 3D proton spectroscopy in the human brain. Magn Reson Med 47:439–446.
  25. 25. Veenith TV, Carter E, Grossac J, Newcombe VFJ, Outtrim JG, et al. (2013) Inter subject variability and reproducibility of diffusion tensor imaging within and between different imaging sessions. PloS one 8:e65941.
  26. 26. Ebel A, Maudsley AA (2001) Comparison of methods for reduction of lipid contamination for in vivo proton MR spectroscopic imaging of the brain. Magn Reson Med 46:706–712.
  27. 27. Woolrich MW, Jbabdi S, Patenaude B, Chappell M, Makni S, et al. (2009) Bayesian analysis of neuroimaging data in FSL. Neuroimage 45:S173–S186.
  28. 28. Greve DN, Fischl B (2009) Accurate and robust brain image alignment using boundary-based registration. Neuroimage 48:63–72.
  29. 29. Jenkinson M, Smith S (2001) A global optimisation method for robust affine registration of brain images. Med Image Anal 5:143–156.
  30. 30. Jenkinson M, Bannister P, Brady M, Smith S (2002) Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17:825–841.
  31. 31. Klein A, Andersson J, Ardekani BA, Ashburner J, Avants B, et al. (2009) Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. Neuroimage 46:786–802.
  32. 32. Coles JP, Fryer TD, Bradley PG, Nortje J, Smielewski P, et al. (2006) Intersubject variability and reproducibility of 15O PET studies. J Cereb Blood Flow Metab 26:48–57.
  33. 33. Coles JP, Fryer TD, Coleman MR, Smielewski P, Gupta AK, et al. (2007) Hyperventilation following head injury:effect on ischemic burden and cerebral oxidative metabolism. Crit Care Med 35:568–578.
  34. 34. Coles JP, Fryer TD, Bradley PG, Nortje J, Smielewski P, et al. (2006) Intersubject variability and reproducibility of 15O PET studies. J Cereb Blood Flow Metab 26:48–57.
  35. 35. Vagnozzi R, Signoretti S, Cristofori L, Alessandrini F, Floris R, et al. (2010) Assessment of metabolic brain damage and recovery following mild traumatic brain injury:a multicentre, proton magnetic resonance spectroscopic study in concussed patients. Brain 133:3232–3242.
  36. 36. Signoretti S, Marmarou A, Aygok GA, Fatouros PP, Portella G, et al. (2008) Assessment of mitochondrial impairment in traumatic brain injury using high-resolution proton magnetic resonance spectroscopy. J Neurosurg 108:42–52.
  37. 37. Faul F, Erdfelder E, Lang AG, Buchner A (2007) G*Power 3:a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 39:175–191.
  38. 38. Saunders DE, Howe FA, van den Boogaart A, Griffiths JR, Brown MM (1999) Aging of the adult human brain:in vivo quantitation of metabolite content with proton magnetic resonance spectroscopy. J Magn Reson Imaging 9:711–716.
  39. 39. Christiansen P, Toft P, Larsson HB, Stubgaard M, Henriksen O (1993) The concentration of N-acetyl aspartate, creatine + phosphocreatine, and choline in different parts of the brain in adulthood and senium. Magn Reson Imaging 11:799–806.