Figures
Abstract
Entropy is an important trait for life as well as the human brain. Characterizing brain entropy (BEN) may provide an informative tool to assess brain states and brain functions. Yet little is known about the distribution and regional organization of BEN in normal brain. The purpose of this study was to examine the whole brain entropy patterns using a large cohort of normal subjects. A series of experiments were first performed to validate an approximate entropy measure regarding its sensitivity, specificity, and reliability using synthetic data and fMRI data. Resting state fMRI data from a large cohort of normal subjects (n = 1049) from multi-sites were then used to derive a 3-dimensional BEN map, showing a sharp low-high entropy contrast between the neocortex and the rest of brain. The spatial heterogeneity of resting BEN was further studied using a data-driven clustering method, and the entire brain was found to be organized into 7 hierarchical regional BEN networks that are consistent with known structural and functional brain parcellations. These findings suggest BEN mapping as a physiologically and functionally meaningful measure for studying brain functions.
Citation: Wang Z, Li Y, Childress AR, Detre JA (2014) Brain Entropy Mapping Using fMRI. PLoS ONE 9(3): e89948. https://doi.org/10.1371/journal.pone.0089948
Editor: Satoru Hayasaka, Wake Forest School of Medicine, United States of America
Received: October 29, 2013; Accepted: January 23, 2014; Published: March 21, 2014
Copyright: © 2014 Wang et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by National Institutes of Health grants: R21DC011074, and 8P41-EB015893, and 5R33DA026114-04. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Entropy indicates system irregularity [1], which remains relatively low in living systems but increases over time in any closed system like our universe as dictated by the second law of thermodynamics [1], [2]. As nearly the most complex living organism known to us, the human brain has a prominent need for sustaining its entropy to function normally [3]–[5]. Measuring brain entropy (BEN) might then provide a physical means for characterizing brain status as well as its alterations in disease. BEN has long been measured using electrophysiological data [6]–[10] with low spatial resolution. Functional MRI (fMRI) reflects regional changes in cerebral blood flow and metabolism [11] and provides time-resolved volumetric imaging of brain function at relatively high spatial resolution, making it an attractive approach for mapping BEN. In the context of fMRI, entropy was first assessed as a novelty index [12], then as a tool for activation detection [13], and recently as a potential marker for brain diseases using the resting-state fMRI (rsfMRI) data from prior-selected regions-of-interest (ROIs) [14], [15]. Entropy of the entire brain has also been assessed using fMRI [16]–[18], but little is known about BEN's spatially distribution and its regional organizations. This study is an extension of our previously presented preliminary BEN work [19]–[21]. The purposes of this paper were to generate a whole brain entropy map using a large cohort of subjects (n = 1049) and to investigate the spatial distribution and local organization of BEN.
As directly calculating entropy from fMRI data is challenging and inaccurate due to the difficulty of accurately estimating the probability distribution function from the moderate number of time points contained in a typical fMRI time-series, we used sample entropy (SampEn) [22], [23] to measure entropy of fMRI timeseries, which is an approximate entropy measure that is stable for different data lengths and across different sessions [22], [23].
In tandem with BEN mapping, we sought to examine the regional BEN structure and to develop a brain atlas based entirely on the entropic correlations of brain regions, rather than using a priori structural or functional information. Our hypothesis was that BEN would discriminate between neuronal and non-neuronal (phantom-based) dynamics. Furthermore, we hypothesized that it would show a structured regional specificity based on empirical observations about slow coherent fluctuations of activity in fMRI – and theoretical work suggesting a hierarchical organization of temporal dynamics in the cortex [24]. To evaluate the SampEn-based BEN mapping and to test the above hypothesis, we first performed a series of control experiment to verify both the sensitivity and specificity of SampEn, and then compared fMRI derived entropy of a static phantom and the normal brain as well as the test-retest stability of BEN mapping in normal brain, and then conducted BEN mapping in normal brain using the large sample size from the 1000 functional connectome project (FCP) database, followed by BEN clustering and regional organization investigation.
Materials and Methods
Human subjects
16 young healthy subjects (age = 25.4±4.5, range = 20.3–35, male/female: 8/8) were recruited from University of Pennsylvania with approval from local ethics committee and signed consent forms from the participants. rsfMRI and fMRI with a sensorimotor task were acquired from the 16 subjects twice with 2 months apart. Detailed recruiting criteria and imaging parameters can be found in [25], [26]. The same fMRI sequence was also used to acquire rsfMRI data from a water phantom.
Resting fMRI were then downloaded from the 1000 functional connectomes project (FCP) [27]. All FCP data were acquired and released with approval from each contributor's ethics committee. Data from 22 centers (n = 1175) were analyzed, and those with small brain coverage or without demographic information (age and gender) were excluded, resulting in a total of 1049 subjects (age = 26.94±11.34 (mean ± standard deviation (STD)) years, age range: 7.88∼85 years, 466 males, 583 females) with rsfMRI data and high resolution anatomical image. 50 subjects had repeat data. The acquisition parameters were: duration: 4.15∼9.8 min; voxel size: 2∼4 mm within plane; slice thickness, 3∼5.5 mm.
Sensorimotor task
The task consisted of 5 resting and activation blocks, each block lasting for 48 seconds and was presented using Presentation (Neurobehavioral Systems, Albany, CA, USA). During the task block, visual stimuli with an 8 Hz reversing black and white checkerboard were presented intermittently in the full visual field for 48 seconds, and the subject was asked to perform a self-paced left-hand only fingertapping task when they saw the visual stimuli.
Data acquisition
For the 16 subjects, structural imaging and rsfMRI acquisitions were described in [25], [26]. Sensorimotor fMRI was acquired using the same sequence as that of rsfMRI. The same structural MRI, rsfMRI, task fMRI were repeated in 2 months. The same fMRI sequence was also used to acquire rsfMRI data from a water phantom.
Image processing
Image preprocessing was performed using AFNI (afni.nimh.nih.gov/afni/) and FSL(www.fmrib.ox.ac.uk/fsl/) with standard processing steps [27] including motion correction, temporal filtering, and spatial smoothing. Nuisance cleaning were performed as described in [27], [28], but without global signal cleaning [29]. We used the Nonlinear Image Registration Tool [30] to register each subject's structural image into the MNI standard space. Statistical analysis was performed using SPM (http://www.fil.ion.ucl.ac.uk/spm/).
Entropy calculation
Directly calculating entropy from fMRI data is challenging and inaccurate because of the difficulty of accurately estimating the probability distribution function from the moderate number of time points contained in a typical fMRI time-series. To overcome this challenge, we used sample entropy (SampEn) [22], [23], which is an extension of Approximate Entropy (ApEn) [31], both are approximations to Kolmogorov complexity/entropy [32]. SampEn is shown to be stable for different data lengths and across different sessions [22], [23]. Since SampEn needs to be calculated for hundreds of thousands of voxels for the >1000 subjects, we used an optimized SampEn algorithm implemented in C++ computer language to reduce the total computation time.
Denote the rsfMRI data of one voxel by, where N is the number of time points. SampEn starts with forming a series of vectors, the so called embedded vectors, each with m consecutive points extracted from x:
, where
to N-m+1, and m is the pre-defined dimension. Using a pre-specified distance threshold r,
counts the number of
to N-m, and
) whose distances (Chebyshev distance is generally used though any other distance can be used as well) to
are less than r, so does
for the dimension of m+1. By averaging across all possible vectors, we have
(1)
(2)And SampEn is calculated as:
(3)In the original algorithm, the distance of
and
and the subsequent comparison with r are conducted twice: one for
and the other for
. This redundancy was removed by updating
and
simultaneously and flagging these operations for this pair to be excluded in later iteration. For fMRI data with N time points, this routine will save (N-m-1)*(N-m-2)/2 times distance calculations and (N-m-1)*(N-m-2)/2 times distance comparisons. Meanwhile, the first m elements of the embedded vectors of dimensions m and m+1 are the same, meaning that distance calculations for m can be shared with m+1, while the latter will only needs to be updated with the last element of the vectors. This SampEn calculation algorithm was verified with Matlab code implementing the original algorithm to make sure that it yielded the same results as the original implementation.
SampEn evaluations
As described above, SampEn depends on an embedded dimension m and a tolerance threshold r and different m and r may yield different SampEn values. Small m and large r lead to more vector matches (higher and
in Eqs. 1 and 2. Note that smaller m tends to yield smaller distance) and subsequently improve the accuracy and confidence level of SampEn. However, the definition of SampEn requires that m approaches ∞ and as r approaches 0 [31]. To verify SampEn with different m and r for differentiating signals with different known entropy and also to find an empirically optimal value for both parameters, SampEn calculations were performed with different m and r using synthetic data with known entropy.
Evaluation 1
SampEns of Gaussian noise, chirp signal, and sinusoidal signal (Fig. S1A) were calculated with different r and m. Based on the literature [23], [33]–[35], in the simulations, m was changed from 3 to 4; r was changed from 0.2 to 1.2 with a step of 0.2 and then changed to 1.5 of data STD. The length of these synthetic data was set to be 150 to 400.
Evaluation 2
As described in [36], [37], synthetic fMRI data with a periodic on-off paradigm were generated with 6 different contrast-to-noise-ratios (CNRs): 0.08, 0.1, 0.2, 0.5, 0.8, and 1. Synthetic data were generated at each noise level by adding new Gaussian noise for 100 times. Both noise and activation were convolved with the canonical hemodynamic reference function (HRF) [38] to mimic the real fMRI noise environment. Fig. S1C shows the HRF convolved design function (red dashed line) and the noise contaminated signal with a CNR of 0.2 (blue solid line). SampEn was calculated for both noise and synthetic activation data using m from 3 to 4, and r from 0.2 to 1 STD.
BEN mapping evaluations
After the above SampEn evaluations, we performed several control experiments to validate BEN mapping using fMRI. The first control experiment was to check the entropy level in a nonliving water phantom (Fig. 1A shows one image slice of the phantom). Entropy of each voxel within and outside of the phantom was calculated using the SampEn algorithm described above and the non-processed raw fMRI data. Since fMRI signal of the static phantom consists of random thermal fluctuations and a random low frequency drift [39] with high irregularity, entropy of the phantom should be no different from that of the background noise. The second control experiment was performed to verify the test-retest reproducibility of BEN mapping results in normal brain. To do that, SampEn was calculated at each voxel of the preprocessed rsfMRI data from 50 subjects identified from the FCP database who had repeated rsfMRI scans. The collection of all voxels' SampEn formed a BEN map, which was warped to the MNI standard space using FNIRT. The intra-class correlation coefficient (ICC) [40] of BEN at the test and retest sessions was calculated at each voxel using Matlab. Correlation coefficient (CC) of the whole brain mean BEN of both sessions was also calculated.
A) image of a cylinder water phantom; B) entropy map of the phantom. The color bar indicates the display color window for the entropy map; C) visual and sensorimotor functional activation induced brain entropy decrease as compared to the resting state. Red and green represent the test (session 1) and retest (session 2) experiment, respectively. The color bars indicate the color window used to display the statistical comparison results (t maps of the paired student t-testing). The statistical threshold for identifying the entropy decreasing clusters is p<0.001 and cluster size>30 (uncorrected for multiple comparisons); D) the correlation coefficient (CC) map of 50 subjects' resting BEN maps. The color bar was used to map the CC value from 0.5 to 1.
The third experiment was to assess whether BEN mapping can capture the brain activity irregularity changes during performing periodic sensorimotor task. Entropy has been assessed as a way to detect brain activation in [13], but was derived from a small window around the assumed brain activation epoch peaks. In this paper, entropy of the entire fMRI time series was characterized. In this experiment, we calculated BEN maps from the 16 subjects' rsfMRI data and sensorimotor fMRI data which were separately acquired in the same scan session and were repeated in another session in 2 months. Since brain activity in response to the periodic task performing would introduce regional orderliness to the fMRI data, regional BEN should decrease accordingly. SampEn was calculated at each voxel of the preprocessed rsfMRI and task fMRI images. The resulting BEN maps were registered and resampled to a resolution of 3×3×3 mm3 into the MNI space using FNIRT. A paired t-test between BEN maps of rsfMRI and task fMRI was conducted for each scan separately to assess the regional BEN alterations due to the periodic task performing.
BEN mapping using the FCP data
BEN maps were calculated using the routines described above. Each BEN map was divided by its mean and subtracted by 1 to get an rBEN map. Using FNIRT, both BEN and rBEN maps were projected into the MNI space with a resolution of 3×3×3 mm3. We then calculated the mean BEN maps of all 1049 subjects and conducted a one-sample t-test on the rBEN maps. Age and gender effects were included in a multiple regression model to assess their effects. This regression was conducted on the whole brain mean BEN and each voxel's BEN separately.
Clustering
To further delineate the entropic patterning of the brain to test the hypothesis that BEN is self-organized into regional communities, we used a data-driven clustering method to automatically parcellate whole brain rBEN values into a series of clusters. We used rBEN maps to remove across-subject global BEN variability. To reduce the computational burden for the whole brain based BEN clustering, rBEN maps were resampled with a resolution of 4.5×4.5×4.5 mm3 in MNI space. We used a fast and robust clustering algorithm, spectral clustering [41], to search for regional BEN communities (clusters). We chose spectral clustering which has been shown to have good performance in various applications [41] including fMRI-based brain segmentation [42]. With 1049 subjects' BEN maps, we had an nxS BEN data matrix, where n = 15893 is the number of intracranial voxels, S = 1049 is the number of subjects. Spectral clustering starts with building an nxn similarity (CC in this study) matrix. With the similarity matrix, a Laplacian matrix was built. Using eigen decomposition, the k smallest eigenvectors of the Laplacian matrix were extracted and grouped into an Sxk matrix, which was subsequently normalized along each row. Treating each row as a new data point, standard k-mean clustering was used to cluster the S points into k clusters. k was the pre-specified cluster number. We used the Matlab code written by Ingo Buerk (http://www.mathworks.com/matlabcentral/fileexchange/34412) to do spectral clustering using the algorithm proposed by [43].
Determining the optimal cluster number
Since clustering produces the results based on the pre-specified cluster number, we performed a series of experiments to determine the optimal cluster number. Clustering was performed for the entire group and a randomly assigned 525 group and a 524 group with k varying from 3 to 40. For each k, we calculated Silhouette coefficient (SC) [44] and a reproducibility index (RI). RI is the number of non-reproducible clusters across the 3 groups. For each k, we got 3 sets of clusters. For each of the k clusters from the 1049 group, we calculated its overlap ratio with each of the k clusters of the two subgroups (the 525 and 524 group). The overlap ratio of two clusters was the ratio of the number of overlapped voxels divided by the total number of voxels in both clusters. The cluster in each of the two subgroups showing the highest overlap ratio to the target cluster in the 1049 group was identified as its partner. We set the partner to be null if no cluster in that subgroup showed greater than 10 percent of overlap ratio with the target cluster of the 1049 group. We then calculated the number of mis-matched clusters by counting the number of null partners of all k clusters of the 1049 group. We repeated the same partner-matching procedure for all clustering experiments with k varying from 2 to 40. We then used the number of mis-matched clusters as the RI for the k-clusters-based clustering. Fewer mis-matchings means higher RI. The optimal k was identified at the peak (local maximum) of SC curve and the peak (local minimum) of the RI curve.
Rank and hierarchy of regional BEN
This experiment was to further evaluate the possible hierarchical structure of the BEN communities identified in the above experiment. We extracted the mean rBEN for the above identified clusters from all subjects. One-way ANOVA function and a series of paired t-tests were performed to test whether there are significant rBEN differences among those clusters. The entropy similarity matrix was also created using the mean cluster rBEN series (across subjects), a dendrogram was generated using the hierarchical clustering method provided in Matlab (Mathworks, Natick, MA, USA) to summarize the entropy relations of the regional entropy communities identified above.
Results
SampEn with different m and r for differentiating signal from noise
Simulations on SampEn calculations showed that data length has only a minor effect on SampEn (Fig. S1B), which ensured including all the rsfMRI data even with different time points for BEN mapping. For fMRI, SampEn robustly detected the synthetic brain activity from the noise contaminated data even when the contrast-to-noise-ratio was as low as 0.2 (see Fig. S1D and Table S1), though its sensitivity decreases when r was greater than 1. Since SampEn with m = 3 or 4 showed similar performance for differentiating signal from noise (Fig. S1D) and small m may improve SampEn-based entropy calculation accuracy, m = 3 was chosen as the empirical value for rsfMRI-based BEN mapping. When r was greater than 0.6 STD, different m's yielded similar SampEn values and the SampEn difference between the Sinusoidal and chirp signal stayed at the same level. Therefore, r = 0.6 STD was chosen to be the optimal value for the following BEN mapping.
Brain entropy mapping using fMRI
In the first fMRI-based entropy mapping experiment, the water phantom (Fig. 1A) showed the same entropy as that of the background except random spatial fluctuations (Fig. 1B). In the second evaluation experiment, sensorimotor task performing introduced significant (p<0.001 and cluster size>30, uncorrected for multiple comparisons) regional SampEn decrease in visual and sensorimotor brain areas as compared to the resting state (Fig. 1C). The SampEn decrease due to task performing in scan day 1 (the hot spots) was replicated in a second experiment performed 2 months later (the green spots). Fig. S2 shows the brain activations identified using standard GLM. The GLM results confirmed the SampEn identified functional regions in both sessions. Fig. 1D shows the test-retest intra-class correlation coefficient (ICC) map of the 50 FCP subjects' BEN maps. Nearly all intracranial voxels showed an ICC>0.5. ICC for the whole brain mean BEN was 0.967. Several voxels in the posterior cingulate cortex showed an ICC<0.5.
Normal BEN distribution revealed using 1049 normal subjects
Fig. 2A shows the BEN map (calculate using SampEn with m = 3 and r = 0.6) from a representative subject from the FCP database. Similar to the result shown in Fig. 1B, entropy in the background is high and randomly distributed. However, BEN in the intracranial voxels appears to be much lower than the background.
A) BEN map of a representative subject. B) average BEN map of 1049 subjects. The background voxels were removed for a better visualization.The gray scale and color scale indicate BEN values for Figure 2a and 2b, respectively.
Fig. 2B shows the mean BEN map of the 1049 subjects with background removed for better visualization of the detailed BEN structure (very similar patterns were found in the mean BEN maps calculated with different r values as shown in Fig. S3). The mean BEN map shows a clear BEN contrast between neocortex, white matter (WM), and subcortical gray matter structures. Neocortex showed lower BEN than the rest of brain, with the 5 lowest BEN regions located in the precuneus (PRE), bilateral motor cortex (MC), orbito-frontal cortex (OFC) and visual cortex (VIS) (Fig. 2B, 3A). Low entropy in PRE, OFC, and VIS is consistent with prior results [14]. Whole brain BEN did not show age effects, either regionally or globally. By comparing rBEN to 1, we statistically (p<0.01, corrected for multiple comparison) defined the high and low BEN distribution pattern shown in Fig. 2B as a higher-than-average BEN network (HBEN) and a lower-than-average BEN network (LBEN) in Fig. 3A.
A) The statistically defined higher-than-average BEN network (hot color) and lower-than-average BEN network (cool color). The significance level used for thresholding the distribution map (the statistical parametric map of the student t-test) is p<0.01 (corrected for multiple comparison); B) The 8 BEN clusters identified by clustering: a) OFC, b) TPLS, c) WM, d) VIS, e) DMN, f) MC, g) PFC, h) peripheral artifact. The text above each axial slice in B, C, and D indicates the slice location (z and x mean the x and z coordinate in mm, respectively) in the MNI space. The left side of image corresponds to the left side of brain.
The hierarchical self-organization of BEN
On the basis of the peak of the SC (Silhouette coefficient) [44] and the peak of a clustering reproducibility index (RI) (Fig. S4), we identified 8 BEN clusters (Fig. 3B). One cluster (h in Fig. 3B) consists of voxels within the peripheral brain boundaries, likely to represent artifact due to imperfections in brain registration. The other 7 clusters correspond to anatomically or functionally meaningful regions. LBEN identified in Fig 3A was reorganized into 5 BEN clusters (a, g, f, e, and d in Fig. 3B) located in OFC, prefrontal cortex (PFC), MC, the posterior part of the “default mode network” (DMN) [45], and VIS, respectively; while HBEN was separated into clusters b, and c, where c consists of WM, and b covers cerebellum, brain stem, limbic area, inferior temporal cortex (ITC), and part of medial temporal cortex (MTC) (cluster b will be called temporal lobe-subcortex (TPLS) cluster in the following). All clusters were bilateral, albeit with some asymmetry. By randomly splitting the whole group into two subgroups with n = 525 and n = 524 respectively, we verified that the 8 cluster parcellation results for the n = 525 subgroup (Fig. S5A) and the n = 524 subgroup (Fig. S5B) are highly reproducible.
Fig. 4A shows the entropy similarity matrix of the 7 structurally and functionally meaningful clusters identified above. Fig. 4B is the dendrogram generated with the hierarchical clustering. The most distinct BEN partitions at the highest level of the hierarchy corresponds to a division between an anterior BEN system (PFC, OFC, WM, and TPLS (g, a, c, and b in Figs. 3B, 4) and a posterior BEN system (MC, DMN, and VIS (f, e, and d in Figs. 3B, 4) as marked by the thick yellow line in the sagittal view of Fig. 3B; below the anterior BEN system are the frontal BEN network (PFC and OFC) and HBEN, while below the posterior BEN system are the visual-DMN system (VIS and DMN) and the sensory motor system (MC).
A) the across-subject BEN similarity matrix, B) the hierarchical structure of the 7 BEN clusters. C) Mean and standard errors of the mean rBEN in the 7 clusters. The color map in A represents the correlations of BEN within and between BEN clusters. The inset in C lists the probability of the rBEN comparisons between a pair of BEN clusters.
Using the one-way ANOVA, we found that the 7 clusters identified above showed significantly (p = 0) different rBENs (Fig. 4C). Among them, the WM cluster showed the highest BEN, followed by TPLS (cluster b in Fig. 3B), MC, PFC, OFC, VIS, and DMN (Fig. 4C). PFC and OFC showed the same level of rBEN, and no rBEN difference was found between VIS and DMN. Significant rBEN differences were demonstrated between each pair of the remaining 5 cluster groups: 1) WM, 2) TPLS, 3) MC, 4) PFC and OFC, 5) VIS and DMN (see the inset for the paired-t test probability values Fig. 4C).
Discussion
We mapped whole brain entropy using resting state fMRI from 1049 normal subjects. Entropy was measured with SampEn. Our data demonstrated that SampEn is a robust and sensitive entropy measure for differentiating generic and fMRI signals with different regularities and that SampEn-based fMRI-derived BEN is reliable brain activity measure, which differs from that of a non-living object and background noise, and is sensitive to task-induced regional brain activity alterations. BEN was stable in nearly the whole brain except several voxels in the middle sagittal plane. While their ICC were still >0.4, the relatively lower test-retest stability may reflect that resting state activity in those voxels which are in the precuneus has larger across-session variability.
Low entropy has long been postulated and observed in living organisms [2] including human brain [3]–[5]. Our results clearly demonstrated the big entropy contrast between the living brain tissue and the background and the nonliving water phantom, which retrospectively proves physical validity for the fMRI-based BEN mapping method, and is consistent with Lovelock's suggestion of using entropy for detecting life in Mars which was further developed into the Gaia theory [46], [47]. The whole brain entropy map showed a clear spatial distribution and a sharp contrast between neocortex and the rest of brain. The relatively lower BEN in neocortex may reflect the “higher” mental functions subserved by cortex [48]. Within the neocortex, low entropy in PRE (precuneus), OFC (orbito-frontal cortex), and VIS (visual cortex) is consistent with prior results [14] where BEN was measured in anatomical ROIs using wavelet entropy [49] and no statistical inference was provided for BEN distributions across the brain. The white matter versus grey matter BEN contrast was consistent with our previous findings using a negentropy-based BEN mapping method [19], [20] and those reported in [18] which was based on ApEn [31].
The heterogeneity of neocortex BEN and its organization into regional communities are indirectly supported in prior rsfMRI studies [45], [50]–[52]_ENREF_35. Specifically, PRE and OFC are within the so-called DMN [45], which is known to fluctuate in a coherent way [27]. MC has long been demonstrated to have strong correlations between its bilateral segments by Biswal et al in their seminal functional connectivity paper [51]_ENREF_41. VIS has also been repeatedly identified as a separate resting state network [50]. BEN clusters were bilateral, suggesting no side dominance of resting BEN across subjects. BEN clustering based brain parcellation is purely driven by the data. Although we controlled the stability of BEN clustering by repeating the process to randomly selected sub-data sets and presented the results that had both a local maximal SI coefficient and a local maximum of reproducibility, it is still possible that new data might give different number of optimal clusters. However, finding a different number of clusters should not change the general patterns of the subdivisions except cluster splitting or merging as shown in the additional clustering results derived at two sub-optimal SI and RI peaks with k = 6 and 14, respectively.
The hierarchical BEN clustering findings were partly supported by recently published cortical surface area-based genetic subdivision study [53] where a similar anterior/posterior brain subdivision was reported. The hierarchical structure of the identified regional BEN clusters was further evidenced by the progression pattern shown in the 6, 8, and 14 clusters-based parcellations results (Fig. 3 and Fig. S6) that the successive clusters (when k increased) tend to be sub-partitions of previous clustering results (of smaller k).
An approximate negentropy [54] was used in our preliminary studies as reported in [19], [20]. Though the entropy contrast between grey matter and white matter shown there was similar to what we found in this paper, the negentropy-based BEN mapping using the same FCP data showed relatively higher entropy rather than lower entropy in the motor cortex than the rest of brain. We later found that the artificial “higher” entropy in the resting motor cortex was caused by the sensitivity of the negentropy measure to input data normalization, which is not an issue for SampEn because SampEn uses a data-dependent threshold (r) for counting the vector matchings and therefore is data scale-free. Choosing r and m has been extensively performed in previous literature. We repeated the evaluation process in order to provide guidance for choosing them for BEN mapping. Though we used r = 0.6 and m = 3 in this paper, we did run a series of analyses using different values and found very similar results for those values assessed in the evaluation experiments.
It's worth to note that SampEn and ApEn are not the same as Shannon entropy. SampEn and ApEn are rather often used to indicate system complexity because both of them were defined as approximates to the Kolmogorov complexity. In our BEN mapping experiments using the sensorimotor fMRI data, we showed that SampEn reduced when brain activity turned to be more coherent due to the periodic task engagement. Since the periodic task activation would increase entropy if measured by Shannon entropy but decrease complexity, a reduction of SampEn suggests that SampEn can be potentially used as a complexity measure for brain activity. However, SampEn has not been fully shown to a complexity measure similar to the Tononi complexity [55]. In [56], a multi-scale SampEn was proposed, which showed lower SampEn in random noise than in 1/f noise when scale increased. Since 1/f noise is known to have higher complexity than random noise, the multi-scale SampEn could potentially provide a way to approximately measure signal complexity. A difficulty of using higher scale in fMRI is that increasing scale will exponentially reduce the available data length, resulting in a non-stable SampEn measurement. Since increasing scale is similar to a low-pass filtering, an alternative approach to perform multi-scale SampEn is to combine low-pass filtering and SampEn. However, that is out of the scope of this study and should be assessed in future work.
To summarize, BEN provides a physiologically and functionally meaningful brain activity measure. Different from the relative metrics used in prior rsfMRI studies, entropy is a quantitative measure, making it a potentially useful index for studying different brain states. The hierarchy of BEN suggests that brain activities can be ranked by BEN, which may provide opportunities to detect brain disorders based on abnormalities in BEN activity such as a pilot investigation of BEN in drug addiction [57].
Supporting Information
Figure S1.
SampEn evaluation results. A) waveforms of a Gaussian noise, a chirp signal, and a sinusoidal signal used for evaluating SampEn; B) SampEn calculation results using different embedded dimensions (m) and different tolerance levels (r) with different data length; C) the hemodynamic response function (HRF)-convolved artificial brain activation (the red line) and noise (the blue line); D) SampEn of noise (blue lines) and noise contaminated brain activation (red lines). The errorbars indicate standard error of SampEn for each calculation.
https://doi.org/10.1371/journal.pone.0089948.s001
(DOCX)
Figure S2.
Brain activations identified using standard general linear model. The task activation was defined as the significant brain activity magnitude between the task condition and control condition. The significance level used here is the same as that in Fig. 1C. Red and green indicate results of the first and second day sensorimotor task performing experiment. Colorbar means the t-value range of the statistical parametric maps shown here.
https://doi.org/10.1371/journal.pone.0089948.s002
(DOCX)
Figure S3.
Mean resting BEN maps of 1049 subjects calculated using SampEn with m = 3, r = 0.4, 0.6, 0.8, 1 from the bottom row to the top row, respectively. For the purpose of display, every BEN map has been normalized to be from 0 to 1 (divided by its maximum intensity). The colormap shows the display window used for generating the maps and its range is from 80% to 101% of the maximum.
https://doi.org/10.1371/journal.pone.0089948.s003
(DOCX)
Figure S4.
Silhouette coefficient (red line) and the number of non-reproducible clusters (blue line) of BEN clustering using different pre-specified cluster numbers.
https://doi.org/10.1371/journal.pone.0089948.s004
(DOCX)
Figure S5.
Two different data subsets-based BEN clustering results. A) Eight brain subdivisions identified from the 525 randomly selected subjects' rBEN maps, B) eight brain subdivisions the rest 524 subjects' rBEN maps using the data-driven spectral clustering method. These clusters were identified at the optimal peak of the curves shown in Fig. S4 using the same spectral clustering procedure as described in the main article.
https://doi.org/10.1371/journal.pone.0089948.s005
(DOCX)
Figure S6.
A) six brain subdivisions and B) fourteen brain subdivisions derived from 1049 subjects' rBEN maps. These clusters were identified using the same spectral clustering procedure as described in the main article. The prior specified cluster number k of 6 and 14were located in the two suboptimal peak locations adjacent to the optimal one k = 8 as shown in Fig. S4.
https://doi.org/10.1371/journal.pone.0089948.s006
(DOCX)
Table S1.
Signal detection results using sample entropy and reference guided data fitting. Synthetic data were generated by adding noise to a boxcar function with 8 different level of contrast-to-noise-ratio (CNR). SampEn was calculated using an embedded dimension of 4, and 5 different tolerance levels. cc means Pearson's correlation coefficient.
https://doi.org/10.1371/journal.pone.0089948.s007
(DOCX)
Acknowledgments
We thank Dr. Karl Friston for providing extensive comments and discussions on the method and results.
Author Contributions
Conceived and designed the experiments: ZW. Performed the experiments: ZW YL. Analyzed the data: ZW YL. Wrote the paper: ZW ARC JAD.
References
- 1.
Sandler SI (2006) Chemical and Engineering Thermodynamics. New York: Wiely.
- 2.
Schrödinger E (1944) What is Life - the Physical Aspect of the Living Cell. Cambridge: Cambridge University Press.
- 3. Singer W (2009) The Brain, a Complex Self-organizing System. European Review 17: 321–329.
- 4. Bergstrom RM (1969) An entropy model of the developing brain. Developmental psychobiology 2: 139–152.
- 5.
Pinker S (1997) How the Mind Works. New York: W. W. Norton.
- 6. Rezek IA, Roberts SJ (1998) Stochastic complexity measures for physiological signal analysis. IEEE transactions on bio-medical engineering 45: 1186–1191.
- 7. Poza J, Hornero R, Escudero J, Fernandez A, Sanchez CI (2008) Regional analysis of spontaneous MEG rhythms in patients with Alzheimer's disease using spectral entropies. Annals of biomedical engineering 36: 141–152.
- 8. Strange BA, Duggins A, Penny W, Dolan RJ, Friston KJ (2005) Information theory, novelty and hippocampal responses: unpredicted or unpredictable? Neural networks: the official journal of the International Neural Network Society 18: 225–230.
- 9. Bruna R, Poza J, Gomez C, Garcia M, Fernandez A, et al. (2012) Analysis of spontaneous MEG activity in mild cognitive impairment and Alzheimer's disease using spectral entropies and statistical complexity measures. Journal of neural engineering 9: 036007.
- 10. Fernandez A, Hornero R, Gomez C, Turrero A, Gil-Gregorio P, et al. (2010) Complexity analysis of spontaneous brain activity in Alzheimer disease and mild cognitive impairment: an MEG study. Alzheimer disease and associated disorders 24: 182–189.
- 11.
Buxton RB (2002) Introduction to Functional Magnetic Resonance Imaging.
- 12.
R. Baumgartner RS, R Summers , W Richter , L Ryner (2000) Novelty indices: identifiers of potentially interesting time-courses in functional MRI data. Magnetic Resonance Imaging: 845–850.
- 13. de Araujo DB, Tedeschi W, Santos AC, Elias J Jr, Neves UP, et al. (2003) Shannon entropy applied to the analysis of event-related fMRI time series. NeuroImage 20: 311–317.
- 14. Bassett DS, Nelson BG, Mueller BA, Camchong J, Lim KO (2012) Altered resting state complexity in schizophrenia. NeuroImage 59: 2196–2207.
- 15. Yang AC, Huang CC, Yeh HL, Liu ME, Hong CJ, et al. (2013) Complexity of spontaneous BOLD activity in default mode network is correlated with cognitive function in normal male elderly: a multiscale entropy analysis. Neurobiology of aging 34: 428–438.
- 16. Sokunbi MO, Staff RT, Waiter GD, Ahearn TS, Fox HC, et al. (2011) Inter-individual differences in fMRI entropy measurements in old age. IEEE Trans Biomed Eng 58: 3206–3214.
- 17.
Hu Z, Shi P (2006) Complexity Analysis of fMRI Time Sequences. 2006 IEEE International Conference on Image Processing. Atlanta, GA. pp. 2861–2864.
- 18. Liu CY, Krishnan AP, Yan L, Smith RX, Kilroy E, et al. (2013) Complexity and synchronicity of resting state blood oxygenation level-dependent (BOLD) functional MRI in normal aging and cognitive decline. J Magn Reson Imaging 38: 36–45.
- 19.
Wang Z (2012) Characterizing Resting Brain Information using Voxel-based Brain Information Mapping (BIM). 2012 Annual Meeting of the Organization for Human Brain Mapping. Beijing, China.
- 20.
Wang Z (2012) Stable and Self-Organized Entropy in the Resting Brain. The Third Biennial Conference on Resting State Brain Connectivity. Magdeburg, Germany. pp. 208.
- 21.
Ze Wang AM, Marcus Raichle, Anna Rose Childress, and John A Detre (2013) Mapping brain entropy using resting state fMRI. 2013 Annual Meeting of International Society of Magnetic Resonance in Medicine. Salt Lake City, USA. pp. 4861.
- 22. Richman JS, Moorman JR (2000) Physiological time-series analysis using approximate entropy and sample entropy. American journal of physiology Heart and circulatory physiology 278: H2039–2049.
- 23. Lake DE, Richman JS, Griffin MP, Moorman JR (2002) Sample entropy analysis of neonatal heart rate variability. American journal of physiology Regulatory, integrative and comparative physiology 283: R789–797.
- 24.
Kiebel SJ, Daunizeau J, Friston KJ (2008) A Hierarchy of Time-Scales and the Brain. Plos Computational Biology 4..
- 25.
Li Z, Kadivar A, Pluta J, Dunlop J, Wang Z (2012) Test-retest stability analysis of resting brain activity revealed by blood oxygen level-dependent functional MRI. Journal of magnetic resonance imaging: JMRI.
- 26. Li Z, Zhu Y, Childress AR, Detre JA, Wang Z (2012) Relations between BOLD fMRI-derived Resting Brain Activity and Cerebral Blood Flow. PLoS One 7: e44556.
- 27. Biswal BB, Mennes M, Zuo XN, Gohel S, Kelly C, et al. (2010) Toward discovery science of human brain function. Proceedings of the National Academy of Sciences of the United States of America 107: 4734–4739.
- 28. Fair DA, Cohen AL, Dosenbach NUF, Church JA, Miezin FM, et al. (2008) The maturing architecture of the brain's default network. Proc Natl Acad Sci U S A 105: 4028–4032.
- 29. Murphy K, Birn RM, Handwerker DA, Jones TB, Bandettini PA (2009) The impact of global signal regression on resting state correlations: are anti-correlated networks introduced? Neuroimage 44: 893–905.
- 30.
Andersson J, Smith S., Jenkinson M. (2008) FNIRT — FMRIB' non-linear image registration tool. Human Brain Mapping. Melbourne, Australia. pp. 496.
- 31. Pincus SM (1991) Approximate entropy as a measure of system complexity. Proc Natl Acad Sci U S A 88: 2297–2301.
- 32. Kolmogorov A (1998) On Tables of Random Numbers. Theoretical Computer Science 207: 387–395.
- 33. Palazzolo JA, Estafanous FG, Murray PA (1998) Entropy measures of heart rate variation in conscious dogs. The American journal of physiology 274: H1099–1105.
- 34. Pincus SM, Goldberger AL (1994) Physiological time-series analysis: what does regularity quantify? The American journal of physiology 266: H1643–1656.
- 35. Chen X, Solomon I, Chon K (2005) Comparison of the use of approximate entropy and sample entropy: applications to neural respiratory signal. Conference proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Conference 4: 4212–4215.
- 36.
Wang Z, Childress AR, Wang J, Detre JA (2007) Support Vector Machine Learning-based fMRI Data Group Analysis. NeuroImage 36 : 1139-1151, PMC2717002.
- 37.
Wang Z (2009) A Hybrid SVM-GLM Approach for fMRI Data Analysis. Neuroimage 46: 608–615, PMC2711446.
- 38. Friston KJ, Jezzard P, Turner R (1994) Analysis of Functional MRI Time-Series. Human Brain Mapping 1: 153–171.
- 39. Smith AM, Lewis BK, Ruttimann UE, Ye FQ, Sinnwell TM, et al. (1999) Investigation of low frequency drift in fMRI signal. Neuroimage 9: 526–533.
- 40. Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86: 420–428.
- 41. von Luxburg U (2007) A tutorial on spectral clustering. Statistics and Computing 17: 395–416.
- 42. Craddock RC, James GA, Holtzheimer PE 3rd, Hu XP, Mayberg HS (2012) A whole brain fMRI atlas generated via spatially constrained spectral clustering. Human Brain Mapping 33: 1914–1928.
- 43. Shi JB, Malik J (2000) Normalized cuts and image segmentation. Ieee Transactions on Pattern Analysis and Machine Intelligence 22: 888–905.
- 44. Rousseeuw PJ (1987) Silhouettes - a Graphical Aid to the Interpretation and Validation of Cluster-Analysis. Journal of Computational and Applied Mathematics 20: 53–65.
- 45. Raichle ME, MacLeod AM, Snyder AZ, Powers WJ, Gusnard DA, et al. (2001) A default mode of brain function. PNAS 98: 676–682.
- 46. Hitchcock DR, Lovelock JE (1967) Life detection by atmospheric analysis. Icarus: International Journal of the Solar System 7: 149–159.
- 47.
Lovelock JE (1979) Gaia: A new look at life on Earth. Oxford: Oxford University Press.
- 48. Rakic P (2009) Evolution of the neocortex: a perspective from developmental biology. Nature reviews Neuroscience 10: 724–735.
- 49. Rosso OA, Blanco S, Yordanova J, Kolev V, Figliola A, et al. (2001) Wavelet entropy: a new tool for analysis of short duration brain electrical signals. Journal of neuroscience methods 105: 65–75.
- 50. Damoiseaux JS, Rombouts SA, Barkhof F, Scheltens P, Stam CJ, et al. (2006) Consistent resting-state networks across healthy subjects. Proceedings of the National Academy of Sciences of the United States of America 103: 13848–13853.
- 51. Biswal B, Yetkin FZ, Haughton VM, Hyde JS (1995) Functional Connectivity in the Motor Cortex of Resting Human Brain Using Echo-Planar Mri. Magnetic Resonance in Medicine 34: 537–541.
- 52.
Zhu HT, Shi PC (2006) Interregional functional connectivity via pattern synchrony. 9th International Conference on Control, Automation, Robotics and Vision. Singapore. pp. 1–6.
- 53. Chen CH, Gutierrez ED, Thompson W, Panizzon MS, Jernigan TL, et al. (2012) Hierarchical genetic organization of human cortical surface area. Science 335: 1634–1636.
- 54.
Hyvärinen A (1998) New approximations of differential entropy for independent component analysis and projection pursuit. In: Jordan MI, Kearns MJ, Solla SA, editors. Advances in Neural Information Processing Systems: MIT Press, MA. pp. 273–279.
- 55. Tononi G, Sporns O, Edelman GM (1994) A Measure for Brain Complexity - Relating Functional Segregation and Integration in the Nervous-System. Proceedings of the National Academy of Sciences of the United States of America 91: 5033–5037.
- 56.
Costa M, Goldberger AL, Peng CK (2002) Multiscale entropy analysis of complex physiologic time series. Physical review letters 89..
- 57.
Ze Wang JS, Y Li, Z Singer, R Ehrman, A. V Hole, C. P O'Brien, Anna Rose Childress (2013) Human brain entropy mapping using thousands of subjects and its application in a drug addiction study. 2013 Annual Meeting of Society for Neuroscience. San Diego. pp. 7491.