Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Quantitative Network Measures as Biomarkers for Classifying Prostate Cancer Disease States: A Systems Approach to Diagnostic Biomarkers

Abstract

Identifying diagnostic biomarkers based on genomic features for an accurate disease classification is a problem of great importance for both, basic medical research and clinical practice. In this paper, we introduce quantitative network measures as structural biomarkers and investigate their ability for classifying disease states inferred from gene expression data from prostate cancer. We demonstrate the utility of our approach by using eigenvalue and entropy-based graph invariants and compare the results with a conventional biomarker analysis of the underlying gene expression data.

Introduction

Molecular and clinal biomarkers have been investigated extensively in medicine and related areas [1], [2], [3], [4]. In particular, biomarkers have been used for cancer analysis, cancer screening and stratification and diagnosis [1], [2], [3], [4]. Classically, diagnostic biomarkers represent molecules such that their occurrence or concentration in tissue samples or blood is representative for a certain cancer state, see [5]. Numerous studies have been performed for demonstrating the usefulness and impact of such biomarkers in cancer research and related fields [1], [2], [3], [4].

The above mentioned results dealing with biomarker research are based on the widely accepted classical view that differentially expressed genes can be interpreted as markers of diseases. However, recent research revealed that classical single-gene biomarker are often less meaningful for analyzing diseases than using network-based biomarker, see [6], [7], [8], [9]. Here, pathways representing complex networks [10], [6], [7] serve as biomarkers of diseases. We now briefly sketch relevant related work of so-called network-based biomarkers as follows. For instance, a protein-network-based method for identifying biomarkers subnetworks inferred from protein interaction databases has been developed by Chuang et al. [11]. This method has been proven useful when classifying these subnetworks for disease signature discrimination [11]. A similar approach due to Chen et al. [12] to prioritize disease genes and protein interaction subnetworks turned out to be useful too as these subnetworks can discriminate disease signatures. Guyon et al. [8] used support vector machine classification such that the method takes network interactions into account rather than only single genes. Jin et al. [9] interpreted certain subgraphs, for example triangle graphs, as protein biomarkers and performed a statistical analysis thereof, see [9]. Finally Barabási et al. [13] used, e.g., structural properties of graphs by using centrality measures and degree distributions to find network-based biomarkers via feature selection.

In this paper, we introduce quantitative network measures as structural biomarkers and investigate their ability when classifying disease states inferred from prostate cancer (see section ‘Data’). The problem of finding appropriate network measures which capture structural information uniquely and, therefore, the problem of identifying suitable candidates as structural biomarkers is intricate. This relates to the open problem that it is not a priori clear what kind of structural features could be best as there are infinitely many features that are graph invariants [14], [15] to characterize the structure of pathways (complex networks), see also [14], [16], [17], [18].

The major contribution of this paper is as follows. We use eigenvalues of biological networks inferred from prostate cancer microarray data as structural biomarkers by using supervised learning. More precisely, we demonstrate that these structural biomarkers, representing eigenvalue-based graph invariants, can be used to classify prostate cancer meaningfully; in this context we obtain reasonable results when classifying cancer vs. benign tissue, see also [19].

Methods

Structural Biomarkers

In this paper, we introduce quantitative network measures as structural biomarkers. That means by starting from biological networks inferred from microarray data (see section ‘Data’), we calculate quantitative graph measures representing network complexity measures and employ supervised learning. If these structural features can classify/discriminate disease states, they are referred to as structural biomarkers. In fact, this opens new perspectives in biomarker research as (i) infinitely many structural features (e.g., graph invariants) exist for structural network characterization and (ii) there exist several machine learning and statistical methods to use the derived structural features for classification/discrimination.

As structural biomarkers, we are going to use eigenvalue- and entropy-based quantities. We start by explaining the procedure to derive eigenvalue-based graph invariants. If denotes a network, then eigenvalue-based measures can be calculated by using a graph-theoretical matrix [20] inferred from . Finally we yield.(1)

In this paper, we set and . is the adjacency matrix and is the distance matrix, respectively [17], [20]. By solving the algebraic equation.(2)we obtain the non-zero eigenvalues and . As and are symmetrical for undirected graphs, it holds . From the sketched calculation of the eigenvalues by using inferred from , we define the measures [17], [21], [22]:

(3)(4)(5)(6)(7)and

(8)(9)(10)(11)

In order to calculate the measures concretely by using R, we set . is the laplacian of and are its eigenvalues thereof [23].

The second class of graph measures we employ as structural biomarkers represent entropy measures for graphs. These measures have been investigated extensively by Dehmer et al. [24], [25], [26] and originally by Mowshowitz [27], [28], [29], [30]. Such measures rely on Shannon's entropy and, hence, a probability distributions must be assigned to a graph . This problem is intricate as, again, infinitely many structural features exist (e.g., vertex degrees, vertices, edges, distances, and partitions thereof) to define entropic measures on a network.

Basically, two methods exist to infer a probability distribution of a graph by taking its structural features into account. The first method is based on determining partitions by using an arbitrary graph invariant and equivalence criterion [31], [27]. The second procedure is based on using so-called information functionals and on assigning a probability value to every vertex. Properties of graph entropies based on both methods have been investigated in [24], [25], [26], [16]. As a result of the extensive research in this field of the last three decades, numerous graph entropy measures have been developed, see, e.g., [31], [32], [24], [27], [33], [34]. It would go beyond the scope of the paper to examine all existing graph entropy measures as candidates for structural biomarker. Nevertheless, we used the following entropies from different paradigms (as a result of the feature selection process, see also section ‘Results’) [31], [24]:

  1. Dehmer entropy by using the information functional (vertex centrality), see [24].
  2. Topological Information Content [35].
  3. Graph Vertex Complexity Index [36].
  4. Mean information content of distance-degree equality [31].
  5. Mean information content on the edge equality [31].
  6. Balaban index [37].
  7. Entropic symmetry index [38].
  8. Bonchev index [31].
  9. Dehmer-entropy by using the information functional (-spheres), see [24].
  10. Bonchev index [31].

The concrete formulas thereof and the technical details can be found in [31], [24].

Data

The data set we use in this paper has never been used for classification cancer disease states. To create the set of biological networks, we used seven publicly available data sets (see Table 1) related to prostate cancer from NCBI GEO [39] and EBI Arrayexpress [40]. The data sets have been selected in cooperation with the Urology Department at the Medical University Innsbruck to identify transcriptional changes in prostate cancer, including tumors with ERG gene rearrangements, see [19]. A first result by using this data has been achieved by Massoner et al. [19] as they found robust population-independent transcriptional changes and signs of ERG rearrangements inducing metabolic changes in cancer cells by activating major metabolic signaling molecules like NPY.

thumbnail
Table 1. This table lists the public data sets we used to infer this set of biological networks.

https://doi.org/10.1371/journal.pone.0077602.t001

We reanalyzed the publicly available data sets (see Table 1) and inferred biological networks by using the C3NET inference method [41]. This resulted in seven C3NET networks representing the benign tissue (from the control group) and seven networks representing cancer tissue. Here, benign means that we refer to sick patients with a tumor.

In order to obtain a larger set of networks, we used the gene ontology (GO) database [42] to extract subgraphs from these networks. For each network and each GO-term in the category ‘biological process’, we extract one subgraph containing the genes associated with this specific GO-term resulting in and 108 networks representing benign and cancer tissue, respectively. We determined the GO-terms by using the Bioconductor Package goProfiles.

The resulting sizes of the obtained classes are potentially different because the network structures of and are different and, hence, not all pathways are captured by these networks. Furthermore, we exclude a subnetwork whenever it contains less that genes associated with a specific GO-term. The obtained two sets of networks can be interpreted as an approximation of two populations. One population represents the benign state and the second the cancerous state. We note that this set of biological networks has already been used in [43] when demonstrating the functionality of the recently developed R-package QuACN.

Results

Classification: Prostate Cancer Networks vs. Gene Expression Biomarkers

In order to evaluate the performance of the new structural biomarkers, we compare the classification of the networks with the classification of the gene expression data itself by using supervised learning. To classify the normalized gene expression data by using the data sets described in section ‘Data’, we combined the samples of the seven studies (see Table 1) by determining the intersection of the measured genes. This results in a feature vector that contains all genes that are measured in each of the seven different studies. In order to select the most important genes, we apply a feature selection mechanism based on the information gain method [44]. Then we classify the data set by using the 10 most important features as a feature vector by using SVM classification [45] with a polynomial kernel function. For performing the classification, we apply the R-implementation of Libsvm [46] and for learning the optimal parameters, we perform a 10-fold cross validation.

In order to obtain the best classification performance we assess the following parameter settings for the classification exhaustively:(12)and

(13)For the three studied measures, their results in form of error measures of the classification are summarized in Table 2. For these measure, we found the optimal parameter settings used for this analysis: , , (eigenvalue-based measures), , , (entropy-based measures) and , , (gene expression data).

thumbnail
Table 2. Error measures (mean values and standard errors) for the evaluation of the classification. Best results are highlighted in bold.

https://doi.org/10.1371/journal.pone.0077602.t002

From our numerical classification of the data, summarized in Table 2, it follows that the network approach based on eigenvalues (second column) and the biomarker analysis of the gene expression data (forth column) perform best. Specifically, the classification of the gene expression biomarkers is always best but the eigenvalue method results in a comparable performance, within one standard error. Due to the fact that all error measures are random variables, estimated from a -fold cross validation, it appears sensible to consider performance intervals, given by the mean and standard error, rather than point estimators. This will lead to more robust statements regarding the obtained performance values.

In contrast to the eigenvalue and gene expression biomarker method, the classification method based on the entropies of networks results in the lowest performance for all error measures, however, still giving a sensible classification performance indicating that also this method is capable for discriminating the two biological classes, at least to a certain extent.

Eigenvalue-based Structural Analysis of the Prostate Cancer Networks

In this section, we examine some properties of the eigenvalues by using the prostate cancer networks representing two classes (cancer and benign tissue). First results are summarized in Figure 1, 2 and Figure 3, 4. We plotted all eigenvalues for the cancer and benign networks by employing the adjacency and distance matrix, respectively. By using the adjacency matrix, the eigenvalues of the benign networks show a characteristic distribution where nearly all eigenvalues are situated in a horizontal strip. In fact, 64% of these eigenvalues are negative and 36% are positive. The plot of the cancer networks by employing the adjacency looks very similar. Here, the ratio of positive and negative eigenvalue is the same as by using the benign networks. The fact that these distributions look similar can be also explained by arguing with the corresponding zero-free regions (e.g., strip-like regions in which no zeros of the characteristic polynomial lie). As mentioned in section ‘Structural Biomarkers’, eigenvalues are the zeros (that means the solutions of the equation ) of the characteristic polynomial by using a graph-theoretical matrix (here, we use and ). Then, we see that the zero-free regions of benign vs. cancer networks by using the adjacency matrix look very similar. But from this, we cannot conclude that eigenvalues are generally unsuitable for discriminating the two network classes as seen in section ‘Classification: Prostate Cancer Networks vs. Gene Expression Biomarkers’. By using the distance matrix, we yield the eigenvalue-ratios 74% negative and 26% positive for benign; 76% negative and 24% for cancer networks. In contrast to the distributions by using the adjacency matrix, the horizontal strips and, hence, the zero-free regions are different. This can be understood by analyzing the distributions of the matrix elements of the adjacency and distance matrix. The fact that those are different also implies that the coefficients of the resulting characteristic polynomials differ significantly.

thumbnail
Figure 1. Distributions of the Eigenvalues of the adjacency matrix for the benign networks.

https://doi.org/10.1371/journal.pone.0077602.g001

thumbnail
Figure 2. Distributions of the Eigenvalues of the adjacency matrix for the cancer networks.

https://doi.org/10.1371/journal.pone.0077602.g002

thumbnail
Figure 3. Distributions of the Eigenvalues of the distance matrix for the benign networks.

https://doi.org/10.1371/journal.pone.0077602.g003

thumbnail
Figure 4. Distributions of the Eigenvalues of the distance matrix for the cancer networks.

https://doi.org/10.1371/journal.pone.0077602.g004

In summary, we may conclude that certain eigenvalue-based measures by using the adjacency and distance matrix capture structural information differently. Here, this could mean that some of these measures by using the distance matrix are more sensitive toward slight structural changes in the network. The validity of this hypothesis can be underpinned by evaluating the discrimination power of eigenvalue-based measures. This relates to determine whether the measure captures structural information uniquely, see [47], [16], [14]. For instance, if the network structure is slightly altered, the measure should detect this structural change by giving distinguishable values. In this paper, we measure the discrimination power or uniqueness by the quantity, , expressing the non-distinguishable values by a particular eigenvalue-based measure. That is to calculate ndv, we compute all measures on the networks and determine the number of graphs which cannot be distinguished by them. Importantly, the networks need to be structurally non-equivalent (non-isomorphic) to perform this study meaningfully; we emphasize that the cancer networks used in this study have been checked to be structurally non-equivalent. By inspecting Table 3, we see first of all that many of the computed eigenvalue-based measures are fully unique; *to normalize the values, we employed Konstantinova's sensitivity measure , see [48], [17].* That means they structurally distinguish the networks by their values uniquely. The only measure that produces degenerate values is , see Equation 5. Moreover, we observe that is more unique than that can be seen by the ndv-values. Thus, we may conclude that the distance matrix encodes structural information more meaningfully than by using the adjacency matrix when employing the measure .

thumbnail
Table 3. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for all prostate cancer networks and the corresponding subgroups (benign/cancer).

https://doi.org/10.1371/journal.pone.0077602.t003

Note that the supplementary files (File S1, S2, S3) contain the values of the calucated networks.

Discussion and Conclusion

Within recent years there is a considerable interest in the identification of biomarkers within genomic datasets. Usually, if gene expression data are used from DNA microarray experiments, a biomarker is considered as a gene, or a set of genes, for which gene expression data are available. Then, classification methods are based on the gene expression data of these biomarkers leading to biologically interpretable results with respect to their classification abilities, e.g., for diagnostic purposes. In contrast, in this paper we assumed structural biomarkers, derived from gene regulatory networks inferred from gene expression data, and used these to conduct a classification of disease states. From our numerical analysis we found that gene expression biomarkers and eigenvalue-based features perform similarly, although, the gene expression biomarkers perform slightly better.

This result is interesting because it demonstrates, first, a biomarker does not need to be a gene but it can be an abstract property of a biological system, e.g., eigenvalue-based network measures, as in our case. In principle this idea is not new. However, what is new is that we demonstrate this explicitly by giving an example for structural biomarkers. As such, we provide practical evidence to this argument which usually is only discussed argumentatively instead of numerically. Second, the way our structural biomarkers are defined does no longer allow to say, e.g., ‘gene A and gene B’ are able to distinguish the biological conditions under consideration. Instead, our features, respectively biomarkers, correspond to features of the system and are as such gene independent, but reflect their collective properties, as captured by the inferred gene regulatory networks. Hence, our approach represents a practical realization of systems medicine.

For a future analysis it would be interesting to use protein expression data rather than gene expression data to repeat a similar analysis. Such an analysis would allow to gain insights into the robustness of our results with respect to a change of the molecular level, as provided by protein interactions. Specifically, it would help to understand if pure [49] or mixed interaction types, as represented by gene regulatory networks, are better suited for constructing structural biomarkers.

Overall, our results provide promising evidence that none-gene biomarkers can be a beneficial means to classify disease states from gene expression data for diagnostic purposes.

Appendix

For completeness, in the Tables 4, 5, 6, 7, 8, 9, 10 we show the same results as in Table 3 but for the individual data sets, as listed in Table 1.

thumbnail
Table 4. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [50].

https://doi.org/10.1371/journal.pone.0077602.t004

thumbnail
Table 5. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [51].

https://doi.org/10.1371/journal.pone.0077602.t005

thumbnail
Table 6. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [52].

https://doi.org/10.1371/journal.pone.0077602.t006

thumbnail
Table 7. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [53].

https://doi.org/10.1371/journal.pone.0077602.t007

thumbnail
Table 8. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [54].

https://doi.org/10.1371/journal.pone.0077602.t008

thumbnail
Table 9. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [55].

https://doi.org/10.1371/journal.pone.0077602.t009

thumbnail
Table 10. ndV-values for the structural biomarkers (eigenvalue and entropy-based measures) for prostate cancer networks and the corresponding subgroups (benign/cancer) for [56].

https://doi.org/10.1371/journal.pone.0077602.t010

Supporting Information

File S1.

R data file containing descriptor values.

https://doi.org/10.1371/journal.pone.0077602.s001

(ZIP)

File S2.

Excel file containg the descriptor values by using eigenvalue-based measures.

https://doi.org/10.1371/journal.pone.0077602.s002

(CSV)

File S3.

Excel file containg the descriptor values by non-eigenvalue-based measures.

https://doi.org/10.1371/journal.pone.0077602.s003

(CSV)

Author Contributions

Analyzed the data: LM FES. Wrote the paper: MD FES LM.

References

  1. 1. Jain KK (2010) The Handbook of Biomarkers. Humana Press.
  2. 2. Mayeux R (2004) Biomarkers: potential uses and limitations. NeuroRx 1: 182–188.
  3. 3. Wang YC, Chen BS (2011) A network-based biomarker approach for molecular investigation and diagnosis of lung cancer. BMC Medical Genomics 2011 4.
  4. 4. Wang X (2011) Role of clinical bioinformatics in the development of network-based biomarkers. Journal of Clinical Bioinformatics 1.
  5. 5. Rahman M, Zhang F, Hasan MA, Chen JY (2011) A method for designing robust subgraph signatures for cancer biomarker development. Technical report, Department of Computer and Information Science, IUPUI, Indianapolis, USA.
  6. 6. Emmert-Streib F, Dehmer M, editors (2010) Analysis of Microarray Data: A Network-based Approach. Wiley VCH Publishing.
  7. 7. Emmert-Streib F (2007) The chronic fatigue syndrome: A comparative pathway analysis. Journal of Computational Biology 14.
  8. 8. Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Machine Learning 46: 389–422.
  9. 9. Jin G, Zhou X, Wang H, Zhao H, Cui K, et al. (2008) The knowledgeintegrated network biomarkers discovery for major adverse cardiac events. Journal of Proteome Research 7: 4013–4021.
  10. 10. Dehmer M, Emmert-Streib F, Graber A, Salvador A, editors (2011) Applied Statistics for Network Biology. Quantitative and Network Biology. Wiley VCH Publishing.
  11. 11. Chuang HY, Lee E, Liu YT, Lee D, Ideker T (2007) Network-based classification of breast cancer metastasis. Molecular Systems Biology 3.
  12. 12. Chen J, J A, Jegga AG (2009) Disease candidate gene identification and prioritization using protein interaction networks. BMC Bioinformatics 10.
  13. 13. Barabási AL, Gulbahce N, Loscalzo J (2011) Network medicine: A network-based approach to human disease. Nature Reviews Genetics 12: 56–68.
  14. 14. Dehmer M, Grabner M, Mowshowitz A, Emmert-Streib F (2012) An efficient heuristic approach to detecting graph isomorphism based on combinations of highly discriminating invariants. Advances in Computational Mathematics.
  15. 15. Harary F (1969) Graph Theory. Addison Wesley Publishing Company. Reading, MA, USA.
  16. 16. Dehmer M, Grabner M, Varmuza K (2012) Information indices with high discriminative power for graphs. PLoS ONE 7: e31214.
  17. 17. Dehmer M, Sivakumar L, Varmuza K (2012) Uniquely discriminating molecular structures using novel eigenvalue-based descriptors. MATCH Communications in Mathematical and in Computer Chemistry 67: 147–172.
  18. 18. Dorogovtsev SN, Mendes JFF (2003) Evolution of Networks. From Biological Networks to the Internet and WWW. Oxford University Press.
  19. 19. Massoner P, Kugler KG, Unterberger K, Kuner R, Mueller LA, et al. (2013) Characterization of Transcriptional Changes in ERG Rearrangement-Positive Prostate Cancer Identifies the Regulation of Metabolic Sensors Such as Neuropeptide Y. PloS one. 8: e55207.
  20. 20. Janežić D, Miležević A, Nikolić S, Trinajstić N (2007) Graph-Theoretical Matrices in Chemistry. Mathematical Chemistry Monographs. University of Kragujevac and Faculty of Science Kragujevac.
  21. 21. Estrada E (2002) Characterization of the folding degree of proteins. Bioinformatics 18: 697–704.
  22. 22. Gutman I, Li X, Zhang J (2009) Graph energy. In: Dehmer M, Emmert-Streib F, editors, Analysis of Complex Networks: From Biology to Linguistics, Wiley-VCH. 145–174.
  23. 23. Gutman I, Zhou B (2006) Laplacian energy of a graph. Linear Algebra and its Applications 414: 29–37.
  24. 24. Dehmer M, Mowshowitz A (2011) A history of graph entropy measures. Information Sciences 1: 57–78.
  25. 25. Dehmer M, Mowshowitz A (2011) Generalized graph entropies. Complexity 17: 45–50.
  26. 26. Dehmer M, Mowshowitz A, Emmert-Streib F (2011) Connections between classical and parametric network entropies. PLoS ONE 6: e15733.
  27. 27. Mowshowitz A (1968) Entropy and the complexity of the graphs I: An index of the relative complexity of a graph. Bull Math Biophys 30: 175–204.
  28. 28. Mowshowitz A (1968) Entropy and the complexity of graphs II: The information content of digraphs and infinite graphs. Bull Math Biophys 30: 225–240.
  29. 29. Mowshowitz A (1968) Entropy and the complexity of graphs III: Graphs with prescribed information content. Bull Math Biophys 30: 387–414.
  30. 30. Mowshowitz A (1968) Entropy and the complexity of graphs IV: Entropy measures and graphical structure. Bull Math Biophys 30: 533–546.
  31. 31. Bonchev D (1983) Information Theoretic Indices for Characterization of Chemical Structures. Research Studies Press, Chichester.
  32. 32. Bonchev D (2009) Information theoretic measures of complexity. In: Meyers R, editor, Encyclopedia of Complexity and System Science, Springer, volume 5: 4820–4838.
  33. 33. Mowshowitz A, Dehmer M (2012) Entropy and the complexity of graphs revisited. Entropy 14: 559–570.
  34. 34. Körner J (1973) Coding of an information source having ambiguous alphabet and the entropy of graphs. Transactions of the 6-th Prague Conference on Information Theory: 411–425.
  35. 35. Rashevsky N (1955) Life, information theory, and topology. Bull Math Biophys 17: 229–235.
  36. 36. Raychaudhury C, Ray SK, Ghosh JJ, Roy AB, Basak SC (1984) Discrimination of isomeric structures using information theoretic topological indices. Journal of Computational Chemistry 5: 581–588.
  37. 37. Balaban AT, Balaban TS (1991) New vertex invariants and topological indices of chemical graphs based on information on distances. J Math Chem 8: 383–397.
  38. 38. Mowshowitz A, Dehmer M (2010) A symmetry index for graphs. Symmetry: Culture and Science 21: 321–327.
  39. 39. Edgar R, Domrachev M, Lash A (2002) Gene Expression Omnibus: NCBI Gene Expression and Hybridization Array Data Repository. Nucleic Acids Research 30: 207–210.
  40. 40. Parkinson H, Kapushesky M, Kolesnikov N, Rustici G, Shojatalab M, et al. (2009) ArrayExpress Update From an Archive of Functional Genomics Experiments to the Atlas of Gene Expression. Nucleic Acids Research 37: D868–D872.
  41. 41. Altay G, Emmert-Streib F (2010) Inferring the conservative causal core of gene regulatory networks. BMC Systems Biology 4: 132.
  42. 42. Harris M, Clark J, Ireland A, Lomax J, Ashburner M, et al. (2004) The Gene Ontology (GO) Database and Informatics Resource. Nucleic acids research 32: D258.
  43. 43. Mueller L, Kugler K, Graber A, Emmert Streib F, Dehmer M (2011) Structural Measures for Network Biology Using QuACN. BMC Bioinformatics 12: 492.
  44. 44. Quinlan RJ (1993) C4.5: Programs for Machine Learning. CA, USA: Morgan Kaufmann.
  45. 45. Cristianini N, Shawe-Taylor J (2000) An Introduction to Support Vector Machines. Cambridge University Press. Cambridge, UK.
  46. 46. Meyer D, Dimitriadou E, Hornik K, Weingessel A, Leisch F (2012) e1071: Misc Functions of the Department of Statistics (e1071), TU Wien. URL http://CRAN.R-project.org/package=e1071. R package version 1.6–1.
  47. 47. Bonchev D, Mekenyan O, Trinajstić N (1981) Isomer discrimination by topological information approach. J Comp Chem 2: 127–148.
  48. 48. Konstantinova EV (1996) The discrimination ability of some topological and information distance indices for graphs of unbranched hexagonal systems. J Chem Inf Comput Sci 36: 54–57.
  49. 49. Arias CR, Yeh HY, Soo SW (2012) Biomarker identification for prostate cancer and lymph node metastasis from microarray data and protein interaction network using gene prioritization method. Scientific World Journal: 24873.
  50. 50. Chandran UR, Ma C, Dhir R, Bisceglia M, Lyons Weiler M, et al. (2007) Gene Expression Profiles of Prostate Cancer Reveal Involvement of Multiple Molecular Pathways in the Metastatic Process. BMC Cancer 7: 64.
  51. 51. Liu P, Ramachandran S, Seyed MA, Scharer CD, Laycock N, et al. (2006) Sex-Determining Region Y Box 4 is a Transforming Oncogene in Human Prostate Cancer Cells. Cancer Research 66: 4011–4019.
  52. 52. Singh D, Febbo PG, Ross K, Jackson DG, Manola J, et al. (2002) Gene Expression Correlates of Clinical Prostate Cancer Behavior. Cancer Cell 1: 203–209.
  53. 53. Tsavachidou D, McDonnell TJ, Wen S, Wang X, Vakar Lopez F, et al. (2009) Selenium and Vitamin E: Cell Type–and Intervention-Specific Tissue Effects in Prostate Cancer. Journal of the National Cancer Institute 101: 306–320.
  54. 54. Wallace TA, Prueitt RL, Yi M, Howe TM, Gillespie JW, et al. (2008) Tumor Immunobiological Differences in Prostate Cancer Between African-American and European-American Men. Cancer Research 68: 927–936.
  55. 55. Varambally S, Yu J, Laxman B, Rhodes DR, Mehra R, et al. (2005) Integrative Genomic and Proteomic Analysis of Prostate Cancer Reveals Signatures of Metastatic Progression. Cancer Cell 8: 393–406.
  56. 56. Yu YP, Landsittel D, Jing L, Nelson J, Ren B, et al. (2004) Gene Expression Alterations in Prostate Cancer Predicting Tumor Aggression and Preceding Development of Malignancy. Journal of Clinical Oncology 22: 2790–2799.