Probing the Topological Properties of Complex Networks Modeling Short Written Texts

Diego R. Amancio

doi:10.1371/journal.pone.0118394

Abstract

In recent years, graph theory has been widely employed to probe several language properties. More specifically, the so-called word adjacency model has been proven useful for tackling several practical problems, especially those relying on textual stylistic analysis. The most common approach to treat texts as networks has simply considered either large pieces of texts or entire books. This approach has certainly worked well—many informative discoveries have been made this way—but it raises an uncomfortable question: could there be important topological patterns in small pieces of texts? To address this problem, the topological properties of subtexts sampled from entire books was probed. Statistical analyses performed on a dataset comprising 50 novels revealed that most of the traditional topological measurements are stable for short subtexts. When the performance of the authorship recognition task was analyzed, it was found that a proper sampling yields a discriminability similar to the one found with full texts. Surprisingly, the support vector machine classification based on the characterization of short texts outperformed the one performed with entire books. These findings suggest that a local topological analysis of large documents might improve its global characterization. Most importantly, it was verified, as a proof of principle, that short texts can be analyzed with the methods and concepts of complex networks. As a consequence, the techniques described here can be extended in a straightforward fashion to analyze texts as time-varying complex networks.

Citation: Amancio DR (2015) Probing the Topological Properties of Complex Networks Modeling Short Written Texts. PLoS ONE 10(2): e0118394. https://doi.org/10.1371/journal.pone.0118394

Academic Editor: Satoru Hayasaka, Wake Forest School of Medicine, UNITED STATES

Received: September 10, 2014; Accepted: January 15, 2015; Published: February 26, 2015

Copyright: © 2015 Diego R. Amancio. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

Data Availability: All relevant data are within the paper and its Supporting Information files.

Funding: DRA acknowledges financial support from São Paulo Research Foundation (FAPESP) (grant numbers 2014/20830-0 and 2015/00329-8). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The author has declared that no competing interests exist.

Introduction

Graph theory has been employed to probe the statistical properties of many real systems [1]. Most of the real networks share the small-world [2] and scale-free [3] properties. The last fifteen years have witnessed the increase of networked models in interdisciplinary applications, including implementations in Physics [4, 5], Social Sciences [6–8], Biology [9, 10], Neuroscience [11, 12], Cognitive Sciences [13, 14], Music [15] and Computer Sciences [16]. In the latter, graph-based techniques have been applied to the analysis and construction of software architecture [17], supervised classifiers [18], spam filters [19] and natural language processing (NLP) systems [20]. For the purpose of textual analysis, networks have proven relevant not only to improve the performance of NLP tasks [21–23], but also to better understand the emergent patterns and mechanisms behind the origins of the language [20].

Due to its interdisciplinary nature, graph theory can be employed to study the various levels of complexity of the language. In the neuroscience field, the network framework turned out to be a powerful tool for representing the topology of neural systems, where the neocortex is responsible for conveying information [24]. Among several findings, it has been shown that the clustering and small-world effects facilitate local and global processes, respectively [14]. The connection between neuroscience and language/mind processing has been investigated in terms of the topological properties of the connectome [25]. Interestingly, it has been found that some linguistic impairments account for fluctuations in the properties of several networks representing brain organization [26–28]. At the cognitive level, networks have proven useful to unveil the mechanisms behind information processing [29]. In this context, some studies link certain diseases with specific characteristics of semantic free-association networks [30], while other investigations relate topological network properties with cognitive complexity. For example, the authors in [31] found that the recognition of a word depends on the average clustering coefficient of the network. Another example is the use of network measurements for quantifying the cognitive complexity of finding the way out of mazes [32].

Network-based models have been applied to study several levels of language organization, which encompasses both the syntactical [33, 34] and the semantical level [35–40]. A well-known model is the so-called word adjacency network, which consists in linking adjacent words. Since this model reflects mostly syntactical and stylistic factors [41], it has been successfully employed for syntactical complexity analysis [42], detection of literary movements [43] and for stylometry [44, 45]. In most applications, it has been assumed the availability of long texts (or books) to perform statistical analyses [18, 33, 41, 45–48]. Unfortunately, in many real-world situations, the available of large pieces of texts is uncertain. Whenever only very short pieces of text are available, the conclusions drawn from the analysis could be invalid due to statistical fluctuations present in short written texts. In addition, the unavoidable noise pervading short texts could undermine the performance of NLP tasks. Therefore, it becomes of paramount importance to know beforehand if a given text is long enough for the analysis. In this context, this paper investigates how the selection of short pieces of texts (hereafter referred to as samples) affects the topological analysis of word adjacency networks.

In order to study the fluctuations of networks measurements modeling short texts, books were sampled in adjacent, non-overlapping subtexts. As I shall show, the sampling of texts yields subtexts with similar topology, as revealed by a systematic analysis of the variability of several measurements across distinct samples. The influence of the subtext length on the authorship recognition task was also studied. The results revealed that the best performance was achieved when the books were split in shorter subtexts, which confirms that the sampling might favor the classification process as the local topological characterization of books becomes more precise.

Materials and Methods

In this section, the word adjacency model is presented. In addition, I swiftly describe the measurements employed for characterizing networks and the methods used for recognizing topological patterns.

Modeling texts as complex networks

The overall purpose of this paper is to study features of the language that reflect particular choices made by individuals or groups. Such particular choices, referred to as stylistic features, can be employed e.g. to classify genres, dialects and literary works [20]. A traditional stylistic feature used e.g. to identify authorship is the frequency of a particular function word in a text [49]. Here, a network model is used to capture particular connectivity patterns that might be useful to identify authorship, genres, languages etc.

There are several ways to model texts as complex networks [50]. The most appropriate modeling depends on the target application. One of the most employed models for grasping stylistic features is the so-called co-occurrence (or adjacency network) [41, 46]. Besides capturing syntactical attributes of the texts, networked models have also proven useful to capture language dependent features [41]. Co-occurrence networks have been employed in many applications [50]. In generic terms, a co-occurrence network can be defined in a manifold way: two words are linked if they co-occur in at least one window. The window can be represented as n-grams, sentences, paragraphs or even entire documents [51]. Some alternative co-occurrence models link two words only if the co-occurrence frequency exceeds a given threshold. There is also the possibility to improve the model by including weighted links [52]. Statistical analysis revealed that most word co-occurrence networks display both small-world and scale-free behaviors [53]. The average clustering coefficient and the average nearest neighbor degrees were found to follow a power-law distribution, as a consequence of the existence of distinct functional classes of words [54]. Particularly, it has been shown adjacency and syntactic networks display similar topological properties, as far as topological attributes are considered [33]. Besides being useful for analyzing styles in texts, co-occurrence graphs serve to model semantical relationships [55, 56].

Prior to the transformation of the text into a network model, some pre-processing steps are usually applied. Firstly, words conveying low semantic content (such as articles and prepositions) are removed. These words, referred to as stopwords, are disregarded from the analysis because they simply serve to connect content words. Even though previous studies used the frequency of stopwords to classify texts according to their styles, I decided not to use them because I am interested in the relationships between words with significant semantic content. This procedure has been applied in many studies (see e.g. [44, 54, 57, 58]). In the next step, each word is transformed into its canonical form so that conjugated verbs and nouns are respectively mapped to their infinitive and singular forms. As such, distinct forms of the same word are mapped to the same concept. To obtain the canonical form of words, it is necessary to perform a sense disambiguation [51] at the word level. To assist the disambiguation process, the part-of-speech of each word is inferred from a maximum entropy model [59].

After the pre-processing step, each distinct word remaining in the text becomes a node in the network. Therefore, the total number of nodes will be given by the vocabulary size of the pre-processed text. Edges linking two words are created if these words appeared as neighbors in the text at least once. For example, in the short sentence “Complex network measurement”, the following links are created: complex → network and network → measurement. In this case, complex and measurement are not connected to each other because they are separated by one intermediary word. Particularly, this model was chosen here because it has been successfully used in applications where authors’ styles represent an important feature for analyzing written texts [53, 60]. Table 1 and Fig. 1 illustrate the creation of a word adjacency network.

Download:

Table 1. Pre-processing steps.

https://doi.org/10.1371/journal.pone.0118394.t001

Download:

Fig 1. Example of adjacency network.

In this example, the network was created from the extract: “Complex networks model several properties of texts. A complex text displays a complex organization”. After the pre-processing step, words are mapped into nodes, which in turn are connected if the respective words appeared at least once as neighbors.

https://doi.org/10.1371/journal.pone.0118394.g001

Topological characterization of textual networks

The topological analysis of complex networks can be conducted through the use of a myriad of measurements. In the current study, we employed the main measurements that have been used in the analysis of word adjacency networks. The quasi-local topology, which considers the connectivity of neighbors, neighbors of neighbors and further hierarchies [61], was measured with the clustering coefficient (C) and with the average neighbor degree (k_n). Both measurements have been employed to identify words appearing in generic contexts [58]. In addition to these measurements, the accessibility (α) was used to characterize the quasi-local structure of textual networks. To define this measurement, consider that $P_{i j}^{(h)}$ represents the probability of a random walker starting at node v_i to reach node v_j in h steps. Mathematically, the accessibility $α_{i}^{(h)}$ is defined as the entropy of the quantity $P_{i j}^{(h)}$ : (1)

It has been show that, when the walker performs a self-avoiding random walk, the accessibility is useful to identify the core of textual networks [62]. Moreover, this measurement has proven useful to generate informative extractive summaries [34].

In addition to the quasi-local measurements, we also employed some global measurements. The average shortest path length (l) was used because this measurement has been useful in several textual applications [58]. Usually, the words taking the lowest values of l are either keywords or words that appear near to the most relevant words in the text. Shortest paths were also employed in the so called betweenness (B) [63]. In textual networks, the betweenness grasps the amount of contexts in which a given word may occur [58]. Differently from the clustering coefficient, the betweenness uses the global information of the network to infer the quantity of semantic contexts in which a word occurs.

The spatial distribution of words along the text was studied in terms of the intermittency, a measurement that is is able to capture the irregularity (bursts) of the distribution [64]. To compute the intermittency, one represents the pre-processed text as a time series. As a consequence, the first word is the first element of the time series, the second word is the second element and so forth. The recurrence time t_i of a word w is defined as the number of words between two successive occurrences of w. Therefore, a word occurring N times in the text generates the sequence T = {t₁,t₂,…,t_N−1} of recurrence times. In order to consider the time t_I until the first occurrence of the word and the time t_F after the last occurrence, this measurement considers also the time t_N = t_I+t_F in T. If ⟨t⟩ is the mean of the elements in T, then the intermittency I of the distribution T is (2) The intermittency has been employed to identify keywords using features not correlated with word frequencies [64]. Moreover, this measurement has proven useful to classify texts according to the informativeness criterium [41].

Pattern recognition methods

In this study, we investigated if the topology of small pieces of texts is able to provide relevant attributes for textual analysis. To quantify the effects of sampling large texts in applications based upon the classification of distinct styles, supervised pattern recognition methods were used [65]. In a supervised classification problem, we are given a training set and a test set. The training set 𝒮_tr = {β_(tr,1),β_(tr,2),…,β_(tr,n)} is the set of examples that inference algorithms employ to generate classification models. After the creation of the classification model, the test dataset 𝒮_ts = {β_(ts,1),β_(ts,2),…,β_(ts,m)} is employed to evaluate the classification performance. The result of the classification is the mapping 𝒮_ts ↦ 𝒞 = {c₁,c₂,…}. In other words, a conventional classifier assigns a unique class c_i ∈ 𝒞 for each element of the training set. For each example β, the value of the attribute F_i taken by β is represented as β⁽ⁱ⁾. The performance of the classification was verified with the well known 10-fold cross-validation technique [65].

The supervised classifiers employed in this paper were: nearest neighbors (kNN) [66], decision trees (C4.5) [67], bayesian decision (Bayes) [68] and support vector machines (SVM) [69]. Below I present a swift description of these methods. Further details can be found in [65].

Nearest neighbors: this technique classifies a new example β ∈ 𝒮_ts according to a voting process performed on 𝒮_tr. If most of the κ nearest neighbors of β belongs to the class c_i ∈ 𝒞, then the class c_i is associated to β_ts.

Bayesian decision: this method computes the probability P(c_i∣β) that a given class c_i ∈ 𝒞 is the correct class associated to a given instance β_(ts). Assuming that the attributes are independent, P(c_i∣β) can be computed as (3)

Therefore, the correct class c_β is (4)

Decision trees: this algorithm is based upon the induction of a tree, a widely employed abstract data type. To construct a tree model, it is necessary to find the most informative attribute, i.e. the attribute that provides the best discriminability of the data. To do so, several measurements have been proposed [65]. In this paper, we use the information gain Ω, which is mathematically defined as (5) where $𝓗 (𝓢_{t r})$ is the entropy of the dataset $𝓢_{t r}$ and $𝓗 (𝓢_{t r} | F_{k})$ is the entropy of the dataset when the value of F_k is specified. $𝓗 (𝓢_{t r} | F_{k})$ can be computed from the training dataset as (6) where V(F_k) is the set of all values taken by the attribute F_k in the training dataset, i.e. (7)

Support Vector Machines: this technique divides the attribute space using hyperplanes, so that each region is assigned to a single class. The construction of the hyperplanes relies upon the definition of linear or non-linear kernel functions. Once the separation is determined, a new example can be classified by evaluating its position on the attribute space. This method has been applied in several real applications due to its robustness with regard to the number of dimensions and other features [70].

Results

Variability of measurements

In this paper, a set of subtexts sampled from a entire book is considered as consistent when the measurements computed for the subtexts display low variability across different subtexts. I take the view that authors tend to keep their styles across distinct portions of the same book. This assumption is reasonable because it has been shown that the main factors responsible for stylistic variations in texts are the language [41], the authorship [58], the complexity [42] and the publication date [43]. As such, it is natural to expect low variability across distinct samples since all these factors remain constant in the same book. Hence, I consider that the main factor accounting for the variability of the style across distinct parts of the same book is the sample size.

In order to compute the variability of the measurements across distinct subtexts, the following procedure was adopted. A dataset comprising 50 novels (see Table 2 and the S1 Dataset) was used. Each book was split in subtexts comprising W tokens. If one considers a book as a sequence of tokens $𝓦 = {w_{1}, w_{2}, \dots}$ , the subtext $T_{i}$ will contain the sequence {w_{S_i},w_{S_i+1},…,w_{S_i+W}}, where S_i = W⋅i+1 and $i \in ℕ$ . The variability of a given measurement X across distinct subtexts $T_{i}$ ’s of a given full book will be given by the coefficient of variation (8) The variability of the following measurements were investigated in the current paper where ⟨…⟩, Δ and γ represent the mean, the standard deviation and the skewness of the distribution of the measurements in a given subtext. The accessibility was used to measure the prominence of a given word considering its nearest concentric neighborhood (h = 2 and h = 3). Higher values of h were not employed because the accessibility computed in higher levels is not informative [61]. The clustering coefficient and the average nearest neighbors degrees were used to quantify the connectivity between neighbors. The global prominence was measured with the average shortest path lengths and betweenness. Finally, the intermittency was employed to quantify the relevance of the words according to their spatial distribution along the text.

Download:

Table 2. List of Books.

https://doi.org/10.1371/journal.pone.0118394.t002

The variability obtained for each X across distinct subtexts is shown in Fig. 2. The results confirm the the variability ν(X) of all measurements studied shows the same behavior, as revealed by a decreasing tendency as W increases. This means that the statistical fluctuations across distinct subtexts decrease as larger portions of subtexts are considered. The majority of the measurements displayed a variability below 0.35 for W ≥ 1,500. The average accessibility displayed a typical coefficient of variation below 0.20 for W ≥ 1,500. The average neighbor degree turned out to be the measurement taking the lowest values of variability. Even when very small pieces of texts were taken into account (W = 300), the typical variability was always below 0,20. The average betweenness also took low values of variability for small subtexts. However, the lowest values were found for W ≥ 1,500. The average clustering coefficient was one of the measurements whose variability across subtexts displayed a high dependence upon W. More specifically, for small subtexts, ⟨C⟩ turned out to be unstable, as revealed by coefficient of variations surpassing ν = 0.65. This result shows that ⟨C⟩ should not be employed for the topological analysis of small texts because it is very sensitive to the sampling size. Concerning the intermittency, both ⟨I⟩ and ΔI displayed low values of variability for W ≥ 600. Conversely, the skewness γ(I) displayed high variabilities even for large texts (W = 2,100). This result might be a consequence of the fact that γ(I) reflects the fraction of keywords in a text [58]. Therefore, if the amount of relevant words in each subtext presents a high variability, it is natural to expect that γ(I) will vary accordingly. With regard to the shortest path lengths, both ⟨l⟩ and Δl displayed low values of fluctuations for W ≥ 1,500. Similarly to γ(I), γ(l) presented a high dispersion across distinct subtexts.

Download:

Fig 2. Coefficient of variation for complex network measurements.

The measurements considered were (a) average acessibility ⟨α^{(h = 2)}⟩; (b) average acessibility ⟨α^{(h = 3)}⟩; (c) average neighbors degree ⟨k_n⟩; (d) average betweenness ⟨B⟩; (e) average clustering coefficient ⟨C⟩; (f) average intermittency ⟨I⟩; (g) standard deviation of the intermittency ΔI; (h) skewness of the intermittency γ(I); (i) average shortest path length ⟨l⟩; (j) standard deviation of the shortest path length Δl; and (k) skewness of the intermittency γ(I).

https://doi.org/10.1371/journal.pone.0118394.g002

All in all, the results displayed in Fig. 2 reveal the most of measurements displays low statistical fluctuations when shorter texts are analyzed. The only exceptions were the skewness of the average shortest path lengths and the skewness of the intermittency. In both cases, the variability remained high even for subtexts comprising 2,100 tokens. In any case, in general, it is reasonable to suppose that a proper sampling allows a proper characterization of the local topological properties of books. In order to verify the applicability of sampling books in real stylometric tasks, the next section investigates how the sampling affects the performance of the authorship recognition task [71].

Authorship recognition via topological analysis of subtexts

Authorship recognition methods are important because they can be applied e.g to solve copyright disagreements [72], to intercept terrorist messages [73] and to classify literary manuscripts [74]. Automatic authorship recognition techniques became popular after the famous investigation of Mosteller and Wallace on the Federalist Papers [75]. After this seminal study, researchers have tried to discover novel features to quantify styles, i.e. the textual properties that unequivocally identify authors. Currently, this line of research is known as stylometry [71]. Traditional features employed to discriminate authors include statistical properties of words (average length, frequency and intermittency of specific words, richness of vocabulary) [49] and characters (frequency and correlations) [72]. In addition to the lexical features, syntactical (frequency of specific parts-of-speech or chunks) and semantical properties (semantical dependencies) have been employed [49]. Current research have devised new attributes for the development of robust classifiers [49]. In recent years, it has been shown that the topological properties of complex networks has been useful to capture various textual attributes related to authors’ styles [20, 42–46]. For example, a significant discriminability of authors could be found in [58]. Because authors leave stylistic marks on the topological structure of complex networks [46, 57, 58], in this section the authorship recognition problem is studied by measuring the topological properties of co-occurrence networks. More specifically, the effects of the sampling on the classification are investigated.

For the classification task, the list of books and authors considered is shown in Table 3. Subtext lengths ranging in the interval 500 ≤ W ≤ 21,400 were considered. To evaluate the performance of the task in short texts, note that low values of W were used. A comparison of the performance obtained with short and large texts was carried out by analyzing the accuracy rates found for higher values of W. In the dataset shown in Table 3, the larger window considered (W = 21,400) corresponds to the case where no sampling was performed. In other words, when W = 21,400 each book was represented by a single subtext. The values of W = 7,130 and W = 5,350 correspond to the division of full texts in three and four parts, respectively. Four classifiers were employed to perform the supervised classifications: (i) nearest neighbors, (ii) naive Bayes, (iii) decision trees, and (iv) support vector machines.

Download:

Table 3. List of books employed for the authorship recognitions task.

https://doi.org/10.1371/journal.pone.0118394.t003

The performance obtained for the authorship recognition task is shown in Table 4. A visualization of the classification is provided in Fig. 3. The highest accuracy rate found was 86.67% (p-value < 10⁻¹⁰), which confirms that the topological characterization of subtexts is able to discriminate authors. In all classifiers, the lowest accuracy rates were found for the shortest subtexts (W = 500). This poor discriminability of authors can be attributed to the very short length employed for the task (see Fig. 4). In order to compare the performance obtained with short and full texts, it is possible to define a threshold W_L from which the accuracy rate surpasses the value θ × AFB, where AFB is the accuracy found with the traditional approach based on full texts. Using θ = 0.85, the following thresholds were obtained: W_L = 1,600 (kNN), W_L = 1,700 (Bayes), W_L = 1,000 (C4.5) and W_L = 1,000 (SVM). Therefore, in the dataset provided in Table 3, one can obtain 85% of the discriminability found with full books (W = 21,400) if one analyzes subtexts comprising at least W = 1,700 tokens.

Download:

Table 4. Accuracy rate for the authorship recognition task.

https://doi.org/10.1371/journal.pone.0118394.t004

Download:

Fig 3. Visualization of the projection of the eleven attributes employed for the classification of authorship.

The principal component analysis was employed. The length of the subtexts considere for the purpose of authorship recognition were: (a) W = 500; (b) W = 1,000; and (c) W = 1,500. Note that the discriminability increases as the subtexts become larger.

https://doi.org/10.1371/journal.pone.0118394.g003

Download:

Fig 4. Accuracy rate as a function of the subtext length.

The classifiers employed were (a) kNN; (b) Naive Bayes; (c) C4.5; and (d) SVM. The accuracy rate obtained with full texts (AFB) is represented as a red dashed line. Considering all the classifiers employed in the experiments, one can obtain 85% of the discriminability found with full books (W = 21,400) if one analyzes subtexts comprising at least W = 1,700 tokens.

https://doi.org/10.1371/journal.pone.0118394.g004

If one compares the accuracy rates found for distinct values of W, it is interesting to note that the highest accuracy rates does not occur when full books are used. As a matter of fact, the highest accuracy rates for kNN, Bayes, C4.5 and SVM were obtained for W = 21,400, W = 5,350, W = 7,130 and W = 5,350, respectively. This observation suggests that, when a suitable sampling is performed, the performance of the classification can even be improved. In line with the results reported in the literature [76], the SVM outperformed other classifiers (for a given subtext length). In particular, this classifier yielded high accuracy rates even for short subtexts (W = 2,500). The accuracy obtained for the SVM when W = 3,000 even surpassed all the accuracies found for the other classifiers. This means that the combination of local characterizations via sampling with support vector machines outperformed the classification based on full books. Given these observations, it seems that support vector machines are more robust than other classifiers when shorter texts are analyzed.

Conclusions

This study probed the influence of sampling texts in the topological analysis of word adjacency networks. An individual analysis of variability of each network measurement revealed that most of them display a low variability across samples. The only exceptions were the skewness of the average shortest path length and the skewness of the intermittency, as revealed by high values of variability across samples even for larger subtexts. Taken together, these results evidence that short pieces of texts are suitable for network analysis, because the sampling process yields weakened statistical fluctuations for short texts.

The influence of the sampling process on a practical classification task was also investigated. Surprisingly, high accuracy rates could be found for texts comprising 1,700 tokens, which amounts to less than 8% of the length of a full book. The SVM classifier turned out to be the best classifier for the authorship recognition task based on short texts, as it outperformed the other three traditional classifiers. These results confirm that, when sufficiently large texts are generated, the sampling does not significantly affect the performance of the classification. Actually, the local characterization of texts might even improve the performance of the classifiers. In addition to allowing the use of short texts in classification tasks based on stylometry via topological characterization of word adjacency networks, the use of small pieces of texts tends to reduce the effects of the so-called curse-of-dimensionality [65], as more training examples are included in the attribute space. A possible weakness of the sampling method is that it can only be applied to large texts. The sampling of short documents generates texts with high topological variability. In these cases, other models should be used to capture relevant features for the specific task [77]. The analysis of short texts has been performed, for example, to detect sentiments. When short comments in product reviews or tweets are analyzed, semantical methods methods have been applied [78, 79].

This paper showed, as a proof of principle, that smaller pieces of texts can also be useful in textual network analysis. Following this research line, future works could, for example, apply the techniques described here to identify stylistic inconsistencies in written texts. Such inconsistencies could be found, for example, by identifying topological outliers, i.e. subtexts whose topology is different from other observations in the same book. The identification of stylistic inconsistencies could also be useful for recognizing multiple authorship or even plagiarisms [80]. Most importantly, the techniques described here could also be extended in a straightforward fashion to study written texts as temporal series [81], thus allowing the study of texts as time-varying complex networks [82].

Supporting Information

S1 Dataset. List of books employed in the experiments.

https://doi.org/10.1371/journal.pone.0118394.s001

(ZIP)

Author Contributions

Conceived and designed the experiments: DRA. Performed the experiments: DRA. Analyzed the data: DRA. Contributed reagents/materials/analysis tools: DRA. Wrote the paper: DRA.

References

1. Newman M. Networks: an introduction. Oxford: Oxford University Press; 1992.
2. Watts DJ, Strogatz SH. Collective dynamics of ‘small-world’ networks. Nature 1998; 393(6684): 440–442. pmid:9623998
- View Article
- PubMed/NCBI
- Google Scholar
3. Dangalchev C. Generation models for scale-free networks. Physica A 2004; 338: 659–671.
- View Article
- Google Scholar
4. Doye JPK, Massen CP. Characterizing the network topology of the energy landscapes of atomic clusters. The Journal of Chemical Physics 2005; 122(8): 084105.
- View Article
- Google Scholar
5. Hughes D, Paczuski M. A heavenly example of scale free networks and self-organized criticality. Physica A 2004; 342(1–2): 158–163.
- View Article
- Google Scholar
6. Girvan M, Newman MEJ. Community structure in social and biological networks. Proceedings of the National Academy of Science USA 2002; 99(12): 7821–7826.
- View Article
- Google Scholar
7. Freeman LC. Centrality in social networks: conceptual clarification. Social Networks 1979; 1: 215–239.
- View Article
- Google Scholar
8. Toivonen R, Kovanen L, Kivela M, Onnela J-P, Saramaki J, Kaski K. A comparative study of social network models: network evolution models and nodal attribute models. Social Networks 2009; 31(4): 240–254.
- View Article
- Google Scholar
9. Barabási A-L and Oltvai ZN. Network biology: understanding the cell’s functional organization. Nature Reviews Genetics 2004; 5(2): 101–113. pmid:14735121
- View Article
- PubMed/NCBI
- Google Scholar
10. Betel D, Isserlin R, Hogue CWV. Analysis of domain correlations in yeast protein complexes. Bioinformatics 2004; 20: 55–62.
- View Article
- Google Scholar
11. Bullmore ET, Sporns O. Complex brain networks: graph-theoretical analysis of structural and functional systems. Nature Reviews Neuroscience 2009; 10:186–198. pmid:19190637
- View Article
- PubMed/NCBI
- Google Scholar
12. Rubinov M, Sporns O. Complex network measures of brain connectivity: uses and interpretations. Neuroimage 2010; 52: 1059–1069. pmid:19819337
- View Article
- PubMed/NCBI
- Google Scholar
13. Stam CJ, Reijneveld JC. Graph theoretical analysis of complex networks in the brain. Nonlinear Biomedical Physics 2007; 1:3. pmid:17908336
- View Article
- PubMed/NCBI
- Google Scholar
14. Baronchelli AA, Ferrer-i-Cancho R, Pastor-Satorras R, Chater N and Christiansen MH Networks in cognitive sciences. Trends in Cognitive Science 2013; 17(7): 348–360.
- View Article
- Google Scholar
15. Cano P, Celma O, Koppenberger M, Buld JM. Topology of music recommendation networks. Chaos 2006; 16: 013107. pmid:16599738
- View Article
- PubMed/NCBI
- Google Scholar
16. Backes AR, Casanova D, Bruno OM. A complex network-based approach for boundary shape analysis. Pattern Recognition 2009; 42(1): 54–67.
- View Article
- Google Scholar
17. Moura APS, Lai YC, Motter AE. Signatures of small-world and scale-free properties in large computer programs. Physical Review E 2003; 68(1): 017102.
- View Article
- Google Scholar
18. Silva TC, Amancio DR. Word sense disambiguation via high order of learning in complex networks. Europhysics Letters 2012; 98:58001.
- View Article
- Google Scholar
19. Kong JS, Rezaei BA, Sarshar N, Roychowdhury VP, Boykin PO. Collaborative spam filtering using e-mail networks. Computer 2006; 39(8): 67–73.
- View Article
- Google Scholar
20. Cong J, Liu H. Approaching human language with complex networks. Physics of Life Reviews 2014; 11(4): 598–618. pmid:24794524
- View Article
- PubMed/NCBI
- Google Scholar
21. Liu H. The complexity of Chinese syntactic dependency networks. Physica A 2008; 387 (12): 3048–3058.
- View Article
- Google Scholar
22. Liu H, Li W. Language clusters based on linguistic complex networks. Chinese Science Bulletin 2010; 55 (30): 3458–3465.
- View Article
- Google Scholar
23. Abramov O, Mehler A. Automatic language classification by means of syntactic dependency networks. Journal of Quantitative Linguistics 2011; 18(4): 291–336.
- View Article
- Google Scholar
24. Sporns O, Chialvo DR, Kaiser M, Hilgetag CC. Organization, development and function of complex brain networks. Trends in Cognitive Sciences 2004; 8(9): 418–425. pmid:15350243
- View Article
- PubMed/NCBI
- Google Scholar
25. Zamora-Lopez G, Russo E, Gleiser P M, Zhou CS, Kurths J. Characterizing the complexity of brain and mind networks. Philosophical Transactions of the Royal Society A 2011; 369: 3730–3747.
- View Article
- Google Scholar
26. Arruda GF, Costa LF, Schubert D, Rodrigues FA. Structure and dynamics of functional networks in child-onset schizophrenia. Clinical Neurophysiology 2013; 125(8): 1589–1595. pmid:24388744
- View Article
- PubMed/NCBI
- Google Scholar
27. Barttfeld P, Wicker B, Cukier S, Navarta S, Lew S, Sigman M. A big-world network in ASD: dynamical connectivity analysis reflects a deficit in long-range connections and an excess of short-range connections. Neuropsychologia 2011; 49: 254–263. pmid:21110988
- View Article
- PubMed/NCBI
- Google Scholar
28. Zhao X, Liu Y, Wang X, Liu B, Xi Q. Disrupted small-world brain networks in moderate Alzheimer’s disease: a resting-state fMRI study. PLoS One 2012; 7:e33540. pmid:22457774
- View Article
- PubMed/NCBI
- Google Scholar
29. Borge-Holthoefer J, Arenas A. Semantic Networks: Structure and Dynamics. Entropy 2010; 12(5): 1264–1302.
- View Article
- Google Scholar
30. Beckage N, Smith L, Hills T. Small worlds and semantic network growth in typical and late talkers. PLoS One 2011; 6: e19348. pmid:21589924
- View Article
- PubMed/NCBI
- Google Scholar
31. Vitevitch MS, Ercal G, Adagarla B. Simulating retrieval from a highly clustered network: implications for spoken word recognition. Frontiers in Psychology 2011; 2: 369. pmid:22174705
- View Article
- PubMed/NCBI
- Google Scholar
32. Amancio DR, Oliveira ON, Costa LF. On the concepts of complex networks to quantify the difficulty in finding the way out of labyrinths. Physica A 2011; 390: 4673–4683.
- View Article
- Google Scholar
33. Ferrer i Cancho R, Solé R, Kohler R. Patterns in syntactic dependency networks. Physical Review E 2004; 69: 51915.
- View Article
- Google Scholar
34. Amancio DR, Nunes MGV, Oliveira ON Jr., Costa LdF. Extractive summarization using complex networks and syntactic dependency. Physica A 2012; 391: 1855–1864.
- View Article
- Google Scholar
35. Liu H. Statistical properties of Chinese semantic networks. Chinese Science Bulletin 2009; 54: 2781–2785.
- View Article
- Google Scholar
36. Masucci AP, Kalampokis A, Eguluz VM, Hernndez-Garcia E. Wikipedia information flow analysis reveals the scale-free architecture of the semantic space. PLoS ONE 2011; 6: e17333. pmid:21407801
- View Article
- PubMed/NCBI
- Google Scholar
37. Silva TC, Amancio DR. Discriminating word senses with tourist walks in complex networks. The European Physical Journal B 2013; 86: 297.
- View Article
- Google Scholar
38. Matveeva I, Levow G-A. Graph-based generalized Latent Semantic Analysis for document representation. Proceedings of the First Workshop on Graph Based Methods for Natural Language Processing, 2006: 61–64.
- View Article
- Google Scholar
39. Landauer TK, Laham D, Derr M. From paragraph to graph: latent semantic analysis for information visualization. Proceedings of the National Academy of Science 2004; 101: 5214–5219.
- View Article
- Google Scholar
40. Henderson K, Eliassi-Rad T. Applying Latent Dirichlet Allocation to group discovery in large graphs. Proceedings of the ACM symposium on Applied Computing ACM, New York, NY, USA, 2009; 1456–1461.
41. Amancio DR, Altmann EG, Rybski D, Oliveira ON Jr., Costa LdF. Probing the statistical properties of unknown texts: application to the Voynich manuscript. PLoS ONE 2013; 8: e67310. pmid:23844002
- View Article
- PubMed/NCBI
- Google Scholar
42. Amancio DR, Aluisio SM, Oliveira ON, Costa LdF. Complex networks analysis of language complexity. Europhysics Letters 2012; 100: 58002.
- View Article
- Google Scholar
43. Amancio DR, Oliveira ON Jr., Costa LdF. Identification of literary movements using complex networks to represent texts. New Journal of Physics 2012; 14: 043029.
- View Article
- Google Scholar
44. Roxas-Villanueva RM, Nambatac MK, Tapang G. Characterizing english poetic style using complex networks. International Journal of Modern Physics C 2012; 23: 1250009.
- View Article
- Google Scholar
45. Grabska-Gradzinska I, Kulig A, Kwapien J, Drozdz S. Complex network analysis of literary and scientific texts. International Journal of Modern Physics C 2012; 23: 1250051.
- View Article
- Google Scholar
46. Roxas RM, Tapang G. Prose and poetry classification and boundary detection using word adjacency network analysis. International Journal of Modern Physics C 2010; 21: 503.
- View Article
- Google Scholar
47. Carron PM, Kenna R. Network analysis of the Islendinga sogur—the Sagas of Icelanders. The European Physical Journal B 2013; 86: 407.
- View Article
- Google Scholar
48. Liu HT, Cong J. Language clustering with word co-occurrence networks based on parallel texts. Chinese Science Bulletin 2013; 58(10): 1139–1144.
- View Article
- Google Scholar
49. Stamatatos E. A survey of modern authorship attribution methods. Journal of the Association for Information Science and Technology 2009; 60: 538–556.
- View Article
- Google Scholar
50. Mihalcea R, Radev D. Graph-based natural language processing and information retrieval. Cambridge University Press; 2011.
51. Navigli R.Word sense disambiguation: a survey. ACM Computing Surveys 2009; 41(2): 1–69.
- View Article
- Google Scholar
52. Dunning T. Accurate methods for the statistics of surprise and coincidence. Comput. Linguist. 1994; 19(1): 61–74.
- View Article
- Google Scholar
53. Ferrer-i-Cancho R, Sole RV. The small-world of human language. Proc. R. Soc. Lond. B 2001; 268(1482): 2261–2265.
- View Article
- Google Scholar
54. Masucci AP, Rodgers GJ. Network properties of written human language. Physical Review E 2006; 74(2): 026102.
- View Article
- Google Scholar
55. Veronis J. HyperLex: lexical cartography for information retrieval. Computer Speech and Language 2004; 18(3): 223–252.
- View Article
- Google Scholar
56. Lin D. Automatic retrieval and clustering of similar words. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics—Volume 2 (ACL’98) Stroudsburg, PA, USA, 768–774; 1998.
57. Amancio DR, Altmann EG, Oliveira ON Jr, Costa LdF. Comparing intermittency and network measurements of words and their dependence on authorship. New Journal of Physics 2011; 13: 123024.
- View Article
- Google Scholar
58. Antiqueira L, Pardo TAS, Nunes MGV, Oliveira ON Jr.. Some issues on complex networks for author characterization. Inteligencia Artificial 2007; 11: 51–58.
- View Article
- Google Scholar
59. Berger AL, Della Pietra SA, Della Pietra VJ. A maximum entropy approach to natural language processing. Computational Linguistics 1996; 22 39–71.
- View Article
- Google Scholar
60. Amancio DR, Oliveira ON Jr., Costa LF. Structure semantics interplay in complex networks and its effects on the predictability of similarity in texts. Physica A 2012; 391: 4406–4419.
- View Article
- Google Scholar
61. Costa LF, Silva FN. Hierarchical characterization of complex networks. Journal of Statistical Physics 2006; 215(4): 841–872.
- View Article
- Google Scholar
62. Carretero-Campos C, Bernaola-Galvn P, Coronado AV, Carpena P. Improving statistical keyword detection in short texts: entropic and clustering approaches. Physica A 2013; 392: 1481–1492.
- View Article
- Google Scholar
63. Freeman L. A set of measures of centrality based on betweenness. Sociometry 1977; 40: 35–41.
- View Article
- Google Scholar
64. Herrera JP, Pury PA. Statistical keyword detection in literary corpora. The European Physical Journal B 2008; 63: 135–146.
- View Article
- Google Scholar
65. Duda RO, Hart PE, Stork DG. Pattern Classification. Wiley-Interscience; 2000.
66. Darrell T, Indyk P, Shakhnarovich F. Nearest neighbor methods in learning and vision: theory and practice. MIT Press. 2006.
67. Murthy SK. Automatic construction of decision trees from data: a multi-disciplinary survey. Data Min. Knowl. Discov 1998; 2: 345–389.
- View Article
- Google Scholar
68. Hand DJ, Yu K. Idiot’s Bayes: not so stupid after all? Statistical Review 2001; 69: 385–398.
- View Article
- Google Scholar
69. Cortes C, Vapnik V. Support-Vector networks. Machine Learning 1995; 20: 273.
- View Article
- Google Scholar
70. Wu X, Kumar V, Quinlan JR, Ghosh J, Yang Q, Motoda H, McLachlan GJ, Ng A, Liu B, Yu PS, Zhou Z-H, Steinbach M, Hand DJ, Steinberg D. Top 10 algorithms in data mining. Knowl. Inf. Syst. 2007; 14(1): 1–37.
- View Article
- Google Scholar
71. Juola P. Authorship attribution. Foundations and Trends in Information Retrieval 2006; 1:3.
- View Article
- Google Scholar
72. Grant TD. Quantifying evidence for forensic authorship analysis. International Journal of Speech Language and the Law 2007; 14(1): 1–25.
- View Article
- Google Scholar
73. Abbasi A, Chen H. Applying authorship analysis to extremist-group Web forum messages, IEEE Intelligent Systems 2005; 20(5): 67–75.
- View Article
- Google Scholar
74. Ebrahimpour M, Putnins TJ, Berryman MJ, Allison A, Ng BW-H, Derek A. Automated authorship attribution using advanced signal classification techniques. PLoS ONE 2013; 8(2): e54998. pmid:23437047
- View Article
- PubMed/NCBI
- Google Scholar
75. Mosteller F, Wallace DL. Inference and disputed authorship: The Federalist. Addison-Wesley; 1964.
76. Amancio DR, Comin CH, Casanova D, Travieso G, Bruno OM, Rodrigues FA, Costa LdF (2014) A systematic comparison of supervised classifiers. PLoS ONE 9 e94137. pmid:24763312
- View Article
- PubMed/NCBI
- Google Scholar
77. Manning CD and Schutze H. Foundations of statistical natural language processing. MIT Press, Cambridge, MA, USA; 1999.
78. Golder SA, Macy MW. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science 2011; 333(6051): 1878–1881. pmid:21960633
- View Article
- PubMed/NCBI
- Google Scholar
79. Cambria E, Schuller B, Xia Y, Havasi C. New avenues in opinion mining and sentiment analysis. IEEE Intelligent Systems 2013; 28(2): 15–21.
- View Article
- Google Scholar
80. Dreher H (2007) Automatic conceptual analysis for plagiarism detection. Information and Beyond: The Journal of Issues in Informing Science and Information Technology 4: 601–614.
- View Article
- Google Scholar
81. Amancio DR. Authorship recognition via fluctuation analysis of network topology and word intermittency. Manuscript under review.
82. Karsai M, Perra N, Vespignani A. Time-varying networks and the weakness of strong ties. Scientific Reports 2014; 4: 4001. pmid:24510159
- View Article
- PubMed/NCBI
- Google Scholar

[ref1] 1. Newman M. Networks: an introduction. Oxford: Oxford University Press; 1992.

[ref2] 2. Watts DJ, Strogatz SH. Collective dynamics of ‘small-world’ networks. Nature 1998; 393(6684): 440–442. pmid:9623998
View Article
PubMed/NCBI
Google Scholar

[3] View Article

[4] PubMed/NCBI

[5] Google Scholar

[ref3] 3. Dangalchev C. Generation models for scale-free networks. Physica A 2004; 338: 659–671.
View Article
Google Scholar

[7] View Article

[8] Google Scholar

[ref4] 4. Doye JPK, Massen CP. Characterizing the network topology of the energy landscapes of atomic clusters. The Journal of Chemical Physics 2005; 122(8): 084105.
View Article
Google Scholar

[10] View Article

[11] Google Scholar

[ref5] 5. Hughes D, Paczuski M. A heavenly example of scale free networks and self-organized criticality. Physica A 2004; 342(1–2): 158–163.
View Article
Google Scholar

[13] View Article

[14] Google Scholar

[ref6] 6. Girvan M, Newman MEJ. Community structure in social and biological networks. Proceedings of the National Academy of Science USA 2002; 99(12): 7821–7826.
View Article
Google Scholar

[16] View Article

[17] Google Scholar

[ref7] 7. Freeman LC. Centrality in social networks: conceptual clarification. Social Networks 1979; 1: 215–239.
View Article
Google Scholar

[19] View Article

[20] Google Scholar

[ref8] 8. Toivonen R, Kovanen L, Kivela M, Onnela J-P, Saramaki J, Kaski K. A comparative study of social network models: network evolution models and nodal attribute models. Social Networks 2009; 31(4): 240–254.
View Article
Google Scholar

[22] View Article

[23] Google Scholar

[ref9] 9. Barabási A-L and Oltvai ZN. Network biology: understanding the cell’s functional organization. Nature Reviews Genetics 2004; 5(2): 101–113. pmid:14735121
View Article
PubMed/NCBI
Google Scholar

[25] View Article

[26] PubMed/NCBI

[27] Google Scholar

[ref10] 10. Betel D, Isserlin R, Hogue CWV. Analysis of domain correlations in yeast protein complexes. Bioinformatics 2004; 20: 55–62.
View Article
Google Scholar

[29] View Article

[30] Google Scholar

[ref11] 11. Bullmore ET, Sporns O. Complex brain networks: graph-theoretical analysis of structural and functional systems. Nature Reviews Neuroscience 2009; 10:186–198. pmid:19190637
View Article
PubMed/NCBI
Google Scholar

[32] View Article

[33] PubMed/NCBI

[34] Google Scholar

[ref12] 12. Rubinov M, Sporns O. Complex network measures of brain connectivity: uses and interpretations. Neuroimage 2010; 52: 1059–1069. pmid:19819337
View Article
PubMed/NCBI
Google Scholar

[36] View Article

[37] PubMed/NCBI

[38] Google Scholar

[ref13] 13. Stam CJ, Reijneveld JC. Graph theoretical analysis of complex networks in the brain. Nonlinear Biomedical Physics 2007; 1:3. pmid:17908336
View Article
PubMed/NCBI
Google Scholar

[40] View Article

[41] PubMed/NCBI

[42] Google Scholar

[ref14] 14. Baronchelli AA, Ferrer-i-Cancho R, Pastor-Satorras R, Chater N and Christiansen MH Networks in cognitive sciences. Trends in Cognitive Science 2013; 17(7): 348–360.
View Article
Google Scholar

[44] View Article

[45] Google Scholar

[ref15] 15. Cano P, Celma O, Koppenberger M, Buld JM. Topology of music recommendation networks. Chaos 2006; 16: 013107. pmid:16599738
View Article
PubMed/NCBI
Google Scholar

[47] View Article

[48] PubMed/NCBI

[49] Google Scholar

[ref16] 16. Backes AR, Casanova D, Bruno OM. A complex network-based approach for boundary shape analysis. Pattern Recognition 2009; 42(1): 54–67.
View Article
Google Scholar

[51] View Article

[52] Google Scholar

[ref17] 17. Moura APS, Lai YC, Motter AE. Signatures of small-world and scale-free properties in large computer programs. Physical Review E 2003; 68(1): 017102.
View Article
Google Scholar

[54] View Article

[55] Google Scholar

[ref18] 18. Silva TC, Amancio DR. Word sense disambiguation via high order of learning in complex networks. Europhysics Letters 2012; 98:58001.
View Article
Google Scholar

[57] View Article

[58] Google Scholar

[ref19] 19. Kong JS, Rezaei BA, Sarshar N, Roychowdhury VP, Boykin PO. Collaborative spam filtering using e-mail networks. Computer 2006; 39(8): 67–73.
View Article
Google Scholar

[60] View Article

[61] Google Scholar

[ref20] 20. Cong J, Liu H. Approaching human language with complex networks. Physics of Life Reviews 2014; 11(4): 598–618. pmid:24794524
View Article
PubMed/NCBI
Google Scholar

[63] View Article

[64] PubMed/NCBI

[65] Google Scholar

[ref21] 21. Liu H. The complexity of Chinese syntactic dependency networks. Physica A 2008; 387 (12): 3048–3058.
View Article
Google Scholar

[67] View Article

[68] Google Scholar

[ref22] 22. Liu H, Li W. Language clusters based on linguistic complex networks. Chinese Science Bulletin 2010; 55 (30): 3458–3465.
View Article
Google Scholar

[70] View Article

[71] Google Scholar

[ref23] 23. Abramov O, Mehler A. Automatic language classification by means of syntactic dependency networks. Journal of Quantitative Linguistics 2011; 18(4): 291–336.
View Article
Google Scholar

[73] View Article

[74] Google Scholar

[ref24] 24. Sporns O, Chialvo DR, Kaiser M, Hilgetag CC. Organization, development and function of complex brain networks. Trends in Cognitive Sciences 2004; 8(9): 418–425. pmid:15350243
View Article
PubMed/NCBI
Google Scholar

[76] View Article

[77] PubMed/NCBI

[78] Google Scholar

[ref25] 25. Zamora-Lopez G, Russo E, Gleiser P M, Zhou CS, Kurths J. Characterizing the complexity of brain and mind networks. Philosophical Transactions of the Royal Society A 2011; 369: 3730–3747.
View Article
Google Scholar

[80] View Article

[81] Google Scholar

[ref26] 26. Arruda GF, Costa LF, Schubert D, Rodrigues FA. Structure and dynamics of functional networks in child-onset schizophrenia. Clinical Neurophysiology 2013; 125(8): 1589–1595. pmid:24388744
View Article
PubMed/NCBI
Google Scholar

[83] View Article

[84] PubMed/NCBI

[85] Google Scholar

[ref27] 27. Barttfeld P, Wicker B, Cukier S, Navarta S, Lew S, Sigman M. A big-world network in ASD: dynamical connectivity analysis reflects a deficit in long-range connections and an excess of short-range connections. Neuropsychologia 2011; 49: 254–263. pmid:21110988
View Article
PubMed/NCBI
Google Scholar

[87] View Article

[88] PubMed/NCBI

[89] Google Scholar

[ref28] 28. Zhao X, Liu Y, Wang X, Liu B, Xi Q. Disrupted small-world brain networks in moderate Alzheimer’s disease: a resting-state fMRI study. PLoS One 2012; 7:e33540. pmid:22457774
View Article
PubMed/NCBI
Google Scholar

[91] View Article

[92] PubMed/NCBI

[93] Google Scholar

[ref29] 29. Borge-Holthoefer J, Arenas A. Semantic Networks: Structure and Dynamics. Entropy 2010; 12(5): 1264–1302.
View Article
Google Scholar

[95] View Article

[96] Google Scholar

[ref30] 30. Beckage N, Smith L, Hills T. Small worlds and semantic network growth in typical and late talkers. PLoS One 2011; 6: e19348. pmid:21589924
View Article
PubMed/NCBI
Google Scholar

[98] View Article

[99] PubMed/NCBI

[100] Google Scholar

[ref31] 31. Vitevitch MS, Ercal G, Adagarla B. Simulating retrieval from a highly clustered network: implications for spoken word recognition. Frontiers in Psychology 2011; 2: 369. pmid:22174705
View Article
PubMed/NCBI
Google Scholar

[102] View Article

[103] PubMed/NCBI

[104] Google Scholar

[ref32] 32. Amancio DR, Oliveira ON, Costa LF. On the concepts of complex networks to quantify the difficulty in finding the way out of labyrinths. Physica A 2011; 390: 4673–4683.
View Article
Google Scholar

[106] View Article

[107] Google Scholar

[ref33] 33. Ferrer i Cancho R, Solé R, Kohler R. Patterns in syntactic dependency networks. Physical Review E 2004; 69: 51915.
View Article
Google Scholar

[109] View Article

[110] Google Scholar

[ref34] 34. Amancio DR, Nunes MGV, Oliveira ON Jr., Costa LdF. Extractive summarization using complex networks and syntactic dependency. Physica A 2012; 391: 1855–1864.
View Article
Google Scholar

[112] View Article

[113] Google Scholar

[ref35] 35. Liu H. Statistical properties of Chinese semantic networks. Chinese Science Bulletin 2009; 54: 2781–2785.
View Article
Google Scholar

[115] View Article

[116] Google Scholar

[ref36] 36. Masucci AP, Kalampokis A, Eguluz VM, Hernndez-Garcia E. Wikipedia information flow analysis reveals the scale-free architecture of the semantic space. PLoS ONE 2011; 6: e17333. pmid:21407801
View Article
PubMed/NCBI
Google Scholar

[118] View Article

[119] PubMed/NCBI

[120] Google Scholar

[ref37] 37. Silva TC, Amancio DR. Discriminating word senses with tourist walks in complex networks. The European Physical Journal B 2013; 86: 297.
View Article
Google Scholar

[122] View Article

[123] Google Scholar

[ref38] 38. Matveeva I, Levow G-A. Graph-based generalized Latent Semantic Analysis for document representation. Proceedings of the First Workshop on Graph Based Methods for Natural Language Processing, 2006: 61–64.
View Article
Google Scholar

[125] View Article

[126] Google Scholar

[ref39] 39. Landauer TK, Laham D, Derr M. From paragraph to graph: latent semantic analysis for information visualization. Proceedings of the National Academy of Science 2004; 101: 5214–5219.
View Article
Google Scholar

[128] View Article

[129] Google Scholar

[ref40] 40. Henderson K, Eliassi-Rad T. Applying Latent Dirichlet Allocation to group discovery in large graphs. Proceedings of the ACM symposium on Applied Computing ACM, New York, NY, USA, 2009; 1456–1461.

[ref41] 41. Amancio DR, Altmann EG, Rybski D, Oliveira ON Jr., Costa LdF. Probing the statistical properties of unknown texts: application to the Voynich manuscript. PLoS ONE 2013; 8: e67310. pmid:23844002
View Article
PubMed/NCBI
Google Scholar

[132] View Article

[133] PubMed/NCBI

[134] Google Scholar

[ref42] 42. Amancio DR, Aluisio SM, Oliveira ON, Costa LdF. Complex networks analysis of language complexity. Europhysics Letters 2012; 100: 58002.
View Article
Google Scholar

[136] View Article

[137] Google Scholar

[ref43] 43. Amancio DR, Oliveira ON Jr., Costa LdF. Identification of literary movements using complex networks to represent texts. New Journal of Physics 2012; 14: 043029.
View Article
Google Scholar

[139] View Article

[140] Google Scholar

[ref44] 44. Roxas-Villanueva RM, Nambatac MK, Tapang G. Characterizing english poetic style using complex networks. International Journal of Modern Physics C 2012; 23: 1250009.
View Article
Google Scholar

[142] View Article

[143] Google Scholar

[ref45] 45. Grabska-Gradzinska I, Kulig A, Kwapien J, Drozdz S. Complex network analysis of literary and scientific texts. International Journal of Modern Physics C 2012; 23: 1250051.
View Article
Google Scholar

[145] View Article

[146] Google Scholar

[ref46] 46. Roxas RM, Tapang G. Prose and poetry classification and boundary detection using word adjacency network analysis. International Journal of Modern Physics C 2010; 21: 503.
View Article
Google Scholar

[148] View Article

[149] Google Scholar

[ref47] 47. Carron PM, Kenna R. Network analysis of the Islendinga sogur—the Sagas of Icelanders. The European Physical Journal B 2013; 86: 407.
View Article
Google Scholar

[151] View Article

[152] Google Scholar

[ref48] 48. Liu HT, Cong J. Language clustering with word co-occurrence networks based on parallel texts. Chinese Science Bulletin 2013; 58(10): 1139–1144.
View Article
Google Scholar

[154] View Article

[155] Google Scholar

[ref49] 49. Stamatatos E. A survey of modern authorship attribution methods. Journal of the Association for Information Science and Technology 2009; 60: 538–556.
View Article
Google Scholar

[157] View Article

[158] Google Scholar

[ref50] 50. Mihalcea R, Radev D. Graph-based natural language processing and information retrieval. Cambridge University Press; 2011.

[ref51] 51. Navigli R.Word sense disambiguation: a survey. ACM Computing Surveys 2009; 41(2): 1–69.
View Article
Google Scholar

[161] View Article

[162] Google Scholar

[ref52] 52. Dunning T. Accurate methods for the statistics of surprise and coincidence. Comput. Linguist. 1994; 19(1): 61–74.
View Article
Google Scholar

[164] View Article

[165] Google Scholar

[ref53] 53. Ferrer-i-Cancho R, Sole RV. The small-world of human language. Proc. R. Soc. Lond. B 2001; 268(1482): 2261–2265.
View Article
Google Scholar

[167] View Article

[168] Google Scholar

[ref54] 54. Masucci AP, Rodgers GJ. Network properties of written human language. Physical Review E 2006; 74(2): 026102.
View Article
Google Scholar

[170] View Article

[171] Google Scholar

[ref55] 55. Veronis J. HyperLex: lexical cartography for information retrieval. Computer Speech and Language 2004; 18(3): 223–252.
View Article
Google Scholar

[173] View Article

[174] Google Scholar

[ref56] 56. Lin D. Automatic retrieval and clustering of similar words. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics—Volume 2 (ACL’98) Stroudsburg, PA, USA, 768–774; 1998.

[ref57] 57. Amancio DR, Altmann EG, Oliveira ON Jr, Costa LdF. Comparing intermittency and network measurements of words and their dependence on authorship. New Journal of Physics 2011; 13: 123024.
View Article
Google Scholar

[177] View Article

[178] Google Scholar

[ref58] 58. Antiqueira L, Pardo TAS, Nunes MGV, Oliveira ON Jr.. Some issues on complex networks for author characterization. Inteligencia Artificial 2007; 11: 51–58.
View Article
Google Scholar

[180] View Article

[181] Google Scholar

[ref59] 59. Berger AL, Della Pietra SA, Della Pietra VJ. A maximum entropy approach to natural language processing. Computational Linguistics 1996; 22 39–71.
View Article
Google Scholar

[183] View Article

[184] Google Scholar

[ref60] 60. Amancio DR, Oliveira ON Jr., Costa LF. Structure semantics interplay in complex networks and its effects on the predictability of similarity in texts. Physica A 2012; 391: 4406–4419.
View Article
Google Scholar

[186] View Article

[187] Google Scholar

[ref61] 61. Costa LF, Silva FN. Hierarchical characterization of complex networks. Journal of Statistical Physics 2006; 215(4): 841–872.
View Article
Google Scholar

[189] View Article

[190] Google Scholar

[ref62] 62. Carretero-Campos C, Bernaola-Galvn P, Coronado AV, Carpena P. Improving statistical keyword detection in short texts: entropic and clustering approaches. Physica A 2013; 392: 1481–1492.
View Article
Google Scholar

[192] View Article

[193] Google Scholar

[ref63] 63. Freeman L. A set of measures of centrality based on betweenness. Sociometry 1977; 40: 35–41.
View Article
Google Scholar

[195] View Article

[196] Google Scholar

[ref64] 64. Herrera JP, Pury PA. Statistical keyword detection in literary corpora. The European Physical Journal B 2008; 63: 135–146.
View Article
Google Scholar

[198] View Article

[199] Google Scholar

[ref65] 65. Duda RO, Hart PE, Stork DG. Pattern Classification. Wiley-Interscience; 2000.

[ref66] 66. Darrell T, Indyk P, Shakhnarovich F. Nearest neighbor methods in learning and vision: theory and practice. MIT Press. 2006.

[ref67] 67. Murthy SK. Automatic construction of decision trees from data: a multi-disciplinary survey. Data Min. Knowl. Discov 1998; 2: 345–389.
View Article
Google Scholar

[203] View Article

[204] Google Scholar

[ref68] 68. Hand DJ, Yu K. Idiot’s Bayes: not so stupid after all? Statistical Review 2001; 69: 385–398.
View Article
Google Scholar

[206] View Article

[207] Google Scholar

[ref69] 69. Cortes C, Vapnik V. Support-Vector networks. Machine Learning 1995; 20: 273.
View Article
Google Scholar

[209] View Article

[210] Google Scholar

[ref70] 70. Wu X, Kumar V, Quinlan JR, Ghosh J, Yang Q, Motoda H, McLachlan GJ, Ng A, Liu B, Yu PS, Zhou Z-H, Steinbach M, Hand DJ, Steinberg D. Top 10 algorithms in data mining. Knowl. Inf. Syst. 2007; 14(1): 1–37.
View Article
Google Scholar

[212] View Article

[213] Google Scholar

[ref71] 71. Juola P. Authorship attribution. Foundations and Trends in Information Retrieval 2006; 1:3.
View Article
Google Scholar

[215] View Article

[216] Google Scholar

[ref72] 72. Grant TD. Quantifying evidence for forensic authorship analysis. International Journal of Speech Language and the Law 2007; 14(1): 1–25.
View Article
Google Scholar

[218] View Article

[219] Google Scholar

[ref73] 73. Abbasi A, Chen H. Applying authorship analysis to extremist-group Web forum messages, IEEE Intelligent Systems 2005; 20(5): 67–75.
View Article
Google Scholar

[221] View Article

[222] Google Scholar

[ref74] 74. Ebrahimpour M, Putnins TJ, Berryman MJ, Allison A, Ng BW-H, Derek A. Automated authorship attribution using advanced signal classification techniques. PLoS ONE 2013; 8(2): e54998. pmid:23437047
View Article
PubMed/NCBI
Google Scholar

[224] View Article

[225] PubMed/NCBI

[226] Google Scholar

[ref75] 75. Mosteller F, Wallace DL. Inference and disputed authorship: The Federalist. Addison-Wesley; 1964.

[ref76] 76. Amancio DR, Comin CH, Casanova D, Travieso G, Bruno OM, Rodrigues FA, Costa LdF (2014) A systematic comparison of supervised classifiers. PLoS ONE 9 e94137. pmid:24763312
View Article
PubMed/NCBI
Google Scholar

[229] View Article

[230] PubMed/NCBI

[231] Google Scholar

[ref77] 77. Manning CD and Schutze H. Foundations of statistical natural language processing. MIT Press, Cambridge, MA, USA; 1999.

[ref78] 78. Golder SA, Macy MW. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science 2011; 333(6051): 1878–1881. pmid:21960633
View Article
PubMed/NCBI
Google Scholar

[234] View Article

[235] PubMed/NCBI

[236] Google Scholar

[ref79] 79. Cambria E, Schuller B, Xia Y, Havasi C. New avenues in opinion mining and sentiment analysis. IEEE Intelligent Systems 2013; 28(2): 15–21.
View Article
Google Scholar

[238] View Article

[239] Google Scholar

[ref80] 80. Dreher H (2007) Automatic conceptual analysis for plagiarism detection. Information and Beyond: The Journal of Issues in Informing Science and Information Technology 4: 601–614.
View Article
Google Scholar

[241] View Article

[242] Google Scholar

[ref81] 81. Amancio DR. Authorship recognition via fluctuation analysis of network topology and word intermittency. Manuscript under review.

[ref82] 82. Karsai M, Perra N, Vespignani A. Time-varying networks and the weakness of strong ties. Scientific Reports 2014; 4: 4001. pmid:24510159
View Article
PubMed/NCBI
Google Scholar

[245] View Article

[246] PubMed/NCBI

[247] Google Scholar

Figures

Abstract

Introduction

Materials and Methods

Modeling texts as complex networks

Topological characterization of textual networks

Pattern recognition methods

Results

Variability of measurements

Authorship recognition via topological analysis of subtexts

Conclusions

Supporting Information

S1 Dataset. List of books employed in the experiments.

Author Contributions

References