Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Dependency Links Can Hinder the Evolution of Cooperation in the Prisoner’s Dilemma Game on Lattices and Networks

  • Xuwen Wang,

    Affiliation Department of Modern Physics, University of Science and Technology of China, Hefei, Anhui, 230026, P. R. China

  • Sen Nie,

    Affiliation Department of Modern Physics, University of Science and Technology of China, Hefei, Anhui, 230026, P. R. China

  • Binghong Wang

    bhwang@ustc.edu.cn

    Affiliations Department of Modern Physics, University of Science and Technology of China, Hefei, Anhui, 230026, P. R. China, College of Physics and Electronic Information Engineering, Wenzhou University, Wenzhou, Zhejiang, 325035, P. R. China, School of Science, Southwest University of Science and Technology, Mianyang, Sichuan, 621010, P. R. China

Abstract

Networks with dependency links are more vulnerable when facing the attacks. Recent research also has demonstrated that the interdependent groups support the spreading of cooperation. We study the prisoner’s dilemma games on spatial networks with dependency links, in which a fraction of individual pairs is selected to depend on each other. The dependency individuals can gain an extra payoff whose value is between the payoff of mutual cooperation and the value of temptation to defect. Thus, this mechanism reflects that the dependency relation is stronger than the relation of ordinary mutual cooperation, but it is not large enough to cause the defection of the dependency pair. We show that the dependence of individuals hinders, promotes and never affects the cooperation on regular ring networks, square lattice, random and scale-free networks, respectively. The results for the square lattice and regular ring networks are demonstrated by the pair approximation.

Introduction

Cooperation is a ubiquitous behavior that exists in the natural and social systems [13]. However, there are many social dilemmas, which prevent the cooperation among the selfish individuals, including the prisoner’s dilemma games [48], snowdrift games [9, 10] and public goods games [1116]. If both players aim at maximizing their own payoff, then no player has an incentive to switch unilaterally from defection to cooperation. Thus, to maintain and promote the cooperation is a fundamental problem in social and biology science. In the original PDG, the individuals can choose one of two strategies, cooperation or defection, and they both receive payoff R upon mutual cooperation and P upon mutual defection. If one defects while the other cooperates, the cooperator receives S while the defector gets T. The ranking of the four payoff values is T > R > P > S and 2R > T + S. To promote and characterize the cooperation of real systems, the games on the structured populations have been widely described, such as cooperation on square-lattice [1720], small-world [2123], scale-free [2426], and coevolving networks [2729]. Moreover, many evolutionary rules that can affect the cooperation have also been introduced, including the reward [30, 31], punishment [3235], diversity [14, 36, 37] and extortion strategy [3840].

Recently, motivated by the fact that the networks are often coupled together, the cooperation on the interdependent networks has been also studied [41, 42]. For two interdependent networks, the individuals in one network are linked to ones in the other network, and it has been demonstrated that these networks can support the reciprocity of prisoner’s dilemma games and public goods games. Besides this, another type of dependency relation is built in one network which contains both connectivity and dependency links [4345]. The former works mainly focused on how the interdependent structures affected the cooperation. While the consideration of repeated prisoner’s dilemma game is that most of us will interact with household members, colleagues, and other people in small-scale economic interactions again and again [1]. Hence, individuals will most likely behave differently when facing different interaction objects. Especially for kin relationship individual pairs, it is difficult for them to behave mutual defecting but they are always cooperating. Here, we introduce a dependency relation into the prisoner’s dilemma games to feature the interaction which is analogous to the kin relationship and other solid relations. The dependency individuals can gain an extra payoff, and this payoff is larger than the payoff of mutual cooperation R but is lower than the temptation to defect T. Hence, dependency relation is stronger than the ordinary mutual cooperation interaction, but not large enough to cause the defection. We find that the dependence of individuals hinders the cooperation on regular ring networks, while it slightly affects cooperation on random and scale-free networks. The only case that can promote the cooperation is the square lattice networks. In particular, below the half density of dependency links, the larger fraction of dependency pairs, the more disadvantage of cooperation for small average degree of regular ring networks.

The paper is organized as follows: Section 2 is the detailed description of the model. In Section 3, we present the simulation results. The Section 4 is the discussion.

Model

Individuals locate on the networks, in which each one is linked with its nearest neighbours. Initially, each individual is designated either as a cooperator or defector with equal probability and f fraction of individual pairs is selected randomly to interdepend with each other. For f = 0 the model reduces to the original PDG, while the whole individuals are dependency pairs for the case of f = 0.5. The higher value of f, the larger fraction of individuals are dependents. For each Monte Carlo step, individual x plays the PDG with its nearest neighbors. Its payoff contains two portions: the ordinary payoff and the payoff offered by dependency individual, respectively. Px is the sum of all the payoffs acquired from its nearest ordinary neighbours. However, if an individual is dependent with another one, then it can gain an extra payoff: (1) In this, for simplicity but without loss of generality, the payoff matrix for the PDG are rescaled such that R = 1, S = 0, T = b, P = 0, where 1 < b ≤ 2 represents the advantage of defectors over cooperators. Equation 1 guarantees the extra payoff 1 < Pe < b. Then, the individual x adopts a randomly selected neighbor y’s strategy with the probability: (2) where k> = max{ki, kj}, Θ = TS in the PDG and Pt(y) is the total payoff of individual y. We set network size N = 10000 for all simulations. We study the prisoner’s dilemma games on the regular ring networks, square lattice, random and scale-free networks. The regular ring networks and square lattice networks are used the periodic boundary conditions. The scale-free networks are generated by the Bárabasi-Albert model [46, 47].

Results

Firstly, we investigate how the dependency links affect the time evolution of cooperation level on regular ring networks for different dependency density f, which is shown in Fig. 1. To the original PDG with f = 0 and average degree < k > = 4, the cooperation level decreases rapidly due to the advantage of defection at the beginning of evolution. While the cooperators can survive in the structured population by forming the clusters, which in turn to increase the cooperation level in the latter steps. This is actually consistent with the fact that the structured population facilitates network reciprocity [18, 48]. But interestingly, the incorporating of dependency links makes the gradual increasing of cooperation level impossible, then the cooperation level finally arrives at a relatively lower value. In this sense, the dependency link weakens the effect of network reciprocity. For the case of < k > = 8, the dependency relation also hinders the cooperation. In particular, the higher density of dependency links, the greater resistance to cooperation behavior.

thumbnail
Fig 1. (Color online) Time evolving of cooperation level on the regular ring networks for b = 1.05 (a) The regular ring networks with k = 4 and (b) The regular ring networks with k = 8.

Each data point is an average of 100 independent realizations.

https://doi.org/10.1371/journal.pone.0121508.g001

To intuitively show the effect of dependency links on the cooperation for regular lattice networks, we examine the cooperation level as a function of temptation to defect b and dependency density f for different average degrees. Fig. 2 depicts that the dependence of individuals hinders the cooperation for both two average degrees which are irrespective with the value of b. To summarize, there are three distinct phenomenons for two average degrees: (i) The cooperation level is symmetric with f = 0.25 for < k > = 4, while it has no obvious symmetry of results for < k > = 8. (ii) As f < 0.25, the higher density of dependency links, the lower cooperation level for < k > = 4, which is totally different from the result for < k > = 8. (iii) The dependence of links affects the cooperation level greater for small average degree than that for large ones. Especially, the cooperation level has a larger downtrend as intermediate b for < k > = 4. If each individual can gain an extra payoff from its interdependent neighbour, then the strategy updating in Equation 2 hold unchanged. As a consequence, the density of cooperators for f = 0 is the same as f = 0.5.

thumbnail
Fig 2. (Color online) Cooperation level as a function of temptation to defect b for different dependency densities (a) The regular ring networks with k = 4 and (c) The regular ring networks with k = 8.

(b) and (d) are cooperation level on the bf parameter plane for k = 4 and 8, respectively. Each data point is an average of 500 independent realizations.

https://doi.org/10.1371/journal.pone.0121508.g002

The network’s structure plays an important role in the evolutionary games. It has been proved that the scale-free networks can greatly support the cooperation due to the existence of hub nodes [24]. Hence, it is necessary for us to examine the cooperation level as a function of b for the random networks and scale-free networks with dependency links. Unlike to the results of regular ring networks in Fig. 2, the fraction of dependency links no longer affects the cooperation as shown in Fig. 3. Indeed, the regular ring networks and scale-free networks are two examples of the simple degree-homogeneous and highly degree-heterogeneous graphs, respectively [25]. Above results demonstrate that the dependency relation can only affect the evolution of cooperation on the degree-homogeneous networks. On the contrary, the extra payoff for the individuals cannot change the tendency of strategy adoption. As an example, examining the case of a CD individual pair in the competing domains. The cooperator surrounded by its neighbours may have a payoff PC = 3(< k > = 4), while the defector may get a payoff PD = 2b from its ordinary neighbours. However, the payoff of defector may be larger than that of cooperator when the defector can gain an extra payoff from its dependent neighbour, and then the strategy adoption DC turns into CD. This transformation induces the increment of cooperation level impossible, which is consistent with the simulation result in Fig. 1. However, the situation of the degree-heterogeneous networks can be significantly different. The larger differences of kCkD and PCPD make the extra payoff Pe cannot be large enough to change the transformation from DC into CD. We can also observe the similar results for large b in Fig. 2(a) and Fig. 2(c).

thumbnail
Fig 3. (Color online) Cooperation level as a function of temptation to defect b (a) The random networks with < k > = 4 and (b) The scale-free networks with < k > = 4.

Each data point is an average of 500 independent realizations.

https://doi.org/10.1371/journal.pone.0121508.g003

Next, we examine the results on the square lattice networks, which are also degree-homogeneous graphs. Very interestingly in Fig. 4(a), we observe that the dependency relation can slightly support the cooperation, which is contrary to the results of regular ring networks even if both of them have the same degree distribution. The higher density of dependency links, the more contribution to cooperation. Even if two different types of networks have the exact same degree distribution, but their clustering coefficients are different. The square lattice network has no triangles, hence its clustering coefficient C = 0 [49]. Nevertheless, the regular ring network has C = 1/2. This difference may cause the entirely different phenomenons of cooperation level on the regular ring networks and square lattice networks with dependency links.

thumbnail
Fig 4. (Color online) Cooperation level as a function of temptation to defect b (a) The square lattice with k = 4 and (b) The curves obtained by the pair approximation approach for the regular networks with k = 4.

Each data point in (a) is an average of 500 independent realizations.

https://doi.org/10.1371/journal.pone.0121508.g004

Finally, We apply the pair approximation method [50, 51] to qualitatively predict cooperation behavior by incorporating the dependency relation. For the focal sites A and B, the strategy of the player A is updated by comparing his performance to a randomly chosen neighbour B. The payoffs PA and PB of A and B are determined by the total payoffs from their neighbours x, y, z, B and u, v, w, A, respectively. The pair approximation is completed by determining the evolution of the pair configuration probability, that is, the probability that the pair pA,B becomes pB,B: (3) The evolving of cooperation level can be obtained by the following ordinary differential equations: (4) (5) Where nc(x, y, z) is the number of cooperators among the neighbours x, y, z, and Pc(x, y, z) and Pd(x, y, z) specify the payoffs of a cooperator(defector) interacting with the neighbours x, y, z plus a defector(cooperator). In Equation 4 and 5, f(PcPd) and f(PdPc) are the expectation transition probability. The equilibrium values are obtained by numerical integration and the common factor 2p(c,d)/(pc3pd3) is omitted. The fraction of cooperators in the whole population is calculated by pc = pc,c + pc,d.

The prediction result in Fig. 4(b) shows that the dependency relation hinders the cooperation level and the higher density of dependency links induces the lower cooperation level. In addition, it also depicts that the cooperation level is symmetric with f = 0.25. Because the predictions of the pair approximation for any two regular graphs with the same average degree k are exactly the same [25], then the Fig. 4(b) only correctly presents the evolving tendency of cooperation level for regular ring networks. Additionally, it significantly over-estimates the benefits of population structures, which is similar to the results in Ref [50].

Discussion

Many natural and man-made systems can be modeled as networks. Generally, the networks are interdependent with each other. The nodes in one network may depend on others in another network, then the failure of a node also causes the failure of its interdependent node [5254]. In addition, a single network can also contain both connectivity and dependency links together [43, 44]. The dependency relation is also used to study the cooperation behaviors, and it has been demonstrated that interdependent networks can spread the cooperation [41, 42]. Motivated by the fact that individuals behave differently when facing the various interaction objects, we introduce a dependency relation into the spatial prisoner’s dilemma games to examine whether the dependency links can also promote the cooperation as the same as former researches. Specifically, a fraction f of individual pairs is selected randomly to depend with each other. This dependency relation can bring an extra payoff to the individual which is between the payoff of mutual cooperation R and temptation to defect T. The motivation of this setup is that the dependency relation ought to be stronger than ordinary cooperation but it cannot induce the defection between the dependent individuals.

It is found that the dependency relation hinders the cooperation on the regular ring networks, while it cannot affect the cooperation on random networks and scale-free networks. The only case that it can promote is the square lattice networks. Whether the dependency relation can affect the cooperation is determined by the homogeneous or heterogeneous of degree. For degree-heterogeneous networks, the extra payoff obtained from the individual’s dependency neighbour cannot change the transformation of the strategy adoption, hence, the dependency relation has no effects on the evolving of cooperation. Our result indicates that the dependency links cannot greatly promote the cooperation of spatial prisoner’s dilemma games, which is also different from the recent research.

Author Contributions

Conceived and designed the experiments: XW. Performed the experiments: XW. Analyzed the data: XW. Contributed reagents/materials/analysis tools: XW. Wrote the paper: SN BW.

References

  1. 1. Sigmund K (2010) The calculus of selfishness. Princeton University Press.
  2. 2. Axelrod RM (2006) The evolution of cooperation. Basic books.
  3. 3. Fehr E, Fischbacher U (2004) Social norms and human cooperation. Trends in cognitive sciences 8: 185–190. pmid:15050515
  4. 4. Perc M, Wang Z (2010) Heterogeneous aspirations promote cooperation in the prisoner’s dilemma game. PLoS One 5: e15117. pmid:21151898
  5. 5. Meloni S, Buscarino A, Fortuna L, Frasca M, Gómez-Gardeñes J, et al. (2009) Effects of mobility in a population of prisoners dilemma players. Physical Review E 79: 067101.
  6. 6. Wang Z, Wang L, Yin ZY, Xia CY (2012) Inferring reputation promotes the evolution of cooperation in spatial social dilemma games. PLoS One 7: e40218. pmid:22808120
  7. 7. Gracia-Lázaro C, Ferrer A, Ruiz G, Tarancón A, Cuesta JA, et al. (2012) Heterogeneous networks do not promote cooperation when humans play a prisoners dilemma. Proceedings of the National Academy of Sciences 109: 12922–12926.
  8. 8. Rong Z, Wu ZX, Chen G (2013) Coevolution of strategy-selection time scale and cooperation in spatial prisoner’s dilemma game. EPL (Europhysics Letters) 102: 68005.
  9. 9. Wang WX, Ren J, Chen G, Wang BH (2006) Memory-based snowdrift game on networks. Physical Review E 74: 056113.
  10. 10. Du WB, Cao XB, Hu MB, Wang WX (2009) Asymmetric cost in snowdrift game on scale-free networks. EPL (Europhysics Letters) 87: 60004.
  11. 11. Szolnoki A, Perc M, Szabó G (2009) Topology-independent impact of noise on cooperation in spatial public goods games. Physical Review E 80: 056109.
  12. 12. Szolnoki A, Perc M (2012) Conditional strategies and the evolution of cooperation in spatial public goods games. Physical Review E 85: 026104.
  13. 13. Szabó G, Hauert C (2002) Phase transitions and volunteering in spatial public goods games. Physical Review Letters 89: 118101. pmid:12225171
  14. 14. Santos FC, Santos MD, Pacheco JM (2008) Social diversity promotes the emergence of cooperation in public goods games. Nature 454: 213–216. pmid:18615084
  15. 15. Hauert C, De Monte S, Hofbauer J, Sigmund K (2002) Volunteering as red queen mechanism for cooperation in public goods games. Science 296: 1129–1132. pmid:12004134
  16. 16. Wang Z, Szolnoki A, Perc M (2012) Percolation threshold determines the optimal population density for public cooperation. Physical Review E 85: 037101.
  17. 17. Vukov J (2014) Accurate reactions open up the way for more cooperative societies. Physical Review E 90: 032802.
  18. 18. Nowak MA, May RM (1992) Evolutionary games and spatial chaos. Nature 359: 826–829.
  19. 19. Szabó G, Hauert C (2002) Evolutionary prisoners dilemma games with voluntary participation. Physical Review E 66: 062903.
  20. 20. Wang Z, Perc M (2010) Aspiring to the fittest and promotion of cooperation in the prisoners dilemma game. Physical Review E 82: 021115.
  21. 21. Kim BJ, Trusina A, Holme P, Minnhagen P, Chung JS, et al. (2002) Dynamic instabilities induced by asymmetric influence: Prisoners dilemma game in small-world networks. Physical Review E 66: 021907.
  22. 22. Chen X, Wang L (2008) Promotion of cooperation induced by appropriate payoff aspirations in a small-world networked game. Physical Review E 77: 017103.
  23. 23. Wu ZX, Xu XJ, Chen Y, Wang YH (2005) Spatial prisoners dilemma game with volunteering in newman-watts small-world networks. Physical Review E 71: 037103.
  24. 24. Santos FC, Pacheco JM (2005) Scale-free networks provide a unifying framework for the emergence of cooperation. Physical Review Letters 95: 098104. pmid:16197256
  25. 25. Peña J, Volken H, Pestelacci E, Tomassini M (2009) Conformity hinders the evolution of cooperation on scale-free networks. Physical Review E 80: 016110.
  26. 26. Rong Z, Li X, Wang X (2007) Roles of mixing patterns in cooperation on a scale-free networked game. Physical Review E 76: 027101.
  27. 27. Rand DG, Arbesman S, Christakis NA (2011) Dynamic social networks promote cooperation in experiments with humans. Proceedings of the National Academy of Sciences 108: 19193–19198.
  28. 28. Ebel H, Bornholdt S (2002) Coevolutionary games on networks. Physical Review E 66: 056118.
  29. 29. Zimmermann MG, Eguíluz VM, San Miguel M, Spadaro A (2000) Cooperation in an adaptive network. Advances in Complex Systems 3: 283–297.
  30. 30. Wang Z, Szolnoki A, Perc M (2014) Rewarding evolutionary fitness with links between populations promotes cooperation. Journal of theoretical biology 349: 50–56. pmid:24508726
  31. 31. Szolnoki A, Perc M (2010) Reward and cooperation in the spatial public goods game. EPL (Euro-physics Letters) 92: 38003.
  32. 32. Brandt H, Hauert C, Sigmund K (2003) Punishment and reputation in spatial public goods games. Proceedings of the Royal Society of London Series B: Biological Sciences 270: 1099–1104. pmid:12803901
  33. 33. Perc M, Szolnoki A (2012) Self-organization of punishment in structured populations. New Journal of Physics 14: 043013.
  34. 34. Helbing D, Szolnoki A, Perc M, Szabó G (2010) Punish, but not too hard: how costly punishment spreads in the spatial public goods game. New Journal of Physics 12: 083005.
  35. 35. Wang Z, Xia CY, Meloni S, Zhou CS, Moreno Y (2013) Impact of social punishment on cooperative behavior in complex networks. Scientific Reports 3: 3055. pmid:24162105
  36. 36. Yang HX, Wang WX, Wu ZX, Lai YC, Wang BH (2009) Diversity-optimized cooperation on complex networks. Physical Review E 79: 056107.
  37. 37. Perc M, Szolnoki A (2008) Social diversity and promotion of cooperation in the spatial prisoners dilemma game. Physical Review E 77: 011904.
  38. 38. Press WH, Dyson FJ (2012) Iterated prisoners dilemma contains strategies that dominate any evolutionary opponent. Proceedings of the National Academy of Sciences 109: 10409–10413.
  39. 39. Hilbe C, Nowak MA, Sigmund K (2013) Evolution of extortion in iterated prisoners dilemma games. Proceedings of the National Academy of Sciences 110: 6913–6918.
  40. 40. Szolnoki A, Perc M (2014) Defection and extortion as unexpected catalysts of unconditional cooperation in structured populations. Scientific Reports 4: 5496. pmid:24975112
  41. 41. Wang Z, Szolnoki A, Perc M (2013) Interdependent network reciprocity in evolutionary games. Scientific Reports 3: 1183. pmid:23378915
  42. 42. Jiang LL, Perc M (2013) Spreading of cooperative behaviour across interdependent groups. Scientific Reports 3: 2483. pmid:23963495
  43. 43. Parshani R, Buldyrev SV, Havlin S (2011) Critical effect of dependency groups on the function of networks. Proceedings of the National Academy of Sciences 108: 1007–1010.
  44. 44. Bashan A, Havlin S (2011) The combined effect of connectivity and dependency links on percolation of networks. Journal of Statistical Physics 145: 686–695.
  45. 45. Boccaletti S, Bianconi G, Criado R, Del Genio C, Gómez-Gardeñes J, et al. (2014) The structure and dynamics of multilayer networks. Physics Reports 544: 1–122.
  46. 46. Barabási AL, Albert R (1999) Emergence of scaling in random networks. science 286: 509–512. pmid:10521342
  47. 47. Wang SJ, Wang Z, Jin T, Boccaletti S (2014) Emergence of disassortative mixing from pruning nodes in growing scale-free networks. Scientific Reports 4: 4095. pmid:24526076
  48. 48. Wang Z, Kokubo S, Tanimoto J, Fukuda E, Shigaki K (2013) Insight into the so-called spatial reciprocity. Physical Review E 88: 042145.
  49. 49. Szabó G, Vukov J, Szolnoki A (2005) Phase diagrams for an evolutionary prisoners dilemma game on two-dimensional lattices. Physical Review E 72: 047107.
  50. 50. Hauert C, Szabó G (2005) Game theory and physics. American Journal of Physics 73: 405–414.
  51. 51. Wu ZX, Yang HX (2014) Social dilemma alleviated by sharing the gains with immediate neighbors. Physical Review E 89: 012109.
  52. 52. Gao J, Buldyrev SV, Havlin S, Stanley HE (2011) Robustness of a network of networks. Physical Review Letters 107: 195701. pmid:22181627
  53. 53. Li W, Bashan A, Buldyrev SV, Stanley HE, Havlin S (2012) Cascading failures in interdependent lattice networks: The critical role of the length of dependency links. Physical Review Letters 108: 228702. pmid:23003664
  54. 54. Parshani R, Buldyrev SV, Havlin S (2010) Interdependent networks: Reducing the coupling strength leads to a change from a first to second order percolation transition. Physical Review Letters 105: 048701. pmid:20867893