Evolutionary Cooperation with Game Transitions via Markov Decision Chain in Networked Population

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Chaoyang, Zhang, Yuji, Feng, Minyu, Szolnoki, Attila
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918264376918016
author Luo, Chaoyang
Zhang, Yuji
Feng, Minyu
Szolnoki, Attila
author_facet Luo, Chaoyang
Zhang, Yuji
Feng, Minyu
Szolnoki, Attila
contents Individual cooperative strategy influences the surrounding dynamic population, which in turn affects cooperative strategy. To better model this phenomenon, we develop a Markov decision chain based game transitions model and examine the dynamic transitions in game states of individuals within a network and their impact on the strategy's evolution. Additionally, we extend single-round strategy imitation to multiple rounds to better capture players' potential non-rational behavior. Using intensive simulations, we explore the effects of transition probabilities and game parameters on game transitions and cooperation. Our study finds that strategy-driven game transitions promote cooperation, and increasing the transition rates of Markov decision chains can significantly accelerate this process. By designing different Markov decision chains, these results provide simulation based guidance for practical applications in swarm intelligence, such as strategic collaboration.
format Preprint
id arxiv_https___arxiv_org_abs_2512_18972
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Evolutionary Cooperation with Game Transitions via Markov Decision Chain in Networked Population
Luo, Chaoyang
Zhang, Yuji
Feng, Minyu
Szolnoki, Attila
Physics and Society
Social and Information Networks
Individual cooperative strategy influences the surrounding dynamic population, which in turn affects cooperative strategy. To better model this phenomenon, we develop a Markov decision chain based game transitions model and examine the dynamic transitions in game states of individuals within a network and their impact on the strategy's evolution. Additionally, we extend single-round strategy imitation to multiple rounds to better capture players' potential non-rational behavior. Using intensive simulations, we explore the effects of transition probabilities and game parameters on game transitions and cooperation. Our study finds that strategy-driven game transitions promote cooperation, and increasing the transition rates of Markov decision chains can significantly accelerate this process. By designing different Markov decision chains, these results provide simulation based guidance for practical applications in swarm intelligence, such as strategic collaboration.
title Evolutionary Cooperation with Game Transitions via Markov Decision Chain in Networked Population
topic Physics and Society
Social and Information Networks
url https://arxiv.org/abs/2512.18972