Reinforcement learning with reputation-based adaptive exploration promotes the evolution of cooperation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910116132945920 |
|---|---|
| author | Li, An Zhu, Wenqiang Wang, Chaoqian Liu, Longzhao Zheng, Hongwei Jiang, Yishen Wang, Xin Tang, Shaoting |
| author_facet | Li, An Zhu, Wenqiang Wang, Chaoqian Liu, Longzhao Zheng, Hongwei Jiang, Yishen Wang, Xin Tang, Shaoting |
| contents | Multi-agent reinforcement learning serves as an effective tool for studying strategy adaptation in evolutionary games. Although prior work has integrated Q-learning with reputation mechanisms to promote cooperation, most existing algorithms adopt fixed exploration rates and overlook the influence of social context on exploratory behavior. In practice, individuals may adjust their willingness to explore based on their reputation and perceived social standing. To address this, we propose a Q-learning model that couples exploration rates with local reputation differences and incorporates asymmetric, state-dependent reputation updates. Our results show that each mechanism independently promotes cooperation, and their combination yields a reinforcing effect. The joint mechanism enhances cooperation by making ``high reputation--low exploration, low reputation--high exploration'', while adjusting reputation updates to amplify cooperative gains at low status and defection penalties at high status. This study thus offers insights into how social evaluation can shape learning behavior in complex environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_08103 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Reinforcement learning with reputation-based adaptive exploration promotes the evolution of cooperation Li, An Zhu, Wenqiang Wang, Chaoqian Liu, Longzhao Zheng, Hongwei Jiang, Yishen Wang, Xin Tang, Shaoting Computational Physics Multi-agent reinforcement learning serves as an effective tool for studying strategy adaptation in evolutionary games. Although prior work has integrated Q-learning with reputation mechanisms to promote cooperation, most existing algorithms adopt fixed exploration rates and overlook the influence of social context on exploratory behavior. In practice, individuals may adjust their willingness to explore based on their reputation and perceived social standing. To address this, we propose a Q-learning model that couples exploration rates with local reputation differences and incorporates asymmetric, state-dependent reputation updates. Our results show that each mechanism independently promotes cooperation, and their combination yields a reinforcing effect. The joint mechanism enhances cooperation by making ``high reputation--low exploration, low reputation--high exploration'', while adjusting reputation updates to amplify cooperative gains at low status and defection penalties at high status. This study thus offers insights into how social evaluation can shape learning behavior in complex environments. |
| title | Reinforcement learning with reputation-based adaptive exploration promotes the evolution of cooperation |
| topic | Computational Physics |
| url | https://arxiv.org/abs/2604.08103 |