Emergent Dominance Hierarchies in Reinforcement Learning Agents
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909229137264640 |
|---|---|
| author | Rachum, Ram Nakar, Yonatan Tomlinson, Bill Alon, Nitay Mirsky, Reuth |
| author_facet | Rachum, Ram Nakar, Yonatan Tomlinson, Bill Alon, Nitay Mirsky, Reuth |
| contents | Modern Reinforcement Learning (RL) algorithms are able to outperform humans in a wide variety of tasks. Multi-agent reinforcement learning (MARL) settings present additional challenges, and successful cooperation in mixed-motive groups of agents depends on a delicate balancing act between individual and group objectives. Social conventions and norms, often inspired by human institutions, are used as tools for striking this balance.
In this paper, we examine a fundamental, well-studied social convention that underlies cooperation in both animal and human societies: dominance hierarchies.
We adapt the ethological theory of dominance hierarchies to artificial agents, borrowing the established terminology and definitions with as few amendments as possible. We demonstrate that populations of RL agents, operating without explicit programming or intrinsic rewards, can invent, learn, enforce, and transmit a dominance hierarchy to new populations. The dominance hierarchies that emerge have a similar structure to those studied in chickens, mice, fish, and other species. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_12258 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Emergent Dominance Hierarchies in Reinforcement Learning Agents Rachum, Ram Nakar, Yonatan Tomlinson, Bill Alon, Nitay Mirsky, Reuth Multiagent Systems Artificial Intelligence Computer Science and Game Theory Machine Learning Modern Reinforcement Learning (RL) algorithms are able to outperform humans in a wide variety of tasks. Multi-agent reinforcement learning (MARL) settings present additional challenges, and successful cooperation in mixed-motive groups of agents depends on a delicate balancing act between individual and group objectives. Social conventions and norms, often inspired by human institutions, are used as tools for striking this balance. In this paper, we examine a fundamental, well-studied social convention that underlies cooperation in both animal and human societies: dominance hierarchies. We adapt the ethological theory of dominance hierarchies to artificial agents, borrowing the established terminology and definitions with as few amendments as possible. We demonstrate that populations of RL agents, operating without explicit programming or intrinsic rewards, can invent, learn, enforce, and transmit a dominance hierarchy to new populations. The dominance hierarchies that emerge have a similar structure to those studied in chickens, mice, fish, and other species. |
| title | Emergent Dominance Hierarchies in Reinforcement Learning Agents |
| topic | Multiagent Systems Artificial Intelligence Computer Science and Game Theory Machine Learning |
| url | https://arxiv.org/abs/2401.12258 |