Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communication
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910711942217728 |
|---|---|
| author | Li, Huao Mahjoub, Hossein Nourkhiz Chalaki, Behdad Tadiparthi, Vaishnav Lee, Kwonjoon Moradi-Pari, Ehsan Lewis, Charles Michael Sycara, Katia P |
| author_facet | Li, Huao Mahjoub, Hossein Nourkhiz Chalaki, Behdad Tadiparthi, Vaishnav Lee, Kwonjoon Moradi-Pari, Ehsan Lewis, Charles Michael Sycara, Katia P |
| contents | Multi-Agent Reinforcement Learning (MARL) methods have shown promise in enabling agents to learn a shared communication protocol from scratch and accomplish challenging team tasks. However, the learned language is usually not interpretable to humans or other agents not co-trained together, limiting its applicability in ad-hoc teamwork scenarios. In this work, we propose a novel computational pipeline that aligns the communication space between MARL agents with an embedding space of human natural language by grounding agent communications on synthetic data generated by embodied Large Language Models (LLMs) in interactive teamwork scenarios. Our results demonstrate that introducing language grounding not only maintains task performance but also accelerates the emergence of communication. Furthermore, the learned communication protocols exhibit zero-shot generalization capabilities in ad-hoc teamwork scenarios with unseen teammates and novel task states. This work presents a significant step toward enabling effective communication and collaboration between artificial agents and humans in real-world teamwork settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_17348 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communication Li, Huao Mahjoub, Hossein Nourkhiz Chalaki, Behdad Tadiparthi, Vaishnav Lee, Kwonjoon Moradi-Pari, Ehsan Lewis, Charles Michael Sycara, Katia P Multiagent Systems Multi-Agent Reinforcement Learning (MARL) methods have shown promise in enabling agents to learn a shared communication protocol from scratch and accomplish challenging team tasks. However, the learned language is usually not interpretable to humans or other agents not co-trained together, limiting its applicability in ad-hoc teamwork scenarios. In this work, we propose a novel computational pipeline that aligns the communication space between MARL agents with an embedding space of human natural language by grounding agent communications on synthetic data generated by embodied Large Language Models (LLMs) in interactive teamwork scenarios. Our results demonstrate that introducing language grounding not only maintains task performance but also accelerates the emergence of communication. Furthermore, the learned communication protocols exhibit zero-shot generalization capabilities in ad-hoc teamwork scenarios with unseen teammates and novel task states. This work presents a significant step toward enabling effective communication and collaboration between artificial agents and humans in real-world teamwork settings. |
| title | Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communication |
| topic | Multiagent Systems |
| url | https://arxiv.org/abs/2409.17348 |