LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sun, Chuanneng, Huang, Songjun, Pompili, Dario
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910452692287488
author Sun, Chuanneng
Huang, Songjun
Pompili, Dario
author_facet Sun, Chuanneng
Huang, Songjun
Pompili, Dario
contents In recent years, Large Language Models (LLMs) have shown great abilities in various tasks, including question answering, arithmetic problem solving, and poem writing, among others. Although research on LLM-as-an-agent has shown that LLM can be applied to Reinforcement Learning (RL) and achieve decent results, the extension of LLM-based RL to Multi-Agent System (MAS) is not trivial, as many aspects, such as coordination and communication between agents, are not considered in the RL frameworks of a single agent. To inspire more research on LLM-based MARL, in this letter, we survey the existing LLM-based single-agent and multi-agent RL frameworks and provide potential research directions for future research. In particular, we focus on the cooperative tasks of multiple agents with a common goal and communication among them. We also consider human-in/on-the-loop scenarios enabled by the language component in the framework.
format Preprint
id arxiv_https___arxiv_org_abs_2405_11106
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions
Sun, Chuanneng
Huang, Songjun
Pompili, Dario
Multiagent Systems
Artificial Intelligence
Computation and Language
Machine Learning
Robotics
In recent years, Large Language Models (LLMs) have shown great abilities in various tasks, including question answering, arithmetic problem solving, and poem writing, among others. Although research on LLM-as-an-agent has shown that LLM can be applied to Reinforcement Learning (RL) and achieve decent results, the extension of LLM-based RL to Multi-Agent System (MAS) is not trivial, as many aspects, such as coordination and communication between agents, are not considered in the RL frameworks of a single agent. To inspire more research on LLM-based MARL, in this letter, we survey the existing LLM-based single-agent and multi-agent RL frameworks and provide potential research directions for future research. In particular, we focus on the cooperative tasks of multiple agents with a common goal and communication among them. We also consider human-in/on-the-loop scenarios enabled by the language component in the framework.
title LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions
topic Multiagent Systems
Artificial Intelligence
Computation and Language
Machine Learning
Robotics
url https://arxiv.org/abs/2405.11106