CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917708874907648 |
|---|---|
| author | Wu, Pengying Mu, Yao Zhou, Kangjie Ma, Ji Chen, Junting Liu, Chang |
| author_facet | Wu, Pengying Mu, Yao Zhou, Kangjie Ma, Ji Chen, Junting Liu, Chang |
| contents | Visual navigation tasks are critical for household service robots. As these tasks become increasingly complex, effective communication and collaboration among multiple robots become imperative to ensure successful completion. In recent years, large language models (LLMs) have exhibited remarkable comprehension and planning abilities in the context of embodied agents. However, their application in household scenarios, specifically in the use of multiple agents collaborating to complete complex navigation tasks through communication, remains unexplored. Therefore, this paper proposes a framework for decentralized multi-agent navigation, leveraging LLM-enabled communication and collaboration. By designing the communication-triggered dynamic leadership organization structure, we achieve faster team consensus with fewer communication instances, leading to better navigation effectiveness and collaborative exploration efficiency. With the proposed novel communication scheme, our framework promises to be conflict-free and robust in multi-object navigation tasks, even when there is a surge in team size. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_00632 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations Wu, Pengying Mu, Yao Zhou, Kangjie Ma, Ji Chen, Junting Liu, Chang Robotics Computation and Language Computer Vision and Pattern Recognition Multiagent Systems Visual navigation tasks are critical for household service robots. As these tasks become increasingly complex, effective communication and collaboration among multiple robots become imperative to ensure successful completion. In recent years, large language models (LLMs) have exhibited remarkable comprehension and planning abilities in the context of embodied agents. However, their application in household scenarios, specifically in the use of multiple agents collaborating to complete complex navigation tasks through communication, remains unexplored. Therefore, this paper proposes a framework for decentralized multi-agent navigation, leveraging LLM-enabled communication and collaboration. By designing the communication-triggered dynamic leadership organization structure, we achieve faster team consensus with fewer communication instances, leading to better navigation effectiveness and collaborative exploration efficiency. With the proposed novel communication scheme, our framework promises to be conflict-free and robust in multi-object navigation tasks, even when there is a surge in team size. |
| title | CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations |
| topic | Robotics Computation and Language Computer Vision and Pattern Recognition Multiagent Systems |
| url | https://arxiv.org/abs/2407.00632 |