Safe Multi-Agent Reinforcement Learning for Behavior-Based Cooperative Navigation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909854677860352 |
|---|---|
| author | Dawood, Murad Pan, Sicong Dengler, Nils Zhou, Siqi Schoellig, Angela P. Bennewitz, Maren |
| author_facet | Dawood, Murad Pan, Sicong Dengler, Nils Zhou, Siqi Schoellig, Angela P. Bennewitz, Maren |
| contents | In this paper, we address the problem of behavior-based cooperative navigation of mobile robots using safe multi-agent reinforcement learning~(MARL). Our work is the first to focus on cooperative navigation without individual reference targets for the robots, using a single target for the formation's centroid. This eliminates the complexities involved in having several path planners to control a team of robots. To ensure safety, our MARL framework uses model predictive control (MPC) to prevent actions that could lead to collisions during training and execution. We demonstrate the effectiveness of our method in simulation and on real robots, achieving safe behavior-based cooperative navigation without using individual reference targets, with zero collisions, and faster target reaching compared to baselines. Finally, we study the impact of MPC safety filters on the learning process, revealing that we achieve faster convergence during training and we show that our approach can be safely deployed on real robots, even during early stages of the training. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_12861 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Safe Multi-Agent Reinforcement Learning for Behavior-Based Cooperative Navigation Dawood, Murad Pan, Sicong Dengler, Nils Zhou, Siqi Schoellig, Angela P. Bennewitz, Maren Robotics In this paper, we address the problem of behavior-based cooperative navigation of mobile robots using safe multi-agent reinforcement learning~(MARL). Our work is the first to focus on cooperative navigation without individual reference targets for the robots, using a single target for the formation's centroid. This eliminates the complexities involved in having several path planners to control a team of robots. To ensure safety, our MARL framework uses model predictive control (MPC) to prevent actions that could lead to collisions during training and execution. We demonstrate the effectiveness of our method in simulation and on real robots, achieving safe behavior-based cooperative navigation without using individual reference targets, with zero collisions, and faster target reaching compared to baselines. Finally, we study the impact of MPC safety filters on the learning process, revealing that we achieve faster convergence during training and we show that our approach can be safely deployed on real robots, even during early stages of the training. |
| title | Safe Multi-Agent Reinforcement Learning for Behavior-Based Cooperative Navigation |
| topic | Robotics |
| url | https://arxiv.org/abs/2312.12861 |