RoboFactory: Exploring Embodied Agent Collaboration with Compositional Constraints
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916658227970048 |
|---|---|
| author | Qin, Yiran Kang, Li Song, Xiufeng Yin, Zhenfei Liu, Xiaohong Liu, Xihui Zhang, Ruimao Bai, Lei |
| author_facet | Qin, Yiran Kang, Li Song, Xiufeng Yin, Zhenfei Liu, Xiaohong Liu, Xihui Zhang, Ruimao Bai, Lei |
| contents | Designing effective embodied multi-agent systems is critical for solving complex real-world tasks across domains. Due to the complexity of multi-agent embodied systems, existing methods fail to automatically generate safe and efficient training data for such systems. To this end, we propose the concept of compositional constraints for embodied multi-agent systems, addressing the challenges arising from collaboration among embodied agents. We design various interfaces tailored to different types of constraints, enabling seamless interaction with the physical world. Leveraging compositional constraints and specifically designed interfaces, we develop an automated data collection framework for embodied multi-agent systems and introduce the first benchmark for embodied multi-agent manipulation, RoboFactory. Based on RoboFactory benchmark, we adapt and evaluate the method of imitation learning and analyzed its performance in different difficulty agent tasks. Furthermore, we explore the architectures and training strategies for multi-agent imitation learning, aiming to build safe and efficient embodied multi-agent systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_16408 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RoboFactory: Exploring Embodied Agent Collaboration with Compositional Constraints Qin, Yiran Kang, Li Song, Xiufeng Yin, Zhenfei Liu, Xiaohong Liu, Xihui Zhang, Ruimao Bai, Lei Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning Designing effective embodied multi-agent systems is critical for solving complex real-world tasks across domains. Due to the complexity of multi-agent embodied systems, existing methods fail to automatically generate safe and efficient training data for such systems. To this end, we propose the concept of compositional constraints for embodied multi-agent systems, addressing the challenges arising from collaboration among embodied agents. We design various interfaces tailored to different types of constraints, enabling seamless interaction with the physical world. Leveraging compositional constraints and specifically designed interfaces, we develop an automated data collection framework for embodied multi-agent systems and introduce the first benchmark for embodied multi-agent manipulation, RoboFactory. Based on RoboFactory benchmark, we adapt and evaluate the method of imitation learning and analyzed its performance in different difficulty agent tasks. Furthermore, we explore the architectures and training strategies for multi-agent imitation learning, aiming to build safe and efficient embodied multi-agent systems. |
| title | RoboFactory: Exploring Embodied Agent Collaboration with Compositional Constraints |
| topic | Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2503.16408 |