AutoMisty: A Multi-Agent LLM Framework for Automated Code Generation in the Misty Social Robot
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915458740912128 |
|---|---|
| author | Wang, Xiao Dong, Lu Rangasrinivasan, Sahana Nwogu, Ifeoma Setlur, Srirangaraj Govindaraju, Venugopal |
| author_facet | Wang, Xiao Dong, Lu Rangasrinivasan, Sahana Nwogu, Ifeoma Setlur, Srirangaraj Govindaraju, Venugopal |
| contents | The social robot's open API allows users to customize open-domain interactions. However, it remains inaccessible to those without programming experience. In this work, we introduce AutoMisty, the first multi-agent collaboration framework powered by large language models (LLMs), to enable the seamless generation of executable Misty robot code from natural language instructions. AutoMisty incorporates four specialized agent modules to manage task decomposition, assignment, problem-solving, and result synthesis. Each agent incorporates a two-layer optimization mechanism, with self-reflection for iterative refinement and human-in-the-loop for better alignment with user preferences. AutoMisty ensures a transparent reasoning process, allowing users to iteratively refine tasks through natural language feedback for precise execution. To evaluate AutoMisty's effectiveness, we designed a benchmark task set spanning four levels of complexity and conducted experiments in a real Misty robot environment. Extensive evaluations demonstrate that AutoMisty not only consistently generates high-quality code but also enables precise code control, significantly outperforming direct reasoning with ChatGPT-4o and ChatGPT-o1. All code, optimized APIs, and experimental videos will be publicly released through the webpage: https://wangxiaoshawn.github.io/AutoMisty.html |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_06791 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AutoMisty: A Multi-Agent LLM Framework for Automated Code Generation in the Misty Social Robot Wang, Xiao Dong, Lu Rangasrinivasan, Sahana Nwogu, Ifeoma Setlur, Srirangaraj Govindaraju, Venugopal Robotics Artificial Intelligence Human-Computer Interaction Multiagent Systems The social robot's open API allows users to customize open-domain interactions. However, it remains inaccessible to those without programming experience. In this work, we introduce AutoMisty, the first multi-agent collaboration framework powered by large language models (LLMs), to enable the seamless generation of executable Misty robot code from natural language instructions. AutoMisty incorporates four specialized agent modules to manage task decomposition, assignment, problem-solving, and result synthesis. Each agent incorporates a two-layer optimization mechanism, with self-reflection for iterative refinement and human-in-the-loop for better alignment with user preferences. AutoMisty ensures a transparent reasoning process, allowing users to iteratively refine tasks through natural language feedback for precise execution. To evaluate AutoMisty's effectiveness, we designed a benchmark task set spanning four levels of complexity and conducted experiments in a real Misty robot environment. Extensive evaluations demonstrate that AutoMisty not only consistently generates high-quality code but also enables precise code control, significantly outperforming direct reasoning with ChatGPT-4o and ChatGPT-o1. All code, optimized APIs, and experimental videos will be publicly released through the webpage: https://wangxiaoshawn.github.io/AutoMisty.html |
| title | AutoMisty: A Multi-Agent LLM Framework for Automated Code Generation in the Misty Social Robot |
| topic | Robotics Artificial Intelligence Human-Computer Interaction Multiagent Systems |
| url | https://arxiv.org/abs/2503.06791 |