Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917213850566656 |
|---|---|
| author | Yoon, Taerim Kang, Dongho Cheng, Jin Zargarbashi, Fatemeh Huang, Yijiang Ahn, Minsung Coros, Stelian Choi, Sungjoon |
| author_facet | Yoon, Taerim Kang, Dongho Cheng, Jin Zargarbashi, Fatemeh Huang, Yijiang Ahn, Minsung Coros, Stelian Choi, Sungjoon |
| contents | In this work, we aim to enable legged robots to learn how to interpret human social cues and produce appropriate behaviors through physical human guidance. However, learning through physical engagement can place a heavy burden on users when the process requires large amounts of human-provided data. To address this, we propose a human-in-the-loop framework that enables robots to acquire navigational behaviors in a data-efficient manner and to be controlled via multimodal natural human inputs, specifically gestural and verbal commands. We reconstruct interaction scenes using a physics-based simulation and aggregate data to mitigate distributional shifts arising from limited demonstration data. Our progressive goal cueing strategy adaptively feeds appropriate commands and navigation goals during training, leading to more accurate navigation and stronger alignment between human input and robot behavior. We evaluate our framework across six real-world agile navigation scenarios, including jumping over or avoiding obstacles. Our experimental results show that our proposed method succeeds in almost all trials across these scenarios, achieving a 97.15% task success rate with less than 1 hour of demonstration data in total. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_08422 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech Yoon, Taerim Kang, Dongho Cheng, Jin Zargarbashi, Fatemeh Huang, Yijiang Ahn, Minsung Coros, Stelian Choi, Sungjoon Robotics In this work, we aim to enable legged robots to learn how to interpret human social cues and produce appropriate behaviors through physical human guidance. However, learning through physical engagement can place a heavy burden on users when the process requires large amounts of human-provided data. To address this, we propose a human-in-the-loop framework that enables robots to acquire navigational behaviors in a data-efficient manner and to be controlled via multimodal natural human inputs, specifically gestural and verbal commands. We reconstruct interaction scenes using a physics-based simulation and aggregate data to mitigate distributional shifts arising from limited demonstration data. Our progressive goal cueing strategy adaptively feeds appropriate commands and navigation goals during training, leading to more accurate navigation and stronger alignment between human input and robot behavior. We evaluate our framework across six real-world agile navigation scenarios, including jumping over or avoiding obstacles. Our experimental results show that our proposed method succeeds in almost all trials across these scenarios, achieving a 97.15% task success rate with less than 1 hour of demonstration data in total. |
| title | Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech |
| topic | Robotics |
| url | https://arxiv.org/abs/2601.08422 |