Versatile Loco-Manipulation through Flexible Interlimb Coordination

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhu, Xinghao, Chen, Yuxin, Sun, Lingfeng, Niroui, Farzad, Cleac'h, Simon Le, Wang, Jiuguang, Fang, Kuan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909645700857856
author Zhu, Xinghao
Chen, Yuxin
Sun, Lingfeng
Niroui, Farzad
Cleac'h, Simon Le
Wang, Jiuguang
Fang, Kuan
author_facet Zhu, Xinghao
Chen, Yuxin
Sun, Lingfeng
Niroui, Farzad
Cleac'h, Simon Le
Wang, Jiuguang
Fang, Kuan
contents The ability to flexibly leverage limbs for loco-manipulation is essential for enabling autonomous robots to operate in unstructured environments. Yet, prior work on loco-manipulation is often constrained to specific tasks or predetermined limb configurations. In this work, we present Reinforcement Learning for Interlimb Coordination (ReLIC), an approach that enables versatile loco-manipulation through flexible interlimb coordination. The key to our approach is an adaptive controller that seamlessly bridges the execution of manipulation motions and the generation of stable gaits based on task demands. Through the interplay between two controller modules, ReLIC dynamically assigns each limb for manipulation or locomotion and robustly coordinates them to achieve the task success. Using efficient reinforcement learning in simulation, ReLIC learns to perform stable gaits in accordance with the manipulation goals in the real world. To solve diverse and complex tasks, we further propose to interface the learned controller with different types of task specifications, including target trajectories, contact points, and natural language instructions. Evaluated on 12 real-world tasks that require diverse and complex coordination patterns, ReLIC demonstrates its versatility and robustness by achieving a success rate of 78.9% on average. Videos and code can be found at https://relic-locoman.rai-inst.com.
format Preprint
id arxiv_https___arxiv_org_abs_2506_07876
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Versatile Loco-Manipulation through Flexible Interlimb Coordination
Zhu, Xinghao
Chen, Yuxin
Sun, Lingfeng
Niroui, Farzad
Cleac'h, Simon Le
Wang, Jiuguang
Fang, Kuan
Robotics
Systems and Control
The ability to flexibly leverage limbs for loco-manipulation is essential for enabling autonomous robots to operate in unstructured environments. Yet, prior work on loco-manipulation is often constrained to specific tasks or predetermined limb configurations. In this work, we present Reinforcement Learning for Interlimb Coordination (ReLIC), an approach that enables versatile loco-manipulation through flexible interlimb coordination. The key to our approach is an adaptive controller that seamlessly bridges the execution of manipulation motions and the generation of stable gaits based on task demands. Through the interplay between two controller modules, ReLIC dynamically assigns each limb for manipulation or locomotion and robustly coordinates them to achieve the task success. Using efficient reinforcement learning in simulation, ReLIC learns to perform stable gaits in accordance with the manipulation goals in the real world. To solve diverse and complex tasks, we further propose to interface the learned controller with different types of task specifications, including target trajectories, contact points, and natural language instructions. Evaluated on 12 real-world tasks that require diverse and complex coordination patterns, ReLIC demonstrates its versatility and robustness by achieving a success rate of 78.9% on average. Videos and code can be found at https://relic-locoman.rai-inst.com.
title Versatile Loco-Manipulation through Flexible Interlimb Coordination
topic Robotics
Systems and Control
url https://arxiv.org/abs/2506.07876