Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.04229 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912468465352704 |
|---|---|
| author | Hou, Dianyong Zhu, Chengrui Zhang, Zhen Li, Zhibin Guo, Chuang Liu, Yong |
| author_facet | Hou, Dianyong Zhu, Chengrui Zhang, Zhen Li, Zhibin Guo, Chuang Liu, Yong |
| contents | Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control. Reinforcement learning (RL) offers a promising solution to address these challenges by learning optimal control policies through interaction. Nevertheless, RL methods often struggle with local optima when exploring large solution spaces for motion and manipulation tasks. To overcome these limitations, we propose a novel approach that integrates an explicit kinematic model of the manipulator into the RL framework. This integration provides feedback on the mapping of the body postures to the manipulator's workspace, guiding the RL exploration process and effectively mitigating the local optima issue. Our algorithm has been successfully deployed on a DeepRobotics X20 quadruped robot equipped with a Unitree Z1 manipulator, and extensive experimental results demonstrate the superior performance of this approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_04229 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Efficient Learning of A Unified Policy For Whole-body Manipulation and Locomotion Skills Hou, Dianyong Zhu, Chengrui Zhang, Zhen Li, Zhibin Guo, Chuang Liu, Yong Robotics Systems and Control Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control. Reinforcement learning (RL) offers a promising solution to address these challenges by learning optimal control policies through interaction. Nevertheless, RL methods often struggle with local optima when exploring large solution spaces for motion and manipulation tasks. To overcome these limitations, we propose a novel approach that integrates an explicit kinematic model of the manipulator into the RL framework. This integration provides feedback on the mapping of the body postures to the manipulator's workspace, guiding the RL exploration process and effectively mitigating the local optima issue. Our algorithm has been successfully deployed on a DeepRobotics X20 quadruped robot equipped with a Unitree Z1 manipulator, and extensive experimental results demonstrate the superior performance of this approach. |
| title | Efficient Learning of A Unified Policy For Whole-body Manipulation and Locomotion Skills |
| topic | Robotics Systems and Control |
| url | https://arxiv.org/abs/2507.04229 |