Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916181779152896 |
|---|---|
| author | Wang, Zifan Jia, Yufei Shi, Lu Wang, Haoyu Zhao, Haizhou Li, Xueyang Zhou, Jinni Ma, Jun Zhou, Guyue |
| author_facet | Wang, Zifan Jia, Yufei Shi, Lu Wang, Haoyu Zhao, Haizhou Li, Xueyang Zhou, Jinni Ma, Jun Zhou, Guyue |
| contents | Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for control objectives. In this paper, we introduce an arm-constrained curriculum learning architecture to tackle the issues introduced by adding the manipulator. Firstly, we develop an arm-constrained reinforcement learning algorithm to ensure safety and stability in control performance. Additionally, to address discrepancies in reward settings between the arm and the base, we propose a reward-aware curriculum learning method. The policy is first trained in Isaac gym and transferred to the physical robot to do dynamic grasping tasks, including the door-opening task, fan-twitching task and the relay-baton-picking and following task. The results demonstrate that our proposed approach effectively controls the arm-equipped wheel-legged robot to master dynamic grasping skills, allowing it to chase and catch a moving object while in motion. Please refer to our website (https://acodedog.github.io/wheel-legged-loco-manipulation) for the code and supplemental videos. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_16535 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot Wang, Zifan Jia, Yufei Shi, Lu Wang, Haoyu Zhao, Haizhou Li, Xueyang Zhou, Jinni Ma, Jun Zhou, Guyue Robotics Incorporating a robotic manipulator into a wheel-legged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for control objectives. In this paper, we introduce an arm-constrained curriculum learning architecture to tackle the issues introduced by adding the manipulator. Firstly, we develop an arm-constrained reinforcement learning algorithm to ensure safety and stability in control performance. Additionally, to address discrepancies in reward settings between the arm and the base, we propose a reward-aware curriculum learning method. The policy is first trained in Isaac gym and transferred to the physical robot to do dynamic grasping tasks, including the door-opening task, fan-twitching task and the relay-baton-picking and following task. The results demonstrate that our proposed approach effectively controls the arm-equipped wheel-legged robot to master dynamic grasping skills, allowing it to chase and catch a moving object while in motion. Please refer to our website (https://acodedog.github.io/wheel-legged-loco-manipulation) for the code and supplemental videos. |
| title | Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot |
| topic | Robotics |
| url | https://arxiv.org/abs/2403.16535 |