Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2501.02116 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916697673302016 |
|---|---|
| author | Gu, Zhaoyuan Li, Junheng Shen, Wenlan Yu, Wenhao Xie, Zhaoming McCrory, Stephen Cheng, Xianyi Shamsah, Abdulaziz Griffin, Robert Liu, C. Karen Kheddar, Abderrahmane Peng, Xue Bin Zhu, Yuke Shi, Guanya Nguyen, Quan Cheng, Gordon Gao, Huijun Zhao, Ye |
| author_facet | Gu, Zhaoyuan Li, Junheng Shen, Wenlan Yu, Wenhao Xie, Zhaoming McCrory, Stephen Cheng, Xianyi Shamsah, Abdulaziz Griffin, Robert Liu, C. Karen Kheddar, Abderrahmane Peng, Xue Bin Zhu, Yuke Shi, Guanya Nguyen, Quan Cheng, Gordon Gao, Huijun Zhao, Ye |
| contents | Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches, these capabilities have progressed rapidly, but often separately. This survey offers a comprehensive overview of the state-of-the-art in humanoid locomotion and manipulation (HLM), with a focus on control, planning, and learning methods. We first review the model-based methods that have been the backbone of humanoid robotics for the past three decades. We discuss contact planning, motion planning, and whole-body control, highlighting the trade-offs between model fidelity and computational efficiency. Then the focus is shifted to examine emerging learning-based methods, with an emphasis on reinforcement and imitation learning that enhance the robustness and versatility of loco-manipulation skills. Furthermore, we assess the potential of integrating foundation models with humanoid embodiments to enable the development of generalist humanoid agents. This survey also highlights the emerging role of tactile sensing, particularly whole-body tactile feedback, as a crucial modality for handling contact-rich interactions. Finally, we compare the strengths and limitations of model-based and learning-based paradigms from multiple perspectives, such as robustness, computational efficiency, versatility, and generalizability, and suggest potential solutions to existing challenges. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_02116 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning Gu, Zhaoyuan Li, Junheng Shen, Wenlan Yu, Wenhao Xie, Zhaoming McCrory, Stephen Cheng, Xianyi Shamsah, Abdulaziz Griffin, Robert Liu, C. Karen Kheddar, Abderrahmane Peng, Xue Bin Zhu, Yuke Shi, Guanya Nguyen, Quan Cheng, Gordon Gao, Huijun Zhao, Ye Robotics Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches, these capabilities have progressed rapidly, but often separately. This survey offers a comprehensive overview of the state-of-the-art in humanoid locomotion and manipulation (HLM), with a focus on control, planning, and learning methods. We first review the model-based methods that have been the backbone of humanoid robotics for the past three decades. We discuss contact planning, motion planning, and whole-body control, highlighting the trade-offs between model fidelity and computational efficiency. Then the focus is shifted to examine emerging learning-based methods, with an emphasis on reinforcement and imitation learning that enhance the robustness and versatility of loco-manipulation skills. Furthermore, we assess the potential of integrating foundation models with humanoid embodiments to enable the development of generalist humanoid agents. This survey also highlights the emerging role of tactile sensing, particularly whole-body tactile feedback, as a crucial modality for handling contact-rich interactions. Finally, we compare the strengths and limitations of model-based and learning-based paradigms from multiple perspectives, such as robustness, computational efficiency, versatility, and generalizability, and suggest potential solutions to existing challenges. |
| title | Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning |
| topic | Robotics |
| url | https://arxiv.org/abs/2501.02116 |