HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Tairan, Xiao, Wenli, Lin, Toru, Luo, Zhengyi, Xu, Zhenjia, Jiang, Zhenyu, Kautz, Jan, Liu, Changliu, Shi, Guanya, Wang, Xiaolong, Fan, Linxi, Zhu, Yuke
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910860715229184
author He, Tairan
Xiao, Wenli
Lin, Toru
Luo, Zhengyi
Xu, Zhenjia
Jiang, Zhenyu
Kautz, Jan
Liu, Changliu
Shi, Guanya
Wang, Xiaolong
Fan, Linxi
Zhu, Yuke
author_facet He, Tairan
Xiao, Wenli
Lin, Toru
Luo, Zhengyi
Xu, Zhenjia
Jiang, Zhenyu
Kautz, Jan
Liu, Changliu
Shi, Guanya
Wang, Xiaolong
Fan, Linxi
Zhu, Yuke
contents Humanoid whole-body control requires adapting to diverse tasks such as navigation, loco-manipulation, and tabletop manipulation, each demanding a different mode of control. For example, navigation relies on root velocity tracking, while tabletop manipulation prioritizes upper-body joint angle tracking. Existing approaches typically train individual policies tailored to a specific command space, limiting their transferability across modes. We present the key insight that full-body kinematic motion imitation can serve as a common abstraction for all these tasks and provide general-purpose motor skills for learning multiple modes of whole-body control. Building on this, we propose HOVER (Humanoid Versatile Controller), a multi-mode policy distillation framework that consolidates diverse control modes into a unified policy. HOVER enables seamless transitions between control modes while preserving the distinct advantages of each, offering a robust and scalable solution for humanoid control across a wide range of modes. By eliminating the need for policy retraining for each control mode, our approach improves efficiency and flexibility for future humanoid applications.
format Preprint
id arxiv_https___arxiv_org_abs_2410_21229
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots
He, Tairan
Xiao, Wenli
Lin, Toru
Luo, Zhengyi
Xu, Zhenjia
Jiang, Zhenyu
Kautz, Jan
Liu, Changliu
Shi, Guanya
Wang, Xiaolong
Fan, Linxi
Zhu, Yuke
Robotics
Humanoid whole-body control requires adapting to diverse tasks such as navigation, loco-manipulation, and tabletop manipulation, each demanding a different mode of control. For example, navigation relies on root velocity tracking, while tabletop manipulation prioritizes upper-body joint angle tracking. Existing approaches typically train individual policies tailored to a specific command space, limiting their transferability across modes. We present the key insight that full-body kinematic motion imitation can serve as a common abstraction for all these tasks and provide general-purpose motor skills for learning multiple modes of whole-body control. Building on this, we propose HOVER (Humanoid Versatile Controller), a multi-mode policy distillation framework that consolidates diverse control modes into a unified policy. HOVER enables seamless transitions between control modes while preserving the distinct advantages of each, offering a robust and scalable solution for humanoid control across a wide range of modes. By eliminating the need for policy retraining for each control mode, our approach improves efficiency and flexibility for future humanoid applications.
title HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots
topic Robotics
url https://arxiv.org/abs/2410.21229