Bi-Level Motion Imitation for Humanoid Robots

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhao, Wenshuai, Zhao, Yi, Pajarinen, Joni, Muehlebach, Michael
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913528822104064
author Zhao, Wenshuai
Zhao, Yi
Pajarinen, Joni
Muehlebach, Michael
author_facet Zhao, Wenshuai
Zhao, Yi
Pajarinen, Joni
Muehlebach, Michael
contents Imitation learning from human motion capture (MoCap) data provides a promising way to train humanoid robots. However, due to differences in morphology, such as varying degrees of joint freedom and force limits, exact replication of human behaviors may not be feasible for humanoid robots. Consequently, incorporating physically infeasible MoCap data in training datasets can adversely affect the performance of the robot policy. To address this issue, we propose a bi-level optimization-based imitation learning framework that alternates between optimizing both the robot policy and the target MoCap data. Specifically, we first develop a generative latent dynamics model using a novel self-consistent auto-encoder, which learns sparse and structured motion representations while capturing desired motion patterns in the dataset. The dynamics model is then utilized to generate reference motions while the latent representation regularizes the bi-level motion imitation process. Simulations conducted with a realistic model of a humanoid robot demonstrate that our method enhances the robot policy by modifying reference motions to be physically consistent.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01968
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bi-Level Motion Imitation for Humanoid Robots
Zhao, Wenshuai
Zhao, Yi
Pajarinen, Joni
Muehlebach, Michael
Robotics
Imitation learning from human motion capture (MoCap) data provides a promising way to train humanoid robots. However, due to differences in morphology, such as varying degrees of joint freedom and force limits, exact replication of human behaviors may not be feasible for humanoid robots. Consequently, incorporating physically infeasible MoCap data in training datasets can adversely affect the performance of the robot policy. To address this issue, we propose a bi-level optimization-based imitation learning framework that alternates between optimizing both the robot policy and the target MoCap data. Specifically, we first develop a generative latent dynamics model using a novel self-consistent auto-encoder, which learns sparse and structured motion representations while capturing desired motion patterns in the dataset. The dynamics model is then utilized to generate reference motions while the latent representation regularizes the bi-level motion imitation process. Simulations conducted with a realistic model of a humanoid robot demonstrate that our method enhances the robot policy by modifying reference motions to be physically consistent.
title Bi-Level Motion Imitation for Humanoid Robots
topic Robotics
url https://arxiv.org/abs/2410.01968