Spatio-Temporal Motion Retargeting for Quadruped Robots

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yoon, Taerim, Kang, Dongho, Kim, Seungmin, Cheng, Jin, Ahn, Minsung, Coros, Stelian, Choi, Sungjoon
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915407004172288
author Yoon, Taerim
Kang, Dongho
Kim, Seungmin
Cheng, Jin
Ahn, Minsung
Coros, Stelian
Choi, Sungjoon
author_facet Yoon, Taerim
Kang, Dongho
Kim, Seungmin
Cheng, Jin
Ahn, Minsung
Coros, Stelian
Choi, Sungjoon
contents This work presents a motion retargeting approach for legged robots, aimed at transferring the dynamic and agile movements to robots from source motions. In particular, we guide the imitation learning procedures by transferring motions from source to target, effectively bridging the morphological disparities while ensuring the physical feasibility of the target system. In the first stage, we focus on motion retargeting at the kinematic level by generating kinematically feasible whole-body motions from keypoint trajectories. Following this, we refine the motion at the dynamic level by adjusting it in the temporal domain while adhering to physical constraints. This process facilitates policy training via reinforcement learning, enabling precise and robust motion tracking. We demonstrate that our approach successfully transforms noisy motion sources, such as hand-held camera videos, into robot-specific motions that align with the morphology and physical properties of the target robots. Moreover, we demonstrate terrain-aware motion retargeting to perform BackFlip on top of a box. We successfully deployed these skills to four robots with different dimensions and physical properties in the real world through hardware experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2404_11557
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Spatio-Temporal Motion Retargeting for Quadruped Robots
Yoon, Taerim
Kang, Dongho
Kim, Seungmin
Cheng, Jin
Ahn, Minsung
Coros, Stelian
Choi, Sungjoon
Robotics
This work presents a motion retargeting approach for legged robots, aimed at transferring the dynamic and agile movements to robots from source motions. In particular, we guide the imitation learning procedures by transferring motions from source to target, effectively bridging the morphological disparities while ensuring the physical feasibility of the target system. In the first stage, we focus on motion retargeting at the kinematic level by generating kinematically feasible whole-body motions from keypoint trajectories. Following this, we refine the motion at the dynamic level by adjusting it in the temporal domain while adhering to physical constraints. This process facilitates policy training via reinforcement learning, enabling precise and robust motion tracking. We demonstrate that our approach successfully transforms noisy motion sources, such as hand-held camera videos, into robot-specific motions that align with the morphology and physical properties of the target robots. Moreover, we demonstrate terrain-aware motion retargeting to perform BackFlip on top of a box. We successfully deployed these skills to four robots with different dimensions and physical properties in the real world through hardware experiments.
title Spatio-Temporal Motion Retargeting for Quadruped Robots
topic Robotics
url https://arxiv.org/abs/2404.11557