Saved in:
Bibliographic Details
Main Authors: Xu, Zihan, Hu, Mengxian, Xiao, Kaiyan, Fang, Qin, Liu, Chengju, Chen, Qijun
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.05117
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918046417813504
author Xu, Zihan
Hu, Mengxian
Xiao, Kaiyan
Fang, Qin
Liu, Chengju
Chen, Qijun
author_facet Xu, Zihan
Hu, Mengxian
Xiao, Kaiyan
Fang, Qin
Liu, Chengju
Chen, Qijun
contents Human motion retargeting for humanoid robots, transferring human motion data to robots for imitation, presents significant challenges but offers considerable potential for real-world applications. Traditionally, this process relies on human demonstrations captured through pose estimation or motion capture systems. In this paper, we explore a text-driven approach to mapping human motion to humanoids. To address the inherent discrepancies between the generated motion representations and the kinematic constraints of humanoid robots, we propose an angle signal network based on norm-position and rotation loss (NPR Loss). It generates joint angles, which serve as inputs to a reinforcement learning-based whole-body joint motion control policy. The policy ensures tracking of the generated motions while maintaining the robot's stability during execution. Our experimental results demonstrate the efficacy of this approach, successfully transferring text-driven human motion to a real humanoid robot NAO.
format Preprint
id arxiv_https___arxiv_org_abs_2506_05117
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Realizing Text-Driven Motion Generation on NAO Robot: A Reinforcement Learning-Optimized Control Pipeline
Xu, Zihan
Hu, Mengxian
Xiao, Kaiyan
Fang, Qin
Liu, Chengju
Chen, Qijun
Robotics
Human motion retargeting for humanoid robots, transferring human motion data to robots for imitation, presents significant challenges but offers considerable potential for real-world applications. Traditionally, this process relies on human demonstrations captured through pose estimation or motion capture systems. In this paper, we explore a text-driven approach to mapping human motion to humanoids. To address the inherent discrepancies between the generated motion representations and the kinematic constraints of humanoid robots, we propose an angle signal network based on norm-position and rotation loss (NPR Loss). It generates joint angles, which serve as inputs to a reinforcement learning-based whole-body joint motion control policy. The policy ensures tracking of the generated motions while maintaining the robot's stability during execution. Our experimental results demonstrate the efficacy of this approach, successfully transferring text-driven human motion to a real humanoid robot NAO.
title Realizing Text-Driven Motion Generation on NAO Robot: A Reinforcement Learning-Optimized Control Pipeline
topic Robotics
url https://arxiv.org/abs/2506.05117