Integrating Learning-Based Manipulation and Physics-Based Locomotion for Whole-Body Badminton Robot Control

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Haochen, Shi, Zhiwei, Zhu, Chengxi, Qiao, Yafei, Zhang, Cheng, Yang, Fan, Ren, Pengjie, Lu, Lan, Xuan, Dong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916708788207616
author Wang, Haochen
Shi, Zhiwei
Zhu, Chengxi
Qiao, Yafei
Zhang, Cheng
Yang, Fan
Ren, Pengjie
Lu, Lan
Xuan, Dong
author_facet Wang, Haochen
Shi, Zhiwei
Zhu, Chengxi
Qiao, Yafei
Zhang, Cheng
Yang, Fan
Ren, Pengjie
Lu, Lan
Xuan, Dong
contents Learning-based methods, such as imitation learning (IL) and reinforcement learning (RL), can produce excel control policies over challenging agile robot tasks, such as sports robot. However, no existing work has harmonized learning-based policy with model-based methods to reduce training complexity and ensure the safety and stability for agile badminton robot control. In this paper, we introduce Hamlet, a novel hybrid control system for agile badminton robots. Specifically, we propose a model-based strategy for chassis locomotion which provides a base for arm policy. We introduce a physics-informed "IL+RL" training framework for learning-based arm policy. In this train framework, a model-based strategy with privileged information is used to guide arm policy training during both IL and RL phases. In addition, we train the critic model during IL phase to alleviate the performance drop issue when transitioning from IL to RL. We present results on our self-engineered badminton robot, achieving 94.5% success rate against the serving machine and 90.7% success rate against human players. Our system can be easily generalized to other agile mobile manipulation tasks such as agile catching and table tennis. Our project website: https://dreamstarring.github.io/HAMLET/.
format Preprint
id arxiv_https___arxiv_org_abs_2504_17771
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Integrating Learning-Based Manipulation and Physics-Based Locomotion for Whole-Body Badminton Robot Control
Wang, Haochen
Shi, Zhiwei
Zhu, Chengxi
Qiao, Yafei
Zhang, Cheng
Yang, Fan
Ren, Pengjie
Lu, Lan
Xuan, Dong
Robotics
Artificial Intelligence
Machine Learning
Learning-based methods, such as imitation learning (IL) and reinforcement learning (RL), can produce excel control policies over challenging agile robot tasks, such as sports robot. However, no existing work has harmonized learning-based policy with model-based methods to reduce training complexity and ensure the safety and stability for agile badminton robot control. In this paper, we introduce Hamlet, a novel hybrid control system for agile badminton robots. Specifically, we propose a model-based strategy for chassis locomotion which provides a base for arm policy. We introduce a physics-informed "IL+RL" training framework for learning-based arm policy. In this train framework, a model-based strategy with privileged information is used to guide arm policy training during both IL and RL phases. In addition, we train the critic model during IL phase to alleviate the performance drop issue when transitioning from IL to RL. We present results on our self-engineered badminton robot, achieving 94.5% success rate against the serving machine and 90.7% success rate against human players. Our system can be easily generalized to other agile mobile manipulation tasks such as agile catching and table tennis. Our project website: https://dreamstarring.github.io/HAMLET/.
title Integrating Learning-Based Manipulation and Physics-Based Locomotion for Whole-Body Badminton Robot Control
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2504.17771