Learning Agile Striker Skills for Humanoid Soccer Robots from Noisy Sensory Input
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914546917048320 |
|---|---|
| author | Xu, Zifan Seo, Myoungkyu Lee, Dongmyeong Fu, Hao Hu, Jiaheng Cui, Jiaxun Jiang, Yuqian Wang, Zhihan Brund, Anastasiia Biswas, Joydeep Stone, Peter |
| author_facet | Xu, Zifan Seo, Myoungkyu Lee, Dongmyeong Fu, Hao Hu, Jiaheng Cui, Jiaxun Jiang, Yuqian Wang, Zhihan Brund, Anastasiia Biswas, Joydeep Stone, Peter |
| contents | Learning fast and robust ball-kicking skills is a critical capability for humanoid soccer robots, yet it remains a challenging problem due to the need for rapid leg swings, postural stability on a single support foot, and robustness under noisy sensory input and external perturbations (e.g., opponents). This paper presents a reinforcement learning (RL)-based system that enables humanoid robots to execute robust continual ball-kicking with adaptability to different ball-goal configurations. The system extends a typical teacher-student training framework -- in which a "teacher" policy is trained with ground truth state information and the "student" learns to mimic it with noisy, imperfect sensing -- by including four training stages: (1) long-distance ball chasing (teacher); (2) directional kicking (teacher); (3) teacher policy distillation (student); and (4) student adaptation and refinement (student). Key design elements -- including tailored reward functions, realistic noise modeling, and online constrained RL for adaptation and refinement -- are critical for closing the sim-to-real gap and sustaining performance under perceptual uncertainty. Extensive evaluations in both simulation and on a real robot demonstrate strong kicking accuracy and goal-scoring success across diverse ball-goal configurations. Ablation studies further highlight the necessity of the constrained RL, noise modeling, and the adaptation stage. This work presents a system for learning robust continual humanoid ball-kicking under imperfect perception, establishing a benchmark task for visuomotor skill learning in humanoid whole-body control. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_06571 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Learning Agile Striker Skills for Humanoid Soccer Robots from Noisy Sensory Input Xu, Zifan Seo, Myoungkyu Lee, Dongmyeong Fu, Hao Hu, Jiaheng Cui, Jiaxun Jiang, Yuqian Wang, Zhihan Brund, Anastasiia Biswas, Joydeep Stone, Peter Robotics Learning fast and robust ball-kicking skills is a critical capability for humanoid soccer robots, yet it remains a challenging problem due to the need for rapid leg swings, postural stability on a single support foot, and robustness under noisy sensory input and external perturbations (e.g., opponents). This paper presents a reinforcement learning (RL)-based system that enables humanoid robots to execute robust continual ball-kicking with adaptability to different ball-goal configurations. The system extends a typical teacher-student training framework -- in which a "teacher" policy is trained with ground truth state information and the "student" learns to mimic it with noisy, imperfect sensing -- by including four training stages: (1) long-distance ball chasing (teacher); (2) directional kicking (teacher); (3) teacher policy distillation (student); and (4) student adaptation and refinement (student). Key design elements -- including tailored reward functions, realistic noise modeling, and online constrained RL for adaptation and refinement -- are critical for closing the sim-to-real gap and sustaining performance under perceptual uncertainty. Extensive evaluations in both simulation and on a real robot demonstrate strong kicking accuracy and goal-scoring success across diverse ball-goal configurations. Ablation studies further highlight the necessity of the constrained RL, noise modeling, and the adaptation stage. This work presents a system for learning robust continual humanoid ball-kicking under imperfect perception, establishing a benchmark task for visuomotor skill learning in humanoid whole-body control. |
| title | Learning Agile Striker Skills for Humanoid Soccer Robots from Noisy Sensory Input |
| topic | Robotics |
| url | https://arxiv.org/abs/2512.06571 |