Learning to Ball: Composing Policies for Long-Horizon Basketball Moves
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916972180013056 |
|---|---|
| author | Xu, Pei Wu, Zhen Wang, Ruocheng Sarukkai, Vishnu Fatahalian, Kayvon Karamouzas, Ioannis Zordan, Victor Liu, C. Karen |
| author_facet | Xu, Pei Wu, Zhen Wang, Ruocheng Sarukkai, Vishnu Fatahalian, Kayvon Karamouzas, Ioannis Zordan, Victor Liu, C. Karen |
| contents | Learning a control policy for a multi-phase, long-horizon task, such as basketball maneuvers, remains challenging for reinforcement learning approaches due to the need for seamless policy composition and transitions between skills. A long-horizon task typically consists of distinct subtasks with well-defined goals, separated by transitional subtasks with unclear goals but critical to the success of the entire task. Existing methods like the mixture of experts and skill chaining struggle with tasks where individual policies do not share significant commonly explored states or lack well-defined initial and terminal states between different phases. In this paper, we introduce a novel policy integration framework to enable the composition of drastically different motor skills in multi-phase long-horizon tasks with ill-defined intermediate states. Based on that, we further introduce a high-level soft router to enable seamless and robust transitions between the subtasks. We evaluate our framework on a set of fundamental basketball skills and challenging transitions. Policies trained by our approach can effectively control the simulated character to interact with the ball and accomplish the long-horizon task specified by real-time user commands, without relying on ball trajectory references. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_22442 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Learning to Ball: Composing Policies for Long-Horizon Basketball Moves Xu, Pei Wu, Zhen Wang, Ruocheng Sarukkai, Vishnu Fatahalian, Kayvon Karamouzas, Ioannis Zordan, Victor Liu, C. Karen Graphics Artificial Intelligence Machine Learning Robotics Learning a control policy for a multi-phase, long-horizon task, such as basketball maneuvers, remains challenging for reinforcement learning approaches due to the need for seamless policy composition and transitions between skills. A long-horizon task typically consists of distinct subtasks with well-defined goals, separated by transitional subtasks with unclear goals but critical to the success of the entire task. Existing methods like the mixture of experts and skill chaining struggle with tasks where individual policies do not share significant commonly explored states or lack well-defined initial and terminal states between different phases. In this paper, we introduce a novel policy integration framework to enable the composition of drastically different motor skills in multi-phase long-horizon tasks with ill-defined intermediate states. Based on that, we further introduce a high-level soft router to enable seamless and robust transitions between the subtasks. We evaluate our framework on a set of fundamental basketball skills and challenging transitions. Policies trained by our approach can effectively control the simulated character to interact with the ball and accomplish the long-horizon task specified by real-time user commands, without relying on ball trajectory references. |
| title | Learning to Ball: Composing Policies for Long-Horizon Basketball Moves |
| topic | Graphics Artificial Intelligence Machine Learning Robotics |
| url | https://arxiv.org/abs/2509.22442 |