SkillMimic: Learning Basketball Interaction Skills from Demonstrations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913762941861888 |
|---|---|
| author | Wang, Yinhuai Zhao, Qihan Yu, Runyi Tsui, Hok Wai Zeng, Ailing Lin, Jing Luo, Zhengyi Yu, Jiwen Li, Xiu Chen, Qifeng Zhang, Jian Zhang, Lei Tan, Ping |
| author_facet | Wang, Yinhuai Zhao, Qihan Yu, Runyi Tsui, Hok Wai Zeng, Ailing Lin, Jing Luo, Zhengyi Yu, Jiwen Li, Xiu Chen, Qifeng Zhang, Jian Zhang, Lei Tan, Ping |
| contents | Traditional reinforcement learning methods for human-object interaction (HOI) rely on labor-intensive, manually designed skill rewards that do not generalize well across different interactions. We introduce SkillMimic, a unified data-driven framework that fundamentally changes how agents learn interaction skills by eliminating the need for skill-specific rewards. Our key insight is that a unified HOI imitation reward can effectively capture the essence of diverse interaction patterns from HOI datasets. This enables SkillMimic to learn a single policy that not only masters multiple interaction skills but also facilitates skill transitions, with both diversity and generalization improving as the HOI dataset grows. For evaluation, we collect and introduce two basketball datasets containing approximately 35 minutes of diverse basketball skills. Extensive experiments show that SkillMimic successfully masters a wide range of basketball skills including stylistic variations in dribbling, layup, and shooting. Moreover, these learned skills can be effectively composed by a high-level controller to accomplish complex and long-horizon tasks such as consecutive scoring, opening new possibilities for scalable and generalizable interaction skill learning. Project page: https://ingrid789.github.io/SkillMimic/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_15270 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SkillMimic: Learning Basketball Interaction Skills from Demonstrations Wang, Yinhuai Zhao, Qihan Yu, Runyi Tsui, Hok Wai Zeng, Ailing Lin, Jing Luo, Zhengyi Yu, Jiwen Li, Xiu Chen, Qifeng Zhang, Jian Zhang, Lei Tan, Ping Computer Vision and Pattern Recognition Graphics Machine Learning Robotics Traditional reinforcement learning methods for human-object interaction (HOI) rely on labor-intensive, manually designed skill rewards that do not generalize well across different interactions. We introduce SkillMimic, a unified data-driven framework that fundamentally changes how agents learn interaction skills by eliminating the need for skill-specific rewards. Our key insight is that a unified HOI imitation reward can effectively capture the essence of diverse interaction patterns from HOI datasets. This enables SkillMimic to learn a single policy that not only masters multiple interaction skills but also facilitates skill transitions, with both diversity and generalization improving as the HOI dataset grows. For evaluation, we collect and introduce two basketball datasets containing approximately 35 minutes of diverse basketball skills. Extensive experiments show that SkillMimic successfully masters a wide range of basketball skills including stylistic variations in dribbling, layup, and shooting. Moreover, these learned skills can be effectively composed by a high-level controller to accomplish complex and long-horizon tasks such as consecutive scoring, opening new possibilities for scalable and generalizable interaction skill learning. Project page: https://ingrid789.github.io/SkillMimic/ |
| title | SkillMimic: Learning Basketball Interaction Skills from Demonstrations |
| topic | Computer Vision and Pattern Recognition Graphics Machine Learning Robotics |
| url | https://arxiv.org/abs/2408.15270 |