VolleyBots: A Testbed for Multi-Drone Volleyball Game Combining Motion Control and Strategic Play

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xu, Zelai, Zhang, Ruize, Yu, Chao, Yuan, Huining, Yi, Xiangmin, Ji, Shilong, Wang, Chuqi, Tang, Wenhao, Gao, Feng, Ding, Wenbo, Chen, Xinlei, Wang, Yu
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912927175409664
author Xu, Zelai
Zhang, Ruize
Yu, Chao
Yuan, Huining
Yi, Xiangmin
Ji, Shilong
Wang, Chuqi
Tang, Wenhao
Gao, Feng
Ding, Wenbo
Chen, Xinlei
Wang, Yu
author_facet Xu, Zelai
Zhang, Ruize
Yu, Chao
Yuan, Huining
Yi, Xiangmin
Ji, Shilong
Wang, Chuqi
Tang, Wenhao
Gao, Feng
Ding, Wenbo
Chen, Xinlei
Wang, Yu
contents Robot sports, characterized by well-defined objectives, explicit rules, and dynamic interactions, present ideal scenarios for demonstrating embodied intelligence. In this paper, we present VolleyBots, a novel robot sports testbed where multiple drones cooperate and compete in the sport of volleyball under physical dynamics. VolleyBots integrates three features within a unified platform: competitive and cooperative gameplay, turn-based interaction structure, and agile 3D maneuvering. These intertwined features yield a complex problem combining motion control and strategic play, with no available expert demonstrations. We provide a comprehensive suite of tasks ranging from single-drone drills to multi-drone cooperative and competitive tasks, accompanied by baseline evaluations of representative reinforcement learning (RL), multi-agent reinforcement learning (MARL) and game-theoretic algorithms. Simulation results show that on-policy RL methods outperform off-policy methods in single-agent tasks, but both approaches struggle in complex tasks that combine motion control and strategic play. We additionally design a hierarchical policy which achieves 69.5% win rate against the strongest baseline in the 3 vs 3 task, demonstrating its potential for tackling the complex interplay between low-level control and high-level strategy. To highlight VolleyBots' sim-to-real potential, we further demonstrate the zero-shot deployment of a policy trained entirely in simulation on real-world drones.
format Preprint
id arxiv_https___arxiv_org_abs_2502_01932
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VolleyBots: A Testbed for Multi-Drone Volleyball Game Combining Motion Control and Strategic Play
Xu, Zelai
Zhang, Ruize
Yu, Chao
Yuan, Huining
Yi, Xiangmin
Ji, Shilong
Wang, Chuqi
Tang, Wenhao
Gao, Feng
Ding, Wenbo
Chen, Xinlei
Wang, Yu
Robotics
Artificial Intelligence
Machine Learning
Robot sports, characterized by well-defined objectives, explicit rules, and dynamic interactions, present ideal scenarios for demonstrating embodied intelligence. In this paper, we present VolleyBots, a novel robot sports testbed where multiple drones cooperate and compete in the sport of volleyball under physical dynamics. VolleyBots integrates three features within a unified platform: competitive and cooperative gameplay, turn-based interaction structure, and agile 3D maneuvering. These intertwined features yield a complex problem combining motion control and strategic play, with no available expert demonstrations. We provide a comprehensive suite of tasks ranging from single-drone drills to multi-drone cooperative and competitive tasks, accompanied by baseline evaluations of representative reinforcement learning (RL), multi-agent reinforcement learning (MARL) and game-theoretic algorithms. Simulation results show that on-policy RL methods outperform off-policy methods in single-agent tasks, but both approaches struggle in complex tasks that combine motion control and strategic play. We additionally design a hierarchical policy which achieves 69.5% win rate against the strongest baseline in the 3 vs 3 task, demonstrating its potential for tackling the complex interplay between low-level control and high-level strategy. To highlight VolleyBots' sim-to-real potential, we further demonstrate the zero-shot deployment of a policy trained entirely in simulation on real-world drones.
title VolleyBots: A Testbed for Multi-Drone Volleyball Game Combining Motion Control and Strategic Play
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2502.01932