RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviour

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Serpiva, Valerii, Lykov, Artem, Myshlyaev, Artyom, Khan, Muhammad Haris, Abdulkarim, Ali Alridha, Sautenkov, Oleg, Tsetserukou, Dzmitry
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910857963765760
author Serpiva, Valerii
Lykov, Artem
Myshlyaev, Artyom
Khan, Muhammad Haris
Abdulkarim, Ali Alridha
Sautenkov, Oleg
Tsetserukou, Dzmitry
author_facet Serpiva, Valerii
Lykov, Artem
Myshlyaev, Artyom
Khan, Muhammad Haris
Abdulkarim, Ali Alridha
Sautenkov, Oleg
Tsetserukou, Dzmitry
contents RaceVLA presents an innovative approach for autonomous racing drone navigation by leveraging Visual-Language-Action (VLA) to emulate human-like behavior. This research explores the integration of advanced algorithms that enable drones to adapt their navigation strategies based on real-time environmental feedback, mimicking the decision-making processes of human pilots. The model, fine-tuned on a collected racing drone dataset, demonstrates strong generalization despite the complexity of drone racing environments. RaceVLA outperforms OpenVLA in motion (75.0 vs 60.0) and semantic generalization (45.5 vs 36.3), benefiting from the dynamic camera and simplified motion tasks. However, visual (79.6 vs 87.0) and physical (50.0 vs 76.7) generalization were slightly reduced due to the challenges of maneuvering in dynamic environments with varying object sizes. RaceVLA also outperforms RT-2 across all axes - visual (79.6 vs 52.0), motion (75.0 vs 55.0), physical (50.0 vs 26.7), and semantic (45.5 vs 38.8), demonstrating its robustness for real-time adjustments in complex environments. Experiments revealed an average velocity of 1.04 m/s, with a maximum speed of 2.02 m/s, and consistent maneuverability, demonstrating RaceVLA's ability to handle high-speed scenarios effectively. These findings highlight the potential of RaceVLA for high-performance navigation in competitive racing contexts. The RaceVLA codebase, pretrained weights, and dataset are available at this http URL: https://racevla.github.io/
format Preprint
id arxiv_https___arxiv_org_abs_2503_02572
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviour
Serpiva, Valerii
Lykov, Artem
Myshlyaev, Artyom
Khan, Muhammad Haris
Abdulkarim, Ali Alridha
Sautenkov, Oleg
Tsetserukou, Dzmitry
Robotics
Artificial Intelligence
RaceVLA presents an innovative approach for autonomous racing drone navigation by leveraging Visual-Language-Action (VLA) to emulate human-like behavior. This research explores the integration of advanced algorithms that enable drones to adapt their navigation strategies based on real-time environmental feedback, mimicking the decision-making processes of human pilots. The model, fine-tuned on a collected racing drone dataset, demonstrates strong generalization despite the complexity of drone racing environments. RaceVLA outperforms OpenVLA in motion (75.0 vs 60.0) and semantic generalization (45.5 vs 36.3), benefiting from the dynamic camera and simplified motion tasks. However, visual (79.6 vs 87.0) and physical (50.0 vs 76.7) generalization were slightly reduced due to the challenges of maneuvering in dynamic environments with varying object sizes. RaceVLA also outperforms RT-2 across all axes - visual (79.6 vs 52.0), motion (75.0 vs 55.0), physical (50.0 vs 26.7), and semantic (45.5 vs 38.8), demonstrating its robustness for real-time adjustments in complex environments. Experiments revealed an average velocity of 1.04 m/s, with a maximum speed of 2.02 m/s, and consistent maneuverability, demonstrating RaceVLA's ability to handle high-speed scenarios effectively. These findings highlight the potential of RaceVLA for high-performance navigation in competitive racing contexts. The RaceVLA codebase, pretrained weights, and dataset are available at this http URL: https://racevla.github.io/
title RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviour
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2503.02572