Vector Field Augmented Differentiable Policy Learning for Vision-Based Drone Racing

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Su, Yang, Yu, Feng, Hu, Yu, Niu, Xinze, Zhang, Linzuo, Sun, Fangyu, Zou, Danping
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915845811208192
author Su, Yang
Yu, Feng
Hu, Yu
Niu, Xinze
Zhang, Linzuo
Sun, Fangyu
Zou, Danping
author_facet Su, Yang
Yu, Feng
Hu, Yu
Niu, Xinze
Zhang, Linzuo
Sun, Fangyu
Zou, Danping
contents Autonomous drone racing in complex environments requires agile, high-speed flight while maintaining reliable obstacle avoidance. Differentiable-physics-based policy learning has recently demonstrated high sample efficiency and remarkable performance across various tasks, including agile drone flight and quadruped locomotion. However, applying such methods to drone racing remains difficult, as key objective like gate traversal are inherently hard to express as smooth, differentiable losses. To address these challenges, we propose DiffRacing, a novel vector field-augmented differentiable policy learning framework. DiffRacing integrates differentiable losses and vector fields into the training process to provide continuous and stable gradient signals, balancing obstacle avoidance and high-speed gate traversal. In addition, a differentiable Delta Action Model compensates for dynamics mismatch, enabling efficient sim-to-real transfer without explicit system identification. Extensive simulation and real-world experiments demonstrate that DiffRacing achieves superior sample efficiency, faster convergence, and robust flight performance, thereby demonstrating that vector fields can augment traditional gradient-based policy learning with a task-specific geometric prior.
format Preprint
id arxiv_https___arxiv_org_abs_2603_08019
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Vector Field Augmented Differentiable Policy Learning for Vision-Based Drone Racing
Su, Yang
Yu, Feng
Hu, Yu
Niu, Xinze
Zhang, Linzuo
Sun, Fangyu
Zou, Danping
Robotics
Autonomous drone racing in complex environments requires agile, high-speed flight while maintaining reliable obstacle avoidance. Differentiable-physics-based policy learning has recently demonstrated high sample efficiency and remarkable performance across various tasks, including agile drone flight and quadruped locomotion. However, applying such methods to drone racing remains difficult, as key objective like gate traversal are inherently hard to express as smooth, differentiable losses. To address these challenges, we propose DiffRacing, a novel vector field-augmented differentiable policy learning framework. DiffRacing integrates differentiable losses and vector fields into the training process to provide continuous and stable gradient signals, balancing obstacle avoidance and high-speed gate traversal. In addition, a differentiable Delta Action Model compensates for dynamics mismatch, enabling efficient sim-to-real transfer without explicit system identification. Extensive simulation and real-world experiments demonstrate that DiffRacing achieves superior sample efficiency, faster convergence, and robust flight performance, thereby demonstrating that vector fields can augment traditional gradient-based policy learning with a task-specific geometric prior.
title Vector Field Augmented Differentiable Policy Learning for Vision-Based Drone Racing
topic Robotics
url https://arxiv.org/abs/2603.08019