Perception-Aware Time-Optimal Planning for Quadrotor Waypoint Flight

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Qin, Chao, Xing, Jiaxu, Reiter, Rudolf, Romero, Angel, Lin, Yifan, Liu, Hugh H. -T., Scaramuzza, Davide
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918369972715520
author Qin, Chao
Xing, Jiaxu
Reiter, Rudolf
Romero, Angel
Lin, Yifan
Liu, Hugh H. -T.
Scaramuzza, Davide
author_facet Qin, Chao
Xing, Jiaxu
Reiter, Rudolf
Romero, Angel
Lin, Yifan
Liu, Hugh H. -T.
Scaramuzza, Davide
contents Agile quadrotor flight pushes the limits of control, actuation, and onboard perception. While time-optimal trajectory planning has been extensively studied, existing approaches typically neglect the tight coupling between vehicle dynamics, environmental geometry, and the visual requirements of onboard state estimation. As a result, trajectories that are dynamically feasible may fail in closed-loop execution due to degraded visual quality. This paper introduces a unified time-optimal trajectory optimization framework for vision-based quadrotors that explicitly incorporates perception constraints alongside full nonlinear dynamics, rotor actuation limits, aerodynamic effects, camera field-of-view constraints, and convex geometric gate representations. The proposed formulation solves minimum-time lap trajectories for arbitrary racetracks with diverse gate shapes and orientations, while remaining numerically robust and computationally efficient. We derive an information-theoretic position uncertainty metric to quantify visual state-estimation quality and integrate it into the planner through three perception objectives: position uncertainty minimization, sequential field-of-view constraints, and look-ahead alignment. This enables systematic exploration of the trade-offs between speed and perceptual reliability. To accurately track the resulting perception-aware trajectories, we develop a model predictive contouring tracking controller that separates lateral and progress errors. Experiments demonstrate real-world flight speeds up to 9.8 m/s with 0.07 m average tracking error, and closed-loop success rates improved from 55% to 100% on a challenging Split-S course. The proposed system provides a scalable benchmark for studying the fundamental limits of perception-aware, time-optimal autonomous flight.
format Preprint
id arxiv_https___arxiv_org_abs_2603_04305
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Perception-Aware Time-Optimal Planning for Quadrotor Waypoint Flight
Qin, Chao
Xing, Jiaxu
Reiter, Rudolf
Romero, Angel
Lin, Yifan
Liu, Hugh H. -T.
Scaramuzza, Davide
Robotics
Agile quadrotor flight pushes the limits of control, actuation, and onboard perception. While time-optimal trajectory planning has been extensively studied, existing approaches typically neglect the tight coupling between vehicle dynamics, environmental geometry, and the visual requirements of onboard state estimation. As a result, trajectories that are dynamically feasible may fail in closed-loop execution due to degraded visual quality. This paper introduces a unified time-optimal trajectory optimization framework for vision-based quadrotors that explicitly incorporates perception constraints alongside full nonlinear dynamics, rotor actuation limits, aerodynamic effects, camera field-of-view constraints, and convex geometric gate representations. The proposed formulation solves minimum-time lap trajectories for arbitrary racetracks with diverse gate shapes and orientations, while remaining numerically robust and computationally efficient. We derive an information-theoretic position uncertainty metric to quantify visual state-estimation quality and integrate it into the planner through three perception objectives: position uncertainty minimization, sequential field-of-view constraints, and look-ahead alignment. This enables systematic exploration of the trade-offs between speed and perceptual reliability. To accurately track the resulting perception-aware trajectories, we develop a model predictive contouring tracking controller that separates lateral and progress errors. Experiments demonstrate real-world flight speeds up to 9.8 m/s with 0.07 m average tracking error, and closed-loop success rates improved from 55% to 100% on a challenging Split-S course. The proposed system provides a scalable benchmark for studying the fundamental limits of perception-aware, time-optimal autonomous flight.
title Perception-Aware Time-Optimal Planning for Quadrotor Waypoint Flight
topic Robotics
url https://arxiv.org/abs/2603.04305