Saved in:
Bibliographic Details
Main Authors: Li, Gang, Zhai, Chunlei, Wang, Teng, Li, Shaun, Jiang, Shangsong, Zhu, Xiangwei
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.26588
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917050472988672
author Li, Gang
Zhai, Chunlei
Wang, Teng
Li, Shaun
Jiang, Shangsong
Zhu, Xiangwei
author_facet Li, Gang
Zhai, Chunlei
Wang, Teng
Li, Shaun
Jiang, Shangsong
Zhu, Xiangwei
contents Visual navigation algorithms for quadrotors often exhibit a large variation in performance when transferred across different vehicle platforms and scene geometries, which increases the cost and risk of field deployment. To support systematic early-stage evaluation, we introduce FLYINGTRUST, a high-fidelity, configurable benchmarking framework that measures how platform kinodynamics and scenario structure jointly affect navigation robustness. FLYINGTRUST models vehicle capability with two compact, physically interpretable indicators: maximum thrust-to-weight ratio and axis-wise maximum angular acceleration. The benchmark pairs a diverse scenario library with a heterogeneous set of real and virtual platforms and prescribes a standardized evaluation protocol together with a composite scoring method that balances scenario importance, platform importance and performance stability. We use FLYINGTRUST to compare representative optimization-based and learning-based navigation approaches under identical conditions, performing repeated trials per platform-scenario combination and reporting uncertainty-aware metrics. The results reveal systematic patterns: navigation success depends predictably on platform capability and scene geometry, and different algorithms exhibit distinct preferences and failure modes across the evaluated conditions. These observations highlight the practical necessity of incorporating both platform capability and scenario structure into algorithm design, evaluation, and selection, and they motivate future work on methods that remain robust across diverse platforms and scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2510_26588
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FLYINGTRUST: A Benchmark for Quadrotor Navigation Across Scenarios and Vehicles
Li, Gang
Zhai, Chunlei
Wang, Teng
Li, Shaun
Jiang, Shangsong
Zhu, Xiangwei
Robotics
Visual navigation algorithms for quadrotors often exhibit a large variation in performance when transferred across different vehicle platforms and scene geometries, which increases the cost and risk of field deployment. To support systematic early-stage evaluation, we introduce FLYINGTRUST, a high-fidelity, configurable benchmarking framework that measures how platform kinodynamics and scenario structure jointly affect navigation robustness. FLYINGTRUST models vehicle capability with two compact, physically interpretable indicators: maximum thrust-to-weight ratio and axis-wise maximum angular acceleration. The benchmark pairs a diverse scenario library with a heterogeneous set of real and virtual platforms and prescribes a standardized evaluation protocol together with a composite scoring method that balances scenario importance, platform importance and performance stability. We use FLYINGTRUST to compare representative optimization-based and learning-based navigation approaches under identical conditions, performing repeated trials per platform-scenario combination and reporting uncertainty-aware metrics. The results reveal systematic patterns: navigation success depends predictably on platform capability and scene geometry, and different algorithms exhibit distinct preferences and failure modes across the evaluated conditions. These observations highlight the practical necessity of incorporating both platform capability and scenario structure into algorithm design, evaluation, and selection, and they motivate future work on methods that remain robust across diverse platforms and scenarios.
title FLYINGTRUST: A Benchmark for Quadrotor Navigation Across Scenarios and Vehicles
topic Robotics
url https://arxiv.org/abs/2510.26588