YOPOv2-Tracker: An End-to-End Agile Tracking and Navigation Framework from Perception to Action

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lu, Junjie, Hui, Yulin, Zhang, Xuewei, Feng, Wencan, Shen, Hongming, Li, Zhiyu, Tian, Bailing
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913831774584832
author Lu, Junjie
Hui, Yulin
Zhang, Xuewei
Feng, Wencan
Shen, Hongming
Li, Zhiyu
Tian, Bailing
author_facet Lu, Junjie
Hui, Yulin
Zhang, Xuewei
Feng, Wencan
Shen, Hongming
Li, Zhiyu
Tian, Bailing
contents Traditional target tracking pipelines including detection, mapping, navigation, and control are comprehensive but introduce high latency, limitting the agility of quadrotors. On the contrary, we follow the design principle of "less is more", striving to simplify the process while maintaining effectiveness. In this work, we propose an end-to-end agile tracking and navigation framework for quadrotors that directly maps the sensory observations to control commands. Importantly, leveraging the multimodal nature of navigation and detection tasks, our network maintains interpretability by explicitly integrating the independent modules of the traditional pipeline, rather than a crude action regression. In detail, we adopt a set of motion primitives as anchors to cover the searching space regarding the feasible region and potential target. Then we reformulate the trajectory optimization as regression of primitive offsets and associated costs considering the safety, smoothness, and other metrics. For tracking task, the trajectories are expected to approach the target and additional objectness scores are predicted. Subsequently, the predictions, after compensation for the estimated lumped disturbance, are transformed into thrust and attitude as control commands for swift response. During training, we seamlessly integrate traditional motion planning with deep learning by directly back-propagating the gradients of trajectory costs to the network, eliminating the need for expert demonstration in imitation learning and providing more direct guidance than reinforcement learning. Finally, we deploy the algorithm on a compact quadrotor and conduct real-world validations in both forest and building environments to demonstrate the efficiency of the proposed method.
format Preprint
id arxiv_https___arxiv_org_abs_2505_06923
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle YOPOv2-Tracker: An End-to-End Agile Tracking and Navigation Framework from Perception to Action
Lu, Junjie
Hui, Yulin
Zhang, Xuewei
Feng, Wencan
Shen, Hongming
Li, Zhiyu
Tian, Bailing
Robotics
Traditional target tracking pipelines including detection, mapping, navigation, and control are comprehensive but introduce high latency, limitting the agility of quadrotors. On the contrary, we follow the design principle of "less is more", striving to simplify the process while maintaining effectiveness. In this work, we propose an end-to-end agile tracking and navigation framework for quadrotors that directly maps the sensory observations to control commands. Importantly, leveraging the multimodal nature of navigation and detection tasks, our network maintains interpretability by explicitly integrating the independent modules of the traditional pipeline, rather than a crude action regression. In detail, we adopt a set of motion primitives as anchors to cover the searching space regarding the feasible region and potential target. Then we reformulate the trajectory optimization as regression of primitive offsets and associated costs considering the safety, smoothness, and other metrics. For tracking task, the trajectories are expected to approach the target and additional objectness scores are predicted. Subsequently, the predictions, after compensation for the estimated lumped disturbance, are transformed into thrust and attitude as control commands for swift response. During training, we seamlessly integrate traditional motion planning with deep learning by directly back-propagating the gradients of trajectory costs to the network, eliminating the need for expert demonstration in imitation learning and providing more direct guidance than reinforcement learning. Finally, we deploy the algorithm on a compact quadrotor and conduct real-world validations in both forest and building environments to demonstrate the efficiency of the proposed method.
title YOPOv2-Tracker: An End-to-End Agile Tracking and Navigation Framework from Perception to Action
topic Robotics
url https://arxiv.org/abs/2505.06923