Saved in:
Bibliographic Details
Main Authors: Yu, Xiaofan, Wu, Yuwei, Mao, Katherine, Tian, Ye, Kumar, Vijay, Rosing, Tajana
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.21523
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909806767374336
author Yu, Xiaofan
Wu, Yuwei
Mao, Katherine
Tian, Ye
Kumar, Vijay
Rosing, Tajana
author_facet Yu, Xiaofan
Wu, Yuwei
Mao, Katherine
Tian, Ye
Kumar, Vijay
Rosing, Tajana
contents Multi-robot target tracking is a fundamental problem that requires coordinated monitoring of dynamic entities in applications such as precision agriculture, environmental monitoring, disaster response, and security surveillance. While Federated Learning (FL) has the potential to enhance learning across multiple robots without centralized data aggregation, its use in multi-Unmanned Aerial Vehicle (UAV) target tracking remains largely underexplored. Key challenges include limited onboard computational resources, significant data heterogeneity in FL due to varying targets and the fields of view, and the need for tight coupling between trajectory prediction and multi-robot planning. In this paper, we introduce DroneFL, the first federated learning framework specifically designed for efficient multi-UAV target tracking. We design a lightweight local model to predict target trajectories from sensor inputs, using a frozen YOLO backbone and a shallow transformer for efficient onboard training. The updated models are periodically aggregated in the cloud for global knowledge sharing. To alleviate the data heterogeneity that hinders FL convergence, DroneFL introduces a position-invariant model architecture with altitude-based adaptive instance normalization. Finally, we fuse predictions from multiple UAVs in the cloud and generate optimal trajectories that balance target prediction accuracy and overall tracking performance. Our results show that DroneFL reduces prediction error by 6%-83% and tracking distance by 0.4%-4.6% compared to a distributed non-FL framework. In terms of efficiency, DroneFL runs in real time on a Raspberry Pi 5 and has on average just 1.56 KBps data rate to the cloud.
format Preprint
id arxiv_https___arxiv_org_abs_2509_21523
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DroneFL: Federated Learning for Multi-UAV Visual Target Tracking
Yu, Xiaofan
Wu, Yuwei
Mao, Katherine
Tian, Ye
Kumar, Vijay
Rosing, Tajana
Robotics
Multi-robot target tracking is a fundamental problem that requires coordinated monitoring of dynamic entities in applications such as precision agriculture, environmental monitoring, disaster response, and security surveillance. While Federated Learning (FL) has the potential to enhance learning across multiple robots without centralized data aggregation, its use in multi-Unmanned Aerial Vehicle (UAV) target tracking remains largely underexplored. Key challenges include limited onboard computational resources, significant data heterogeneity in FL due to varying targets and the fields of view, and the need for tight coupling between trajectory prediction and multi-robot planning. In this paper, we introduce DroneFL, the first federated learning framework specifically designed for efficient multi-UAV target tracking. We design a lightweight local model to predict target trajectories from sensor inputs, using a frozen YOLO backbone and a shallow transformer for efficient onboard training. The updated models are periodically aggregated in the cloud for global knowledge sharing. To alleviate the data heterogeneity that hinders FL convergence, DroneFL introduces a position-invariant model architecture with altitude-based adaptive instance normalization. Finally, we fuse predictions from multiple UAVs in the cloud and generate optimal trajectories that balance target prediction accuracy and overall tracking performance. Our results show that DroneFL reduces prediction error by 6%-83% and tracking distance by 0.4%-4.6% compared to a distributed non-FL framework. In terms of efficiency, DroneFL runs in real time on a Raspberry Pi 5 and has on average just 1.56 KBps data rate to the cloud.
title DroneFL: Federated Learning for Multi-UAV Visual Target Tracking
topic Robotics
url https://arxiv.org/abs/2509.21523