Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Li, Wenhao, Wu, Zimeng, Wu, Yu, Fu, Zehua, Chen, Jiaxin
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913001529933824
author Li, Wenhao
Wu, Zimeng
Wu, Yu
Fu, Zehua
Chen, Jiaxin
author_facet Li, Wenhao
Wu, Zimeng
Wu, Yu
Fu, Zehua
Chen, Jiaxin
contents Unmanned aerial vehicle (UAV) based object detection is a critical but challenging task, when applied in dynamically changing scenarios with limited annotated training data. Layout-to-image generation approaches have proved effective in promoting detection accuracy by synthesizing labeled images based on diffusion models. However, they suffer from frequently producing artifacts, especially near layout boundaries of tiny objects, thus substantially limiting their performance. To address these issues, we propose UAVGen, a novel layout-to-image generation framework tailored for UAV-based object detection. Specifically, UAVGen designs a Visual Prototype Conditioned Diffusion Model (VPC-DM) that constructs representative instances for each class and integrates them into latent embeddings for high-fidelity object generation. Moreover, a Focal Region Enhanced Data Pipeline (FRE-DP) is introduced to emphasize object-concentrated foreground regions in synthesis, combined with a label refinement to correct missing, extra and misaligned generations. Extensive experimental results demonstrate that our method significantly outperforms state-of-the-art approaches, and consistently promotes accuracy when integrated with distinct detectors. The source code is available at https://github.com/Sirius-Li/UAVGen.
format Preprint
id arxiv_https___arxiv_org_abs_2604_02966
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection
Li, Wenhao
Wu, Zimeng
Wu, Yu
Fu, Zehua
Chen, Jiaxin
Computer Vision and Pattern Recognition
Unmanned aerial vehicle (UAV) based object detection is a critical but challenging task, when applied in dynamically changing scenarios with limited annotated training data. Layout-to-image generation approaches have proved effective in promoting detection accuracy by synthesizing labeled images based on diffusion models. However, they suffer from frequently producing artifacts, especially near layout boundaries of tiny objects, thus substantially limiting their performance. To address these issues, we propose UAVGen, a novel layout-to-image generation framework tailored for UAV-based object detection. Specifically, UAVGen designs a Visual Prototype Conditioned Diffusion Model (VPC-DM) that constructs representative instances for each class and integrates them into latent embeddings for high-fidelity object generation. Moreover, a Focal Region Enhanced Data Pipeline (FRE-DP) is introduced to emphasize object-concentrated foreground regions in synthesis, combined with a label refinement to correct missing, extra and misaligned generations. Extensive experimental results demonstrate that our method significantly outperforms state-of-the-art approaches, and consistently promotes accuracy when integrated with distinct detectors. The source code is available at https://github.com/Sirius-Li/UAVGen.
title Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.02966