Object Style Diffusion for Generalized Object Detection in Urban Scene

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Hao, Yang, Xiangyuan, Wang, Mengzhu, Lan, Long, Liang, Ke, Liu, Xinwang, Li, Kenli
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917872482123776
author Li, Hao
Yang, Xiangyuan
Wang, Mengzhu
Lan, Long
Liang, Ke
Liu, Xinwang
Li, Kenli
author_facet Li, Hao
Yang, Xiangyuan
Wang, Mengzhu
Lan, Long
Liang, Ke
Liu, Xinwang
Li, Kenli
contents Object detection is a critical task in computer vision, with applications in various domains such as autonomous driving and urban scene monitoring. However, deep learning-based approaches often demand large volumes of annotated data, which are costly and difficult to acquire, particularly in complex and unpredictable real-world environments. This dependency significantly hampers the generalization capability of existing object detection techniques. To address this issue, we introduce a novel single-domain object detection generalization method, named GoDiff, which leverages a pre-trained model to enhance generalization in unseen domains. Central to our approach is the Pseudo Target Data Generation (PTDG) module, which employs a latent diffusion model to generate pseudo-target domain data that preserves source domain characteristics while introducing stylistic variations. By integrating this pseudo data with source domain data, we diversify the training dataset. Furthermore, we introduce a cross-style instance normalization technique to blend style features from different domains generated by the PTDG module, thereby increasing the detector's robustness. Experimental results demonstrate that our method not only enhances the generalization ability of existing detectors but also functions as a plug-and-play enhancement for other single-domain generalization methods, achieving state-of-the-art performance in autonomous driving scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2412_13815
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Object Style Diffusion for Generalized Object Detection in Urban Scene
Li, Hao
Yang, Xiangyuan
Wang, Mengzhu
Lan, Long
Liang, Ke
Liu, Xinwang
Li, Kenli
Computer Vision and Pattern Recognition
Object detection is a critical task in computer vision, with applications in various domains such as autonomous driving and urban scene monitoring. However, deep learning-based approaches often demand large volumes of annotated data, which are costly and difficult to acquire, particularly in complex and unpredictable real-world environments. This dependency significantly hampers the generalization capability of existing object detection techniques. To address this issue, we introduce a novel single-domain object detection generalization method, named GoDiff, which leverages a pre-trained model to enhance generalization in unseen domains. Central to our approach is the Pseudo Target Data Generation (PTDG) module, which employs a latent diffusion model to generate pseudo-target domain data that preserves source domain characteristics while introducing stylistic variations. By integrating this pseudo data with source domain data, we diversify the training dataset. Furthermore, we introduce a cross-style instance normalization technique to blend style features from different domains generated by the PTDG module, thereby increasing the detector's robustness. Experimental results demonstrate that our method not only enhances the generalization ability of existing detectors but also functions as a plug-and-play enhancement for other single-domain generalization methods, achieving state-of-the-art performance in autonomous driving scenarios.
title Object Style Diffusion for Generalized Object Detection in Urban Scene
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.13815