UniDet-D: A Unified Dynamic Spectral Attention Model for Object Detection under Adverse Weathers

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Wei, Wang, Yuantao, Yang, Haowei, Zhuang, Yin, Lu, Shijian, Mao, Xuerui
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916880555442176
author Zhang, Wei
Wang, Yuantao
Yang, Haowei
Zhuang, Yin
Lu, Shijian
Mao, Xuerui
author_facet Zhang, Wei
Wang, Yuantao
Yang, Haowei
Zhuang, Yin
Lu, Shijian
Mao, Xuerui
contents Real-world object detection is a challenging task where the captured images/videos often suffer from complex degradations due to various adverse weather conditions such as rain, fog, snow, low-light, etc. Despite extensive prior efforts, most existing methods are designed for one specific type of adverse weather with constraints of poor generalization, under-utilization of visual features while handling various image degradations. Leveraging a theoretical analysis on how critical visual details are lost in adverse-weather images, we design UniDet-D, a unified framework that tackles the challenge of object detection under various adverse weather conditions, and achieves object detection and image restoration within a single network. Specifically, the proposed UniDet-D incorporates a dynamic spectral attention mechanism that adaptively emphasizes informative spectral components while suppressing irrelevant ones, enabling more robust and discriminative feature representation across various degradation types. Extensive experiments show that UniDet-D achieves superior detection accuracy across different types of adverse-weather degradation. Furthermore, UniDet-D demonstrates superior generalization towards unseen adverse weather conditions such as sandstorms and rain-fog mixtures, highlighting its great potential for real-world deployment.
format Preprint
id arxiv_https___arxiv_org_abs_2506_12324
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UniDet-D: A Unified Dynamic Spectral Attention Model for Object Detection under Adverse Weathers
Zhang, Wei
Wang, Yuantao
Yang, Haowei
Zhuang, Yin
Lu, Shijian
Mao, Xuerui
Computer Vision and Pattern Recognition
Real-world object detection is a challenging task where the captured images/videos often suffer from complex degradations due to various adverse weather conditions such as rain, fog, snow, low-light, etc. Despite extensive prior efforts, most existing methods are designed for one specific type of adverse weather with constraints of poor generalization, under-utilization of visual features while handling various image degradations. Leveraging a theoretical analysis on how critical visual details are lost in adverse-weather images, we design UniDet-D, a unified framework that tackles the challenge of object detection under various adverse weather conditions, and achieves object detection and image restoration within a single network. Specifically, the proposed UniDet-D incorporates a dynamic spectral attention mechanism that adaptively emphasizes informative spectral components while suppressing irrelevant ones, enabling more robust and discriminative feature representation across various degradation types. Extensive experiments show that UniDet-D achieves superior detection accuracy across different types of adverse-weather degradation. Furthermore, UniDet-D demonstrates superior generalization towards unseen adverse weather conditions such as sandstorms and rain-fog mixtures, highlighting its great potential for real-world deployment.
title UniDet-D: A Unified Dynamic Spectral Attention Model for Object Detection under Adverse Weathers
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.12324