PedDet: Adaptive Spectral Optimization for Multimodal Pedestrian Detection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910840248074240 |
|---|---|
| author | Zhao, Rui Zhang, Zeyu Xu, Yi Yao, Yi Huang, Yan Zhang, Wenxin Song, Zirui Chen, Xiuying Zhao, Yang |
| author_facet | Zhao, Rui Zhang, Zeyu Xu, Yi Yao, Yi Huang, Yan Zhang, Wenxin Song, Zirui Chen, Xiuying Zhao, Yang |
| contents | Pedestrian detection in intelligent transportation systems has made significant progress but faces two critical challenges: (1) insufficient fusion of complementary information between visible and infrared spectra, particularly in complex scenarios, and (2) sensitivity to illumination changes, such as low-light or overexposed conditions, leading to degraded performance. To address these issues, we propose PedDet, an adaptive spectral optimization complementarity framework specifically enhanced and optimized for multispectral pedestrian detection. PedDet introduces the Multi-scale Spectral Feature Perception Module (MSFPM) to adaptively fuse visible and infrared features, enhancing robustness and flexibility in feature extraction. Additionally, the Illumination Robustness Feature Decoupling Module (IRFDM) improves detection stability under varying lighting by decoupling pedestrian and background features. We further design a contrastive alignment to enhance intermodal feature discrimination. Experiments on LLVIP and MSDS datasets demonstrate that PedDet achieves state-of-the-art performance, improving the mAP by 6.6% with superior detection accuracy even in low-light conditions, marking a significant step forward for road safety. Code will be available at https://github.com/AIGeeksGroup/PedDet. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_14063 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PedDet: Adaptive Spectral Optimization for Multimodal Pedestrian Detection Zhao, Rui Zhang, Zeyu Xu, Yi Yao, Yi Huang, Yan Zhang, Wenxin Song, Zirui Chen, Xiuying Zhao, Yang Computer Vision and Pattern Recognition Pedestrian detection in intelligent transportation systems has made significant progress but faces two critical challenges: (1) insufficient fusion of complementary information between visible and infrared spectra, particularly in complex scenarios, and (2) sensitivity to illumination changes, such as low-light or overexposed conditions, leading to degraded performance. To address these issues, we propose PedDet, an adaptive spectral optimization complementarity framework specifically enhanced and optimized for multispectral pedestrian detection. PedDet introduces the Multi-scale Spectral Feature Perception Module (MSFPM) to adaptively fuse visible and infrared features, enhancing robustness and flexibility in feature extraction. Additionally, the Illumination Robustness Feature Decoupling Module (IRFDM) improves detection stability under varying lighting by decoupling pedestrian and background features. We further design a contrastive alignment to enhance intermodal feature discrimination. Experiments on LLVIP and MSDS datasets demonstrate that PedDet achieves state-of-the-art performance, improving the mAP by 6.6% with superior detection accuracy even in low-light conditions, marking a significant step forward for road safety. Code will be available at https://github.com/AIGeeksGroup/PedDet. |
| title | PedDet: Adaptive Spectral Optimization for Multimodal Pedestrian Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2502.14063 |