CVFusion: Cross-View Fusion of 4D Radar and Camera for 3D Object Detection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916829625057280 |
|---|---|
| author | Zhong, Hanzhi Xiang, Zhiyu Xu, Ruoyu Fu, Jingyun Xu, Peng Wang, Shaohong Yang, Zhihao Pu, Tianyu Liu, Eryun |
| author_facet | Zhong, Hanzhi Xiang, Zhiyu Xu, Ruoyu Fu, Jingyun Xu, Peng Wang, Shaohong Yang, Zhihao Pu, Tianyu Liu, Eryun |
| contents | 4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by integrating images from camera and perform modality fusion in BEV space. However, the potential of the radar and the fusion mechanism is still largely unexplored, hindering the performance improvement. In this study, we propose a cross-view two-stage fusion network called CVFusion. In the first stage, we design a radar guided iterative (RGIter) BEV fusion module to generate high-recall 3D proposal boxes. In the second stage, we aggregate features from multiple heterogeneous views including points, image, and BEV for each proposal. These comprehensive instance level features greatly help refine the proposals and generate high-quality predictions. Extensive experiments on public datasets show that our method outperforms the previous state-of-the-art methods by a large margin, with 9.10% and 3.68% mAP improvements on View-of-Delft (VoD) and TJ4DRadSet, respectively. Our code will be made publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_04587 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | CVFusion: Cross-View Fusion of 4D Radar and Camera for 3D Object Detection Zhong, Hanzhi Xiang, Zhiyu Xu, Ruoyu Fu, Jingyun Xu, Peng Wang, Shaohong Yang, Zhihao Pu, Tianyu Liu, Eryun Computer Vision and Pattern Recognition 4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by integrating images from camera and perform modality fusion in BEV space. However, the potential of the radar and the fusion mechanism is still largely unexplored, hindering the performance improvement. In this study, we propose a cross-view two-stage fusion network called CVFusion. In the first stage, we design a radar guided iterative (RGIter) BEV fusion module to generate high-recall 3D proposal boxes. In the second stage, we aggregate features from multiple heterogeneous views including points, image, and BEV for each proposal. These comprehensive instance level features greatly help refine the proposals and generate high-quality predictions. Extensive experiments on public datasets show that our method outperforms the previous state-of-the-art methods by a large margin, with 9.10% and 3.68% mAP improvements on View-of-Delft (VoD) and TJ4DRadSet, respectively. Our code will be made publicly available. |
| title | CVFusion: Cross-View Fusion of 4D Radar and Camera for 3D Object Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2507.04587 |