MUFASA: Multi-View Fusion and Adaptation Network with Spatial Awareness for Radar Object Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Peng, Xiangyuan, Tang, Miao, Sun, Huawei, Bierzynski, Kay, Servadei, Lorenzo, Wille, Robert
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911974667845632
author Peng, Xiangyuan
Tang, Miao
Sun, Huawei
Bierzynski, Kay
Servadei, Lorenzo
Wille, Robert
author_facet Peng, Xiangyuan
Tang, Miao
Sun, Huawei
Bierzynski, Kay
Servadei, Lorenzo
Wille, Robert
contents In recent years, approaches based on radar object detection have made significant progress in autonomous driving systems due to their robustness under adverse weather compared to LiDAR. However, the sparsity of radar point clouds poses challenges in achieving precise object detection, highlighting the importance of effective and comprehensive feature extraction technologies. To address this challenge, this paper introduces a comprehensive feature extraction method for radar point clouds. This study first enhances the capability of detection networks by using a plug-and-play module, GeoSPA. It leverages the Lalonde features to explore local geometric patterns. Additionally, a distributed multi-view attention mechanism, DEMVA, is designed to integrate the shared information across the entire dataset with the global information of each individual frame. By employing the two modules, we present our method, MUFASA, which enhances object detection performance through improved feature extraction. The approach is evaluated on the VoD and TJ4DRaDSet datasets to demonstrate its effectiveness. In particular, we achieve state-of-the-art results among radar-based methods on the VoD dataset with the mAP of 50.24%.
format Preprint
id arxiv_https___arxiv_org_abs_2408_00565
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MUFASA: Multi-View Fusion and Adaptation Network with Spatial Awareness for Radar Object Detection
Peng, Xiangyuan
Tang, Miao
Sun, Huawei
Bierzynski, Kay
Servadei, Lorenzo
Wille, Robert
Computer Vision and Pattern Recognition
In recent years, approaches based on radar object detection have made significant progress in autonomous driving systems due to their robustness under adverse weather compared to LiDAR. However, the sparsity of radar point clouds poses challenges in achieving precise object detection, highlighting the importance of effective and comprehensive feature extraction technologies. To address this challenge, this paper introduces a comprehensive feature extraction method for radar point clouds. This study first enhances the capability of detection networks by using a plug-and-play module, GeoSPA. It leverages the Lalonde features to explore local geometric patterns. Additionally, a distributed multi-view attention mechanism, DEMVA, is designed to integrate the shared information across the entire dataset with the global information of each individual frame. By employing the two modules, we present our method, MUFASA, which enhances object detection performance through improved feature extraction. The approach is evaluated on the VoD and TJ4DRaDSet datasets to demonstrate its effectiveness. In particular, we achieve state-of-the-art results among radar-based methods on the VoD dataset with the mAP of 50.24%.
title MUFASA: Multi-View Fusion and Adaptation Network with Spatial Awareness for Radar Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.00565