NeuRadar: Neural Radiance Fields for Automotive Radar Point Clouds

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rafidashti, Mahan, Lan, Ji, Fatemi, Maryam, Fu, Junsheng, Hammarstrand, Lars, Svensson, Lennart
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909622904815616
author Rafidashti, Mahan
Lan, Ji
Fatemi, Maryam
Fu, Junsheng
Hammarstrand, Lars
Svensson, Lennart
author_facet Rafidashti, Mahan
Lan, Ji
Fatemi, Maryam
Fu, Junsheng
Hammarstrand, Lars
Svensson, Lennart
contents Radar is an important sensor for autonomous driving (AD) systems due to its robustness to adverse weather and different lighting conditions. Novel view synthesis using neural radiance fields (NeRFs) has recently received considerable attention in AD due to its potential to enable efficient testing and validation but remains unexplored for radar point clouds. In this paper, we present NeuRadar, a NeRF-based model that jointly generates radar point clouds, camera images, and lidar point clouds. We explore set-based object detection methods such as DETR, and propose an encoder-based solution grounded in the NeRF geometry for improved generalizability. We propose both a deterministic and a probabilistic point cloud representation to accurately model the radar behavior, with the latter being able to capture radar's stochastic behavior. We achieve realistic reconstruction results for two automotive datasets, establishing a baseline for NeRF-based radar point cloud simulation models. In addition, we release radar data for ZOD's Sequences and Drives to enable further research in this field. To encourage further development of radar NeRFs, we release the source code for NeuRadar.
format Preprint
id arxiv_https___arxiv_org_abs_2504_00859
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle NeuRadar: Neural Radiance Fields for Automotive Radar Point Clouds
Rafidashti, Mahan
Lan, Ji
Fatemi, Maryam
Fu, Junsheng
Hammarstrand, Lars
Svensson, Lennart
Computer Vision and Pattern Recognition
Radar is an important sensor for autonomous driving (AD) systems due to its robustness to adverse weather and different lighting conditions. Novel view synthesis using neural radiance fields (NeRFs) has recently received considerable attention in AD due to its potential to enable efficient testing and validation but remains unexplored for radar point clouds. In this paper, we present NeuRadar, a NeRF-based model that jointly generates radar point clouds, camera images, and lidar point clouds. We explore set-based object detection methods such as DETR, and propose an encoder-based solution grounded in the NeRF geometry for improved generalizability. We propose both a deterministic and a probabilistic point cloud representation to accurately model the radar behavior, with the latter being able to capture radar's stochastic behavior. We achieve realistic reconstruction results for two automotive datasets, establishing a baseline for NeRF-based radar point cloud simulation models. In addition, we release radar data for ZOD's Sequences and Drives to enable further research in this field. To encourage further development of radar NeRFs, we release the source code for NeuRadar.
title NeuRadar: Neural Radiance Fields for Automotive Radar Point Clouds
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.00859