4DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radar

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tang, Xiao, Zhuo, Guirong, Wang, Cong, Zheng, Boyuan, Huang, Minqing, Zheng, Lianqing, Chen, Long, Lu, Shouyi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915497054830592
author Tang, Xiao
Zhuo, Guirong
Wang, Cong
Zheng, Boyuan
Huang, Minqing
Zheng, Lianqing
Chen, Long
Lu, Shouyi
author_facet Tang, Xiao
Zhuo, Guirong
Wang, Cong
Zheng, Boyuan
Huang, Minqing
Zheng, Lianqing
Chen, Long
Lu, Shouyi
contents 3D reconstruction and novel view synthesis are critical for validating autonomous driving systems and training advanced perception models. Recent self-supervised methods have gained significant attention due to their cost-effectiveness and enhanced generalization in scenarios where annotated bounding boxes are unavailable. However, existing approaches, which often rely on frequency-domain decoupling or optical flow, struggle to accurately reconstruct dynamic objects due to imprecise motion estimation and weak temporal consistency, resulting in incomplete or distorted representations of dynamic scene elements. To address these challenges, we propose 4DRadar-GS, a 4D Radar-augmented self-supervised 3D reconstruction framework tailored for dynamic driving scenes. Specifically, we first present a 4D Radar-assisted Gaussian initialization scheme that leverages 4D Radar's velocity and spatial information to segment dynamic objects and recover monocular depth scale, generating accurate Gaussian point representations. In addition, we propose a Velocity-guided PointTrack (VGPT) model, which is jointly trained with the reconstruction pipeline under scene flow supervision, to track fine-grained dynamic trajectories and construct temporally consistent representations. Evaluated on the OmniHD-Scenes dataset, 4DRadar-GS achieves state-of-the-art performance in dynamic driving scene 3D reconstruction.
format Preprint
id arxiv_https___arxiv_org_abs_2509_12931
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle 4DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radar
Tang, Xiao
Zhuo, Guirong
Wang, Cong
Zheng, Boyuan
Huang, Minqing
Zheng, Lianqing
Chen, Long
Lu, Shouyi
Computer Vision and Pattern Recognition
3D reconstruction and novel view synthesis are critical for validating autonomous driving systems and training advanced perception models. Recent self-supervised methods have gained significant attention due to their cost-effectiveness and enhanced generalization in scenarios where annotated bounding boxes are unavailable. However, existing approaches, which often rely on frequency-domain decoupling or optical flow, struggle to accurately reconstruct dynamic objects due to imprecise motion estimation and weak temporal consistency, resulting in incomplete or distorted representations of dynamic scene elements. To address these challenges, we propose 4DRadar-GS, a 4D Radar-augmented self-supervised 3D reconstruction framework tailored for dynamic driving scenes. Specifically, we first present a 4D Radar-assisted Gaussian initialization scheme that leverages 4D Radar's velocity and spatial information to segment dynamic objects and recover monocular depth scale, generating accurate Gaussian point representations. In addition, we propose a Velocity-guided PointTrack (VGPT) model, which is jointly trained with the reconstruction pipeline under scene flow supervision, to track fine-grained dynamic trajectories and construct temporally consistent representations. Evaluated on the OmniHD-Scenes dataset, 4DRadar-GS achieves state-of-the-art performance in dynamic driving scene 3D reconstruction.
title 4DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radar
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.12931