Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Xiang, Liang, Alan, Liu, Youquan, Sun, Xian, Li, Linfeng, Kong, Lingdong, Liu, Ziwei, Liu, Qingshan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911742226857984
author Xu, Xiang
Liang, Alan
Liu, Youquan
Sun, Xian
Li, Linfeng
Kong, Lingdong
Liu, Ziwei
Liu, Qingshan
author_facet Xu, Xiang
Liang, Alan
Liu, Youquan
Sun, Xian
Li, Linfeng
Kong, Lingdong
Liu, Ziwei
Liu, Qingshan
contents Constructing faithful 4D worlds from LiDAR-acquired sequences is crucial for embodied AI, yet current generative frameworks apply uniform modeling capacity across all spatial regions. This ignores that perceptual difficulty varies dramatically within a single scan: distant surfaces, occluded boundaries, and small-scale objects carry far higher uncertainty than well-observed structures. We present U4D, a new framework that explicitly leverages spatial uncertainty to guide LiDAR scene generation in a "hard-to-easy" schedule. U4D derives per-point uncertainty maps via Shannon Entropy from a pretrained segmentor, then applies an unconditional diffusion stage to synthesize high-entropy areas with precise geometry, followed by a conditional completion stage that fills in the remaining regions using these structures as priors. A MoST (Mixture of Spatio-Temporal) block further maintains cross-frame coherence by dynamically balancing spatial detail and temporal continuity. Extensive experiments on nuScenes and SemanticKITTI demonstrate state-of-the-art scene fidelity, temporal consistency, and downstream performance.
format Preprint
id arxiv_https___arxiv_org_abs_2606_02510
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis
Xu, Xiang
Liang, Alan
Liu, Youquan
Sun, Xian
Li, Linfeng
Kong, Lingdong
Liu, Ziwei
Liu, Qingshan
Computer Vision and Pattern Recognition
Robotics
Constructing faithful 4D worlds from LiDAR-acquired sequences is crucial for embodied AI, yet current generative frameworks apply uniform modeling capacity across all spatial regions. This ignores that perceptual difficulty varies dramatically within a single scan: distant surfaces, occluded boundaries, and small-scale objects carry far higher uncertainty than well-observed structures. We present U4D, a new framework that explicitly leverages spatial uncertainty to guide LiDAR scene generation in a "hard-to-easy" schedule. U4D derives per-point uncertainty maps via Shannon Entropy from a pretrained segmentor, then applies an unconditional diffusion stage to synthesize high-entropy areas with precise geometry, followed by a conditional completion stage that fills in the remaining regions using these structures as priors. A MoST (Mixture of Spatio-Temporal) block further maintains cross-frame coherence by dynamically balancing spatial detail and temporal continuity. Extensive experiments on nuScenes and SemanticKITTI demonstrate state-of-the-art scene fidelity, temporal consistency, and downstream performance.
title Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2606.02510