EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Miao, Sheng, Li, Sijin, Wang, Pan, Bai, Dongfeng, Liu, Bingbing, Wang, Yue, Geiger, Andreas, Liao, Yiyi
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915747511402496
author Miao, Sheng
Li, Sijin
Wang, Pan
Bai, Dongfeng
Liu, Bingbing
Wang, Yue
Geiger, Andreas
Liao, Yiyi
author_facet Miao, Sheng
Li, Sijin
Wang, Pan
Bai, Dongfeng
Liu, Bingbing
Wang, Yue
Geiger, Andreas
Liao, Yiyi
contents Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and 3D Gaussian Splatting approaches achieve photorealism, they often rely on time-consuming per-scene optimization. Conversely, emerging feed-forward methods frequently adopt per-pixel Gaussian representations, which lead to 3D inconsistencies when aggregating multi-view predictions in complex, dynamic environments. We propose EvolSplat4D, a feed-forward framework that moves beyond existing per-pixel paradigms by unifying volume-based and pixel-based Gaussian prediction across three specialized branches. For close-range static regions, we predict consistent geometry of 3D Gaussians over multiple frames directly from a 3D feature volume, complemented by a semantically-enhanced image-based rendering module for predicting their appearance. For dynamic actors, we utilize object-centric canonical spaces and a motion-adjusted rendering module to aggregate temporal features, ensuring stable 4D reconstruction despite noisy motion priors. Far-Field scenery is handled by an efficient per-pixel Gaussian branch to ensure full-scene coverage. Experimental results on the KITTI-360, KITTI, Waymo, and PandaSet datasets show that EvolSplat4D reconstructs both static and dynamic environments with superior accuracy and consistency, outperforming both per-scene optimization and state-of-the-art feed-forward baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2601_15951
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis
Miao, Sheng
Li, Sijin
Wang, Pan
Bai, Dongfeng
Liu, Bingbing
Wang, Yue
Geiger, Andreas
Liao, Yiyi
Computer Vision and Pattern Recognition
Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and 3D Gaussian Splatting approaches achieve photorealism, they often rely on time-consuming per-scene optimization. Conversely, emerging feed-forward methods frequently adopt per-pixel Gaussian representations, which lead to 3D inconsistencies when aggregating multi-view predictions in complex, dynamic environments. We propose EvolSplat4D, a feed-forward framework that moves beyond existing per-pixel paradigms by unifying volume-based and pixel-based Gaussian prediction across three specialized branches. For close-range static regions, we predict consistent geometry of 3D Gaussians over multiple frames directly from a 3D feature volume, complemented by a semantically-enhanced image-based rendering module for predicting their appearance. For dynamic actors, we utilize object-centric canonical spaces and a motion-adjusted rendering module to aggregate temporal features, ensuring stable 4D reconstruction despite noisy motion priors. Far-Field scenery is handled by an efficient per-pixel Gaussian branch to ensure full-scene coverage. Experimental results on the KITTI-360, KITTI, Waymo, and PandaSet datasets show that EvolSplat4D reconstructs both static and dynamic environments with superior accuracy and consistency, outperforming both per-scene optimization and state-of-the-art feed-forward baselines.
title EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.15951