4D Neural Voxel Splatting: Dynamic Scene Rendering with Voxelized Guassian Splatting

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Chun-Tin, Chen, Jun-Cheng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914550196994048
author Wu, Chun-Tin
Chen, Jun-Cheng
author_facet Wu, Chun-Tin
Chen, Jun-Cheng
contents Although 3D Gaussian Splatting (3D-GS) achieves efficient rendering for novel view synthesis, extending it to dynamic scenes still results in substantial memory overhead from replicating Gaussians across frames. To address this challenge, we propose 4D Neural Voxel Splatting (4D-NVS), which combines voxel-based representations with neural Gaussian splatting for efficient dynamic scene modeling. Instead of generating separate Gaussian sets per timestamp, our method employs a compact set of neural voxels with learned deformation fields to model temporal dynamics. The design greatly reduces memory consumption and accelerates training while preserving high image quality. We further introduce a novel view refinement stage that selectively improves challenging viewpoints through targeted optimization, maintaining global efficiency while enhancing rendering quality for difficult viewing angles. Experiments demonstrate that our method outperforms state-of-the-art approaches with significant memory reduction and faster training, enabling real-time rendering with superior visual fidelity.
format Preprint
id arxiv_https___arxiv_org_abs_2511_00560
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle 4D Neural Voxel Splatting: Dynamic Scene Rendering with Voxelized Guassian Splatting
Wu, Chun-Tin
Chen, Jun-Cheng
Computer Vision and Pattern Recognition
Although 3D Gaussian Splatting (3D-GS) achieves efficient rendering for novel view synthesis, extending it to dynamic scenes still results in substantial memory overhead from replicating Gaussians across frames. To address this challenge, we propose 4D Neural Voxel Splatting (4D-NVS), which combines voxel-based representations with neural Gaussian splatting for efficient dynamic scene modeling. Instead of generating separate Gaussian sets per timestamp, our method employs a compact set of neural voxels with learned deformation fields to model temporal dynamics. The design greatly reduces memory consumption and accelerates training while preserving high image quality. We further introduce a novel view refinement stage that selectively improves challenging viewpoints through targeted optimization, maintaining global efficiency while enhancing rendering quality for difficult viewing angles. Experiments demonstrate that our method outperforms state-of-the-art approaches with significant memory reduction and faster training, enabling real-time rendering with superior visual fidelity.
title 4D Neural Voxel Splatting: Dynamic Scene Rendering with Voxelized Guassian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.00560