Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Model

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Mufan, Yang, Qi, Huang, He, Huang, Wenjie, Yuan, Zhenlong, Li, Zhu, Xu, Yiling
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911385500254208
author Liu, Mufan
Yang, Qi
Huang, He
Huang, Wenjie
Yuan, Zhenlong
Li, Zhu
Xu, Yiling
author_facet Liu, Mufan
Yang, Qi
Huang, He
Huang, Wenjie
Yuan, Zhenlong
Li, Zhu
Xu, Yiling
contents 3D Gaussian Splatting (3DGS) has emerged as an efficient and high-fidelity paradigm for novel view synthesis. To adapt 3DGS for dynamic content, deformable 3DGS incorporates temporally deformable primitives with learnable latent embeddings to capture complex motions. Despite its impressive performance, the high-dimensional embeddings and vast number of primitives lead to substantial storage requirements. In this paper, we introduce a \textbf{Light}weight \textbf{4}D\textbf{GS} framework, called Light4GS, that employs significance pruning with a deep context model to provide a lightweight storage-efficient dynamic 3DGS representation. The proposed Light4GS is based on 4DGS that is a typical representation of deformable 3DGS. Specifically, our framework is built upon two core components: (1) a spatio-temporal significance pruning strategy that eliminates over 64\% of the deformable primitives, followed by an entropy-constrained spherical harmonics compression applied to the remainder; and (2) a deep context model that integrates intra- and inter-prediction with hyperprior into a coarse-to-fine context structure to enable efficient multiscale latent embedding compression. Our approach achieves over 120x compression and increases rendering FPS up to 20\% compared to the baseline 4DGS, and also superior to frame-wise state-of-the-art 3DGS compression methods, revealing the effectiveness of our Light4GS in terms of both intra- and inter-prediction methods without sacrificing rendering quality.
format Preprint
id arxiv_https___arxiv_org_abs_2503_13948
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Model
Liu, Mufan
Yang, Qi
Huang, He
Huang, Wenjie
Yuan, Zhenlong
Li, Zhu
Xu, Yiling
Computer Vision and Pattern Recognition
3D Gaussian Splatting (3DGS) has emerged as an efficient and high-fidelity paradigm for novel view synthesis. To adapt 3DGS for dynamic content, deformable 3DGS incorporates temporally deformable primitives with learnable latent embeddings to capture complex motions. Despite its impressive performance, the high-dimensional embeddings and vast number of primitives lead to substantial storage requirements. In this paper, we introduce a \textbf{Light}weight \textbf{4}D\textbf{GS} framework, called Light4GS, that employs significance pruning with a deep context model to provide a lightweight storage-efficient dynamic 3DGS representation. The proposed Light4GS is based on 4DGS that is a typical representation of deformable 3DGS. Specifically, our framework is built upon two core components: (1) a spatio-temporal significance pruning strategy that eliminates over 64\% of the deformable primitives, followed by an entropy-constrained spherical harmonics compression applied to the remainder; and (2) a deep context model that integrates intra- and inter-prediction with hyperprior into a coarse-to-fine context structure to enable efficient multiscale latent embedding compression. Our approach achieves over 120x compression and increases rendering FPS up to 20\% compared to the baseline 4DGS, and also superior to frame-wise state-of-the-art 3DGS compression methods, revealing the effectiveness of our Light4GS in terms of both intra- and inter-prediction methods without sacrificing rendering quality.
title Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Model
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.13948