ELMGS: Enhancing memory and computation scaLability through coMpression for 3D Gaussian Splatting

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ali, Muhammad Salman, Bae, Sung-Ho, Tartaglione, Enzo
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929568757055488
author Ali, Muhammad Salman
Bae, Sung-Ho
Tartaglione, Enzo
author_facet Ali, Muhammad Salman
Bae, Sung-Ho
Tartaglione, Enzo
contents 3D models have recently been popularized by the potentiality of end-to-end training offered first by Neural Radiance Fields and most recently by 3D Gaussian Splatting models. The latter has the big advantage of naturally providing fast training convergence and high editability. However, as the research around these is still in its infancy, there is still a gap in the literature regarding the model's scalability. In this work, we propose an approach enabling both memory and computation scalability of such models. More specifically, we propose an iterative pruning strategy that removes redundant information encoded in the model. We also enhance compressibility for the model by including in the optimization strategy a differentiable quantization and entropy coding estimator. Our results on popular benchmarks showcase the effectiveness of the proposed approach and open the road to the broad deployability of such a solution even on resource-constrained devices.
format Preprint
id arxiv_https___arxiv_org_abs_2410_23213
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ELMGS: Enhancing memory and computation scaLability through coMpression for 3D Gaussian Splatting
Ali, Muhammad Salman
Bae, Sung-Ho
Tartaglione, Enzo
Computer Vision and Pattern Recognition
3D models have recently been popularized by the potentiality of end-to-end training offered first by Neural Radiance Fields and most recently by 3D Gaussian Splatting models. The latter has the big advantage of naturally providing fast training convergence and high editability. However, as the research around these is still in its infancy, there is still a gap in the literature regarding the model's scalability. In this work, we propose an approach enabling both memory and computation scalability of such models. More specifically, we propose an iterative pruning strategy that removes redundant information encoded in the model. We also enhance compressibility for the model by including in the optimization strategy a differentiable quantization and entropy coding estimator. Our results on popular benchmarks showcase the effectiveness of the proposed approach and open the road to the broad deployability of such a solution even on resource-constrained devices.
title ELMGS: Enhancing memory and computation scaLability through coMpression for 3D Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.23213