GaussianForest: Hierarchical-Hybrid 3D Gaussian Splatting for Compressed Scene Modeling

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Fengyi, Luo, Yadan, Zhang, Tianjun, Zhang, Lin, Huang, Zi
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911981475201024
author Zhang, Fengyi
Luo, Yadan
Zhang, Tianjun
Zhang, Lin
Huang, Zi
author_facet Zhang, Fengyi
Luo, Yadan
Zhang, Tianjun
Zhang, Lin
Huang, Zi
contents The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely on ray tracing, demonstrates superior rendering quality and speed. However, the explicit and unstructured nature of 3D Gaussians poses a significant storage challenge, impeding its broader application. To address this challenge, we introduce the Gaussian-Forest modeling framework, which hierarchically represents a scene as a forest of hybrid 3D Gaussians. Each hybrid Gaussian retains its unique explicit attributes while sharing implicit ones with its sibling Gaussians, thus optimizing parameterization with significantly fewer variables. Moreover, adaptive growth and pruning strategies are designed, ensuring detailed representation in complex regions and a notable reduction in the number of required Gaussians. Extensive experiments demonstrate that Gaussian-Forest not only maintains comparable speed and quality but also achieves a compression rate surpassing 10 times, marking a significant advancement in efficient scene modeling. Codes will be available at https://github.com/Xian-Bei/GaussianForest.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08759
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GaussianForest: Hierarchical-Hybrid 3D Gaussian Splatting for Compressed Scene Modeling
Zhang, Fengyi
Luo, Yadan
Zhang, Tianjun
Zhang, Lin
Huang, Zi
Computer Vision and Pattern Recognition
Multimedia
The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely on ray tracing, demonstrates superior rendering quality and speed. However, the explicit and unstructured nature of 3D Gaussians poses a significant storage challenge, impeding its broader application. To address this challenge, we introduce the Gaussian-Forest modeling framework, which hierarchically represents a scene as a forest of hybrid 3D Gaussians. Each hybrid Gaussian retains its unique explicit attributes while sharing implicit ones with its sibling Gaussians, thus optimizing parameterization with significantly fewer variables. Moreover, adaptive growth and pruning strategies are designed, ensuring detailed representation in complex regions and a notable reduction in the number of required Gaussians. Extensive experiments demonstrate that Gaussian-Forest not only maintains comparable speed and quality but also achieves a compression rate surpassing 10 times, marking a significant advancement in efficient scene modeling. Codes will be available at https://github.com/Xian-Bei/GaussianForest.
title GaussianForest: Hierarchical-Hybrid 3D Gaussian Splatting for Compressed Scene Modeling
topic Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2406.08759