Sparse Point Cloud Patches Rendering via Splitting 2D Gaussians

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Changfeng, Ma, Ran, Bi, Jie, Guo, Chongjun, Wang, Yanwen, Guo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918020437245952
author Changfeng, Ma
Ran, Bi
Jie, Guo
Chongjun, Wang
Yanwen, Guo
author_facet Changfeng, Ma
Ran, Bi
Jie, Guo
Chongjun, Wang
Yanwen, Guo
contents Current learning-based methods predict NeRF or 3D Gaussians from point clouds to achieve photo-realistic rendering but still depend on categorical priors, dense point clouds, or additional refinements. Hence, we introduce a novel point cloud rendering method by predicting 2D Gaussians from point clouds. Our method incorporates two identical modules with an entire-patch architecture enabling the network to be generalized to multiple datasets. The module normalizes and initializes the Gaussians utilizing the point cloud information including normals, colors and distances. Then, splitting decoders are employed to refine the initial Gaussians by duplicating them and predicting more accurate results, making our methodology effectively accommodate sparse point clouds as well. Once trained, our approach exhibits direct generalization to point clouds across different categories. The predicted Gaussians are employed directly for rendering without additional refinement on the rendered images, retaining the benefits of 2D Gaussians. We conduct extensive experiments on various datasets, and the results demonstrate the superiority and generalization of our method, which achieves SOTA performance. The code is available at https://github.com/murcherful/GauPCRender}{https://github.com/murcherful/GauPCRender.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09413
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sparse Point Cloud Patches Rendering via Splitting 2D Gaussians
Changfeng, Ma
Ran, Bi
Jie, Guo
Chongjun, Wang
Yanwen, Guo
Computer Vision and Pattern Recognition
Current learning-based methods predict NeRF or 3D Gaussians from point clouds to achieve photo-realistic rendering but still depend on categorical priors, dense point clouds, or additional refinements. Hence, we introduce a novel point cloud rendering method by predicting 2D Gaussians from point clouds. Our method incorporates two identical modules with an entire-patch architecture enabling the network to be generalized to multiple datasets. The module normalizes and initializes the Gaussians utilizing the point cloud information including normals, colors and distances. Then, splitting decoders are employed to refine the initial Gaussians by duplicating them and predicting more accurate results, making our methodology effectively accommodate sparse point clouds as well. Once trained, our approach exhibits direct generalization to point clouds across different categories. The predicted Gaussians are employed directly for rendering without additional refinement on the rendered images, retaining the benefits of 2D Gaussians. We conduct extensive experiments on various datasets, and the results demonstrate the superiority and generalization of our method, which achieves SOTA performance. The code is available at https://github.com/murcherful/GauPCRender}{https://github.com/murcherful/GauPCRender.
title Sparse Point Cloud Patches Rendering via Splitting 2D Gaussians
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.09413