Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstruction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Huang, Binxiao, Li, Zhihao, Liu, Shiyong, Tang, Xiao, Tang, Jiajun, Lin, Jiaqi, Cheng, Yuxin, Chen, Zhenyu, Wu, Xiaofei, Wong, Ngai
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916784339156992
author Huang, Binxiao
Li, Zhihao
Liu, Shiyong
Tang, Xiao
Tang, Jiajun
Lin, Jiaqi
Cheng, Yuxin
Chen, Zhenyu
Wu, Xiaofei
Wong, Ngai
author_facet Huang, Binxiao
Li, Zhihao
Liu, Shiyong
Tang, Xiao
Tang, Jiajun
Lin, Jiaqi
Cheng, Yuxin
Chen, Zhenyu
Wu, Xiaofei
Wong, Ngai
contents 3D Gaussian splatting (3DGS) has demonstrated exceptional performance in image-based 3D reconstruction and real-time rendering. However, regions with complex textures require numerous Gaussians to capture significant color variations accurately, leading to inefficiencies in rendering speed. To address this challenge, we introduce a hybrid representation for indoor scenes that combines 3DGS with textured meshes. Our approach uses textured meshes to handle texture-rich flat areas, while retaining Gaussians to model intricate geometries. The proposed method begins by pruning and refining the extracted mesh to eliminate geometrically complex regions. We then employ a joint optimization for 3DGS and mesh, incorporating a warm-up strategy and transmittance-aware supervision to balance their contributions seamlessly.Extensive experiments demonstrate that the hybrid representation maintains comparable rendering quality and achieves superior frames per second FPS with fewer Gaussian primitives.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06988
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstruction
Huang, Binxiao
Li, Zhihao
Liu, Shiyong
Tang, Xiao
Tang, Jiajun
Lin, Jiaqi
Cheng, Yuxin
Chen, Zhenyu
Wu, Xiaofei
Wong, Ngai
Computer Vision and Pattern Recognition
3D Gaussian splatting (3DGS) has demonstrated exceptional performance in image-based 3D reconstruction and real-time rendering. However, regions with complex textures require numerous Gaussians to capture significant color variations accurately, leading to inefficiencies in rendering speed. To address this challenge, we introduce a hybrid representation for indoor scenes that combines 3DGS with textured meshes. Our approach uses textured meshes to handle texture-rich flat areas, while retaining Gaussians to model intricate geometries. The proposed method begins by pruning and refining the extracted mesh to eliminate geometrically complex regions. We then employ a joint optimization for 3DGS and mesh, incorporating a warm-up strategy and transmittance-aware supervision to balance their contributions seamlessly.Extensive experiments demonstrate that the hybrid representation maintains comparable rendering quality and achieves superior frames per second FPS with fewer Gaussian primitives.
title Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstruction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.06988