GSurf: 3D Reconstruction via Signed Distance Fields with Direct Gaussian Supervision

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Baixin, Hu, Jiangbei, Li, Jiaze, He, Ying
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917875294404608
author Xu, Baixin
Hu, Jiangbei
Li, Jiaze
He, Ying
author_facet Xu, Baixin
Hu, Jiangbei
Li, Jiaze
He, Ying
contents Surface reconstruction from multi-view images is a core challenge in 3D vision. Recent studies have explored signed distance fields (SDF) within Neural Radiance Fields (NeRF) to achieve high-fidelity surface reconstructions. However, these approaches often suffer from slow training and rendering speeds compared to 3D Gaussian splatting (3DGS). Current state-of-the-art techniques attempt to fuse depth information to extract geometry from 3DGS, but frequently result in incomplete reconstructions and fragmented surfaces. In this paper, we introduce GSurf, a novel end-to-end method for learning a signed distance field directly from Gaussian primitives. The continuous and smooth nature of SDF addresses common issues in the 3DGS family, such as holes resulting from noisy or missing depth data. By using Gaussian splatting for rendering, GSurf avoids the redundant volume rendering typically required in other GS and SDF integrations. Consequently, GSurf achieves faster training and rendering speeds while delivering 3D reconstruction quality comparable to neural implicit surface methods, such as VolSDF and NeuS. Experimental results across various benchmark datasets demonstrate the effectiveness of our method in producing high-fidelity 3D reconstructions.
format Preprint
id arxiv_https___arxiv_org_abs_2411_15723
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GSurf: 3D Reconstruction via Signed Distance Fields with Direct Gaussian Supervision
Xu, Baixin
Hu, Jiangbei
Li, Jiaze
He, Ying
Computer Vision and Pattern Recognition
Surface reconstruction from multi-view images is a core challenge in 3D vision. Recent studies have explored signed distance fields (SDF) within Neural Radiance Fields (NeRF) to achieve high-fidelity surface reconstructions. However, these approaches often suffer from slow training and rendering speeds compared to 3D Gaussian splatting (3DGS). Current state-of-the-art techniques attempt to fuse depth information to extract geometry from 3DGS, but frequently result in incomplete reconstructions and fragmented surfaces. In this paper, we introduce GSurf, a novel end-to-end method for learning a signed distance field directly from Gaussian primitives. The continuous and smooth nature of SDF addresses common issues in the 3DGS family, such as holes resulting from noisy or missing depth data. By using Gaussian splatting for rendering, GSurf avoids the redundant volume rendering typically required in other GS and SDF integrations. Consequently, GSurf achieves faster training and rendering speeds while delivering 3D reconstruction quality comparable to neural implicit surface methods, such as VolSDF and NeuS. Experimental results across various benchmark datasets demonstrate the effectiveness of our method in producing high-fidelity 3D reconstructions.
title GSurf: 3D Reconstruction via Signed Distance Fields with Direct Gaussian Supervision
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.15723