Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Junsheng, Ma, Baorui, Liu, Yu-Shen, Han, Zhizhong
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917727921242112
author Zhou, Junsheng
Ma, Baorui
Liu, Yu-Shen
Han, Zhizhong
author_facet Zhou, Junsheng
Ma, Baorui
Liu, Yu-Shen
Han, Zhizhong
contents Learning signed distance functions (SDFs) from point clouds is an important task in 3D computer vision. However, without ground truth signed distances, point normals or clean point clouds, current methods still struggle from learning SDFs from noisy point clouds. To overcome this challenge, we propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision. Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy observations. We achieve this by a novel loss which enables statistical reasoning on point clouds and maintains geometric consistency although point clouds are irregular, unordered and have no point correspondence among noisy observations. To accelerate training, we use multi-resolution hash encodings implemented in CUDA in our framework, which reduces our training time by a factor of ten, achieving convergence within one minute. We further introduce a novel schema to improve multi-view reconstruction by estimating SDFs as a prior. Our evaluations under widely-used benchmarks demonstrate our superiority over the state-of-the-art methods in surface reconstruction from point clouds or multi-view images, point cloud denoising and upsampling.
format Preprint
id arxiv_https___arxiv_org_abs_2407_14225
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping
Zhou, Junsheng
Ma, Baorui
Liu, Yu-Shen
Han, Zhizhong
Computer Vision and Pattern Recognition
Learning signed distance functions (SDFs) from point clouds is an important task in 3D computer vision. However, without ground truth signed distances, point normals or clean point clouds, current methods still struggle from learning SDFs from noisy point clouds. To overcome this challenge, we propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision. Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy observations. We achieve this by a novel loss which enables statistical reasoning on point clouds and maintains geometric consistency although point clouds are irregular, unordered and have no point correspondence among noisy observations. To accelerate training, we use multi-resolution hash encodings implemented in CUDA in our framework, which reduces our training time by a factor of ten, achieving convergence within one minute. We further introduce a novel schema to improve multi-view reconstruction by estimating SDFs as a prior. Our evaluations under widely-used benchmarks demonstrate our superiority over the state-of-the-art methods in surface reconstruction from point clouds or multi-view images, point cloud denoising and upsampling.
title Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.14225