MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912102691635200 |
|---|---|
| author | Noda, Takeshi Chen, Chao Zhang, Weiqi Liu, Xinhai Liu, Yu-Shen Han, Zhizhong |
| author_facet | Noda, Takeshi Chen, Chao Zhang, Weiqi Liu, Xinhai Liu, Yu-Shen Han, Zhizhong |
| contents | Reconstructing a continuous surface from a raw 3D point cloud is a challenging task. Recent methods usually train neural networks to overfit on single point clouds to infer signed distance functions (SDFs). However, neural networks tend to smooth local details due to the lack of ground truth signed distances or normals, which limits the performance of overfitting-based methods in reconstruction tasks. To resolve this issue, we propose a novel method, named MultiPull, to learn multi-scale implicit fields from raw point clouds by optimizing accurate SDFs from coarse to fine. We achieve this by mapping 3D query points into a set of frequency features, which makes it possible to leverage multi-level features during optimization. Meanwhile, we introduce optimization constraints from the perspective of spatial distance and normal consistency, which play a key role in point cloud reconstruction based on multi-scale optimization strategies. Our experiments on widely used object and scene benchmarks demonstrate that our method outperforms the state-of-the-art methods in surface reconstruction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_01208 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step Noda, Takeshi Chen, Chao Zhang, Weiqi Liu, Xinhai Liu, Yu-Shen Han, Zhizhong Computer Vision and Pattern Recognition Reconstructing a continuous surface from a raw 3D point cloud is a challenging task. Recent methods usually train neural networks to overfit on single point clouds to infer signed distance functions (SDFs). However, neural networks tend to smooth local details due to the lack of ground truth signed distances or normals, which limits the performance of overfitting-based methods in reconstruction tasks. To resolve this issue, we propose a novel method, named MultiPull, to learn multi-scale implicit fields from raw point clouds by optimizing accurate SDFs from coarse to fine. We achieve this by mapping 3D query points into a set of frequency features, which makes it possible to leverage multi-level features during optimization. Meanwhile, we introduce optimization constraints from the perspective of spatial distance and normal consistency, which play a key role in point cloud reconstruction based on multi-scale optimization strategies. Our experiments on widely used object and scene benchmarks demonstrate that our method outperforms the state-of-the-art methods in surface reconstruction. |
| title | MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.01208 |