Stable Surface Regularization for Fast Few-Shot NeRF

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Joung, Byeongin, Lee, Byeong-Uk, Choe, Jaesung, Shin, Ukcheol, Kang, Minjun, Lee, Taeyeop, Kweon, In So, Yoon, Kuk-Jin
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929295312551936
author Joung, Byeongin
Lee, Byeong-Uk
Choe, Jaesung
Shin, Ukcheol
Kang, Minjun
Lee, Taeyeop
Kweon, In So
Yoon, Kuk-Jin
author_facet Joung, Byeongin
Lee, Byeong-Uk
Choe, Jaesung
Shin, Ukcheol
Kang, Minjun
Lee, Taeyeop
Kweon, In So
Yoon, Kuk-Jin
contents This paper proposes an algorithm for synthesizing novel views under few-shot setup. The main concept is to develop a stable surface regularization technique called Annealing Signed Distance Function (ASDF), which anneals the surface in a coarse-to-fine manner to accelerate convergence speed. We observe that the Eikonal loss - which is a widely known geometric regularization - requires dense training signal to shape different level-sets of SDF, leading to low-fidelity results under few-shot training. In contrast, the proposed surface regularization successfully reconstructs scenes and produce high-fidelity geometry with stable training. Our method is further accelerated by utilizing grid representation and monocular geometric priors. Finally, the proposed approach is up to 45 times faster than existing few-shot novel view synthesis methods, and it produces comparable results in the ScanNet dataset and NeRF-Real dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2403_19985
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Stable Surface Regularization for Fast Few-Shot NeRF
Joung, Byeongin
Lee, Byeong-Uk
Choe, Jaesung
Shin, Ukcheol
Kang, Minjun
Lee, Taeyeop
Kweon, In So
Yoon, Kuk-Jin
Computer Vision and Pattern Recognition
This paper proposes an algorithm for synthesizing novel views under few-shot setup. The main concept is to develop a stable surface regularization technique called Annealing Signed Distance Function (ASDF), which anneals the surface in a coarse-to-fine manner to accelerate convergence speed. We observe that the Eikonal loss - which is a widely known geometric regularization - requires dense training signal to shape different level-sets of SDF, leading to low-fidelity results under few-shot training. In contrast, the proposed surface regularization successfully reconstructs scenes and produce high-fidelity geometry with stable training. Our method is further accelerated by utilizing grid representation and monocular geometric priors. Finally, the proposed approach is up to 45 times faster than existing few-shot novel view synthesis methods, and it produces comparable results in the ScanNet dataset and NeRF-Real dataset.
title Stable Surface Regularization for Fast Few-Shot NeRF
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.19985