OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctrees

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kim, Hakyeong, Meuleman, Andreas, Jang, Hyeonjoong, Tompkin, James, Kim, Min H.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929298667995136
author Kim, Hakyeong
Meuleman, Andreas
Jang, Hyeonjoong
Tompkin, James
Kim, Min H.
author_facet Kim, Hakyeong
Meuleman, Andreas
Jang, Hyeonjoong
Tompkin, James
Kim, Min H.
contents We present a method to reconstruct indoor and outdoor static scene geometry and appearance from an omnidirectional video moving in a small circular sweep. This setting is challenging because of the small baseline and large depth ranges, making it difficult to find ray crossings. To better constrain the optimization, we estimate geometry as a signed distance field within a spherical binoctree data structure and use a complementary efficient tree traversal strategy based on a breadth-first search for sampling. Unlike regular grids or trees, the shape of this structure well-matches the camera setting, creating a better memory-quality trade-off. From an initial depth estimate, the binoctree is adaptively subdivided throughout the optimization; previous methods use a fixed depth that leaves the scene undersampled. In comparison with three neural optimization methods and two non-neural methods, ours shows decreased geometry error on average, especially in a detailed scene, while significantly reducing the required number of voxels to represent such details.
format Preprint
id arxiv_https___arxiv_org_abs_2404_00678
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctrees
Kim, Hakyeong
Meuleman, Andreas
Jang, Hyeonjoong
Tompkin, James
Kim, Min H.
Computer Vision and Pattern Recognition
Graphics
We present a method to reconstruct indoor and outdoor static scene geometry and appearance from an omnidirectional video moving in a small circular sweep. This setting is challenging because of the small baseline and large depth ranges, making it difficult to find ray crossings. To better constrain the optimization, we estimate geometry as a signed distance field within a spherical binoctree data structure and use a complementary efficient tree traversal strategy based on a breadth-first search for sampling. Unlike regular grids or trees, the shape of this structure well-matches the camera setting, creating a better memory-quality trade-off. From an initial depth estimate, the binoctree is adaptively subdivided throughout the optimization; previous methods use a fixed depth that leaves the scene undersampled. In comparison with three neural optimization methods and two non-neural methods, ours shows decreased geometry error on average, especially in a detailed scene, while significantly reducing the required number of voxels to represent such details.
title OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctrees
topic Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2404.00678