3D Scene Geometry Estimation from 360$^\circ$ Imagery: A Survey

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: da Silveira, Thiago Lopes Trugillo, Pinto, Paulo Gamarra Lessa, Llerena, Jeffri Erwin Murrugarra, Jung, Claudio Rosito
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929213097902080
author da Silveira, Thiago Lopes Trugillo
Pinto, Paulo Gamarra Lessa
Llerena, Jeffri Erwin Murrugarra
Jung, Claudio Rosito
author_facet da Silveira, Thiago Lopes Trugillo
Pinto, Paulo Gamarra Lessa
Llerena, Jeffri Erwin Murrugarra
Jung, Claudio Rosito
contents This paper provides a comprehensive survey on pioneer and state-of-the-art 3D scene geometry estimation methodologies based on single, two, or multiple images captured under the omnidirectional optics. We first revisit the basic concepts of the spherical camera model, and review the most common acquisition technologies and representation formats suitable for omnidirectional (also called 360$^\circ$, spherical or panoramic) images and videos. We then survey monocular layout and depth inference approaches, highlighting the recent advances in learning-based solutions suited for spherical data. The classical stereo matching is then revised on the spherical domain, where methodologies for detecting and describing sparse and dense features become crucial. The stereo matching concepts are then extrapolated for multiple view camera setups, categorizing them among light fields, multi-view stereo, and structure from motion (or visual simultaneous localization and mapping). We also compile and discuss commonly adopted datasets and figures of merit indicated for each purpose and list recent results for completeness. We conclude this paper by pointing out current and future trends.
format Preprint
id arxiv_https___arxiv_org_abs_2401_09252
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle 3D Scene Geometry Estimation from 360$^\circ$ Imagery: A Survey
da Silveira, Thiago Lopes Trugillo
Pinto, Paulo Gamarra Lessa
Llerena, Jeffri Erwin Murrugarra
Jung, Claudio Rosito
Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
Machine Learning
This paper provides a comprehensive survey on pioneer and state-of-the-art 3D scene geometry estimation methodologies based on single, two, or multiple images captured under the omnidirectional optics. We first revisit the basic concepts of the spherical camera model, and review the most common acquisition technologies and representation formats suitable for omnidirectional (also called 360$^\circ$, spherical or panoramic) images and videos. We then survey monocular layout and depth inference approaches, highlighting the recent advances in learning-based solutions suited for spherical data. The classical stereo matching is then revised on the spherical domain, where methodologies for detecting and describing sparse and dense features become crucial. The stereo matching concepts are then extrapolated for multiple view camera setups, categorizing them among light fields, multi-view stereo, and structure from motion (or visual simultaneous localization and mapping). We also compile and discuss commonly adopted datasets and figures of merit indicated for each purpose and list recent results for completeness. We conclude this paper by pointing out current and future trends.
title 3D Scene Geometry Estimation from 360$^\circ$ Imagery: A Survey
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
Machine Learning
url https://arxiv.org/abs/2401.09252