Indoor 3D Reconstruction with an Unknown Camera-Projector Pair

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Qi, Zhaoshuai, Hao, Yifeng, Hu, Rui, Chang, Wenyou, Yang, Jiaqi, Zhang, Yanning
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910509994868736
author Qi, Zhaoshuai
Hao, Yifeng
Hu, Rui
Chang, Wenyou
Yang, Jiaqi
Zhang, Yanning
author_facet Qi, Zhaoshuai
Hao, Yifeng
Hu, Rui
Chang, Wenyou
Yang, Jiaqi
Zhang, Yanning
contents Structured light-based method with a camera-projector pair (CPP) plays a vital role in indoor 3D reconstruction, especially for scenes with weak textures. Previous methods usually assume known intrinsics, which are pre-calibrated from known objects, or self-calibrated from multi-view observations. It is still challenging to reliably recover CPP intrinsics from only two views without any known objects. In this paper, we provide a simple yet reliable solution. We demonstrate that, for the first time, sufficient constraints on CPP intrinsics can be derived from an unknown cuboid corner (C2), e.g. a room's corner, which is a common structure in indoor scenes. In addition, with only known camera principal point, the complex multi-variable estimation of all CPP intrinsics can be simplified to a simple univariable optimization problem, leading to reliable calibration and thus direct 3D reconstruction with unknown CPP. Extensive results have demonstrated the superiority of the proposed method over both traditional and learning-based counterparts. Furthermore, the proposed method also demonstrates impressive potential to solve similar tasks without active lighting, such as sparse-view structure from motion.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01945
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Indoor 3D Reconstruction with an Unknown Camera-Projector Pair
Qi, Zhaoshuai
Hao, Yifeng
Hu, Rui
Chang, Wenyou
Yang, Jiaqi
Zhang, Yanning
Computer Vision and Pattern Recognition
Structured light-based method with a camera-projector pair (CPP) plays a vital role in indoor 3D reconstruction, especially for scenes with weak textures. Previous methods usually assume known intrinsics, which are pre-calibrated from known objects, or self-calibrated from multi-view observations. It is still challenging to reliably recover CPP intrinsics from only two views without any known objects. In this paper, we provide a simple yet reliable solution. We demonstrate that, for the first time, sufficient constraints on CPP intrinsics can be derived from an unknown cuboid corner (C2), e.g. a room's corner, which is a common structure in indoor scenes. In addition, with only known camera principal point, the complex multi-variable estimation of all CPP intrinsics can be simplified to a simple univariable optimization problem, leading to reliable calibration and thus direct 3D reconstruction with unknown CPP. Extensive results have demonstrated the superiority of the proposed method over both traditional and learning-based counterparts. Furthermore, the proposed method also demonstrates impressive potential to solve similar tasks without active lighting, such as sparse-view structure from motion.
title Indoor 3D Reconstruction with an Unknown Camera-Projector Pair
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.01945