RePoseD: Efficient Relative Pose Estimation With Known Depth Information

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ding, Yaqing, Kocur, Viktor, Vávra, Václav, Haladová, Zuzana Berger, Yang, Jian, Sattler, Torsten, Kukelova, Zuzana
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913774229782528
author Ding, Yaqing
Kocur, Viktor
Vávra, Václav
Haladová, Zuzana Berger
Yang, Jian
Sattler, Torsten
Kukelova, Zuzana
author_facet Ding, Yaqing
Kocur, Viktor
Vávra, Václav
Haladová, Zuzana Berger
Yang, Jian
Sattler, Torsten
Kukelova, Zuzana
contents Recent advances in monocular depth estimation methods (MDE) and their improved accuracy open new possibilities for their applications. In this paper, we investigate how monocular depth estimates can be used for relative pose estimation. In particular, we are interested in answering the question whether using MDEs improves results over traditional point-based methods. We propose a novel framework for estimating the relative pose of two cameras from point correspondences with associated monocular depths. Since depth predictions are typically defined up to an unknown scale or even both unknown scale and shift parameters, our solvers jointly estimate the scale or both the scale and shift parameters along with the relative pose. We derive efficient solvers considering different types of depths for three camera configurations: (1) two calibrated cameras, (2) two cameras with an unknown shared focal length, and (3) two cameras with unknown different focal lengths. Our new solvers outperform state-of-the-art depth-aware solvers in terms of speed and accuracy. In extensive real experiments on multiple datasets and with various MDEs, we discuss which depth-aware solvers are preferable in which situation. The code will be made publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2501_07742
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RePoseD: Efficient Relative Pose Estimation With Known Depth Information
Ding, Yaqing
Kocur, Viktor
Vávra, Václav
Haladová, Zuzana Berger
Yang, Jian
Sattler, Torsten
Kukelova, Zuzana
Computer Vision and Pattern Recognition
Recent advances in monocular depth estimation methods (MDE) and their improved accuracy open new possibilities for their applications. In this paper, we investigate how monocular depth estimates can be used for relative pose estimation. In particular, we are interested in answering the question whether using MDEs improves results over traditional point-based methods. We propose a novel framework for estimating the relative pose of two cameras from point correspondences with associated monocular depths. Since depth predictions are typically defined up to an unknown scale or even both unknown scale and shift parameters, our solvers jointly estimate the scale or both the scale and shift parameters along with the relative pose. We derive efficient solvers considering different types of depths for three camera configurations: (1) two calibrated cameras, (2) two cameras with an unknown shared focal length, and (3) two cameras with unknown different focal lengths. Our new solvers outperform state-of-the-art depth-aware solvers in terms of speed and accuracy. In extensive real experiments on multiple datasets and with various MDEs, we discuss which depth-aware solvers are preferable in which situation. The code will be made publicly available.
title RePoseD: Efficient Relative Pose Estimation With Known Depth Information
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.07742