Condition numbers in multiview geometry, instability in relative pose estimation, and RANSAC

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fan, Hongyi, Kileel, Joe, Kimia, Benjamin
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909606521864192
author Fan, Hongyi
Kileel, Joe
Kimia, Benjamin
author_facet Fan, Hongyi
Kileel, Joe
Kimia, Benjamin
contents In this paper, we introduce a general framework for analyzing the numerical conditioning of minimal problems in multiple view geometry, using tools from computational algebra and Riemannian geometry. Special motivation comes from the fact that relative pose estimation, based on standard 5-point or 7-point Random Sample Consensus (RANSAC) algorithms, can fail even when no outliers are present and there is enough data to support a hypothesis. We argue that these cases arise due to the intrinsic instability of the 5- and 7-point minimal problems. We apply our framework to characterize the instabilities, both in terms of the world scenes that lead to infinite condition number, and directly in terms of ill-conditioned image data. The approach produces computational tests for assessing the condition number before solving the minimal problem. Lastly, synthetic and real data experiments suggest that RANSAC serves not only to remove outliers, but in practice it also selects for well-conditioned image data, which is consistent with our theory.
format Preprint
id arxiv_https___arxiv_org_abs_2310_02719
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Condition numbers in multiview geometry, instability in relative pose estimation, and RANSAC
Fan, Hongyi
Kileel, Joe
Kimia, Benjamin
Computer Vision and Pattern Recognition
Numerical Analysis
In this paper, we introduce a general framework for analyzing the numerical conditioning of minimal problems in multiple view geometry, using tools from computational algebra and Riemannian geometry. Special motivation comes from the fact that relative pose estimation, based on standard 5-point or 7-point Random Sample Consensus (RANSAC) algorithms, can fail even when no outliers are present and there is enough data to support a hypothesis. We argue that these cases arise due to the intrinsic instability of the 5- and 7-point minimal problems. We apply our framework to characterize the instabilities, both in terms of the world scenes that lead to infinite condition number, and directly in terms of ill-conditioned image data. The approach produces computational tests for assessing the condition number before solving the minimal problem. Lastly, synthetic and real data experiments suggest that RANSAC serves not only to remove outliers, but in practice it also selects for well-conditioned image data, which is consistent with our theory.
title Condition numbers in multiview geometry, instability in relative pose estimation, and RANSAC
topic Computer Vision and Pattern Recognition
Numerical Analysis
url https://arxiv.org/abs/2310.02719