PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Taiana, Matteo, Toso, Matteo, James, Stuart, Del Bue, Alessio
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913267047202816
author Taiana, Matteo
Toso, Matteo
James, Stuart
Del Bue, Alessio
author_facet Taiana, Matteo
Toso, Matteo
James, Stuart
Del Bue, Alessio
contents Robustly estimating camera poses from a set of images is a fundamental task which remains challenging for differentiable methods, especially in the case of small and sparse camera pose graphs. To overcome this challenge, we propose Pose-refined Rotation Averaging Graph Optimization (PRAGO). From a set of objectness detections on unordered images, our method reconstructs the rotational pose, and in turn, the absolute pose, in a differentiable manner benefiting from the optimization of a sequence of geometrical tasks. We show how our objectness pose-refinement module in PRAGO is able to refine the inherent ambiguities in pairwise relative pose estimation without removing edges and avoiding making early decisions on the viability of graph edges. PRAGO then refines the absolute rotations through iterative graph construction, reweighting the graph edges to compute the final rotational pose, which can be converted into absolute poses using translation averaging. We show that PRAGO is able to outperform non-differentiable solvers on small and sparse scenes extracted from 7-Scenes achieving a relative improvement of 21% for rotations while achieving similar translation estimates.
format Preprint
id arxiv_https___arxiv_org_abs_2403_08586
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections
Taiana, Matteo
Toso, Matteo
James, Stuart
Del Bue, Alessio
Computer Vision and Pattern Recognition
Robustly estimating camera poses from a set of images is a fundamental task which remains challenging for differentiable methods, especially in the case of small and sparse camera pose graphs. To overcome this challenge, we propose Pose-refined Rotation Averaging Graph Optimization (PRAGO). From a set of objectness detections on unordered images, our method reconstructs the rotational pose, and in turn, the absolute pose, in a differentiable manner benefiting from the optimization of a sequence of geometrical tasks. We show how our objectness pose-refinement module in PRAGO is able to refine the inherent ambiguities in pairwise relative pose estimation without removing edges and avoiding making early decisions on the viability of graph edges. PRAGO then refines the absolute rotations through iterative graph construction, reweighting the graph edges to compute the final rotational pose, which can be converted into absolute poses using translation averaging. We show that PRAGO is able to outperform non-differentiable solvers on small and sparse scenes extracted from 7-Scenes achieving a relative improvement of 21% for rotations while achieving similar translation estimates.
title PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.08586