Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Dong, Siyan, Wang, Shuzhe, Liu, Shaohui, Cai, Lulu, Fan, Qingnan, Kannala, Juho, Yang, Yanchao
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908276445151232
author Dong, Siyan
Wang, Shuzhe
Liu, Shaohui
Cai, Lulu
Fan, Qingnan
Kannala, Juho
Yang, Yanchao
author_facet Dong, Siyan
Wang, Shuzhe
Liu, Shaohui
Cai, Lulu
Fan, Qingnan
Kannala, Juho
Yang, Yanchao
contents Visual localization aims to determine the camera pose of a query image relative to a database of posed images. In recent years, deep neural networks that directly regress camera poses have gained popularity due to their fast inference capabilities. However, existing methods struggle to either generalize well to new scenes or provide accurate camera pose estimates. To address these issues, we present Reloc3r, a simple yet effective visual localization framework. It consists of an elegantly designed relative pose regression network, and a minimalist motion averaging module for absolute pose estimation. Trained on approximately eight million posed image pairs, Reloc3r achieves surprisingly good performance and generalization ability. We conduct extensive experiments on six public datasets, consistently demonstrating the effectiveness and efficiency of the proposed method. It provides high-quality camera pose estimates in real time and generalizes to novel scenes. Code: https://github.com/ffrivera0/reloc3r.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08376
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization
Dong, Siyan
Wang, Shuzhe
Liu, Shaohui
Cai, Lulu
Fan, Qingnan
Kannala, Juho
Yang, Yanchao
Computer Vision and Pattern Recognition
Visual localization aims to determine the camera pose of a query image relative to a database of posed images. In recent years, deep neural networks that directly regress camera poses have gained popularity due to their fast inference capabilities. However, existing methods struggle to either generalize well to new scenes or provide accurate camera pose estimates. To address these issues, we present Reloc3r, a simple yet effective visual localization framework. It consists of an elegantly designed relative pose regression network, and a minimalist motion averaging module for absolute pose estimation. Trained on approximately eight million posed image pairs, Reloc3r achieves surprisingly good performance and generalization ability. We conduct extensive experiments on six public datasets, consistently demonstrating the effectiveness and efficiency of the proposed method. It provides high-quality camera pose estimates in real time and generalizes to novel scenes. Code: https://github.com/ffrivera0/reloc3r.
title Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.08376