ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Niu, Xiaoji, Wang, Yuqing, Wang, Yan, Tang, Hailiang, Zhang, Tisheng
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914445030064128
author Niu, Xiaoji
Wang, Yuqing
Wang, Yan
Tang, Hailiang
Zhang, Tisheng
author_facet Niu, Xiaoji
Wang, Yuqing
Wang, Yan
Tang, Hailiang
Zhang, Tisheng
contents Most existing image keypoint detection and description methods rely on datasets with accurate pose and depth annotations, limiting scalability and generalization, and often degrading navigation and localization performance. We propose ViBA, a sustainable learning framework that integrates geometric optimization with feature learning for continuous online training on unconstrained video streams. Embedded in a standard visual odometry pipeline, it consists of an implicitly differentiable geometric residual framework: (i) an initial tracking network for inter-frame correspondences, (ii) depth-based outlier filtering, and (iii) differentiable global bundle adjustment that jointly refines camera poses and feature positions by minimizing reprojection errors. By combining geometric consistency from BA with long-term temporal consistency across frames, ViBA enforces stable and accurate feature representations. We evaluate ViBA on EuRoC and UMA datasets. Compared with state-of-the-art methods such as SuperPoint+SuperGlue, ALIKED, and LightGlue, ViBA reduces mean absolute translation error (ATE) by 12-18% and absolute rotation error (ARE) by 5-10% across sequences, while maintaining real-time inference speeds (FPS 36-91). When evaluated on unseen sequences, it retains over 90% localization accuracy, demonstrating robust generalization. These results show that ViBA supports continuous online learning with geometric and temporal consistency, consistently improving navigation and localization in real-world scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03377
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching
Niu, Xiaoji
Wang, Yuqing
Wang, Yan
Tang, Hailiang
Zhang, Tisheng
Computer Vision and Pattern Recognition
Most existing image keypoint detection and description methods rely on datasets with accurate pose and depth annotations, limiting scalability and generalization, and often degrading navigation and localization performance. We propose ViBA, a sustainable learning framework that integrates geometric optimization with feature learning for continuous online training on unconstrained video streams. Embedded in a standard visual odometry pipeline, it consists of an implicitly differentiable geometric residual framework: (i) an initial tracking network for inter-frame correspondences, (ii) depth-based outlier filtering, and (iii) differentiable global bundle adjustment that jointly refines camera poses and feature positions by minimizing reprojection errors. By combining geometric consistency from BA with long-term temporal consistency across frames, ViBA enforces stable and accurate feature representations. We evaluate ViBA on EuRoC and UMA datasets. Compared with state-of-the-art methods such as SuperPoint+SuperGlue, ALIKED, and LightGlue, ViBA reduces mean absolute translation error (ATE) by 12-18% and absolute rotation error (ARE) by 5-10% across sequences, while maintaining real-time inference speeds (FPS 36-91). When evaluated on unseen sequences, it retains over 90% localization accuracy, demonstrating robust generalization. These results show that ViBA supports continuous online learning with geometric and temporal consistency, consistently improving navigation and localization in real-world scenarios.
title ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.03377