On Designing Consistent Covariance Recovery from a Deep Learning Visual Odometry Engine

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nir, Jagatpreet Singh, Giaya, Dennis, Singh, Hanumant
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909143029252096
author Nir, Jagatpreet Singh
Giaya, Dennis
Singh, Hanumant
author_facet Nir, Jagatpreet Singh
Giaya, Dennis
Singh, Hanumant
contents Deep learning techniques have significantly advanced in providing accurate visual odometry solutions by leveraging large datasets. However, generating uncertainty estimates for these methods remains a challenge. Traditional sensor fusion approaches in a Bayesian framework are well-established, but deep learning techniques with millions of parameters lack efficient methods for uncertainty estimation. This paper addresses the issue of uncertainty estimation for pre-trained deep-learning models in monocular visual odometry. We propose formulating a factor graph on an implicit layer of the deep learning network to recover relative covariance estimates, which allows us to determine the covariance of the Visual Odometry (VO) solution. We showcase the consistency of the deep learning engine's covariance approximation with an empirical analysis of the covariance model on the EUROC datasets to demonstrate the correctness of our formulation.
format Preprint
id arxiv_https___arxiv_org_abs_2403_13170
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On Designing Consistent Covariance Recovery from a Deep Learning Visual Odometry Engine
Nir, Jagatpreet Singh
Giaya, Dennis
Singh, Hanumant
Robotics
Deep learning techniques have significantly advanced in providing accurate visual odometry solutions by leveraging large datasets. However, generating uncertainty estimates for these methods remains a challenge. Traditional sensor fusion approaches in a Bayesian framework are well-established, but deep learning techniques with millions of parameters lack efficient methods for uncertainty estimation. This paper addresses the issue of uncertainty estimation for pre-trained deep-learning models in monocular visual odometry. We propose formulating a factor graph on an implicit layer of the deep learning network to recover relative covariance estimates, which allows us to determine the covariance of the Visual Odometry (VO) solution. We showcase the consistency of the deep learning engine's covariance approximation with an empirical analysis of the covariance model on the EUROC datasets to demonstrate the correctness of our formulation.
title On Designing Consistent Covariance Recovery from a Deep Learning Visual Odometry Engine
topic Robotics
url https://arxiv.org/abs/2403.13170