Deep Bayesian Future Fusion for Self-Supervised, High-Resolution, Off-Road Mapping

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Aich, Shubhra, Wang, Wenshan, Maheshwari, Parv, Sivaprakasam, Matthew, Triest, Samuel, Ho, Cherie, Gregory, Jason M., Rogers III, John G., Scherer, Sebastian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909327781003264
author Aich, Shubhra
Wang, Wenshan
Maheshwari, Parv
Sivaprakasam, Matthew
Triest, Samuel
Ho, Cherie
Gregory, Jason M.
Rogers III, John G.
Scherer, Sebastian
author_facet Aich, Shubhra
Wang, Wenshan
Maheshwari, Parv
Sivaprakasam, Matthew
Triest, Samuel
Ho, Cherie
Gregory, Jason M.
Rogers III, John G.
Scherer, Sebastian
contents High-speed off-road navigation requires long-range, high-resolution maps to enable robots to safely navigate over different surfaces while avoiding dangerous obstacles. However, due to limited computational power and sensing noise, most approaches to off-road mapping focus on producing coarse (20-40cm) maps of the environment. In this paper, we propose Future Fusion, a framework capable of generating dense, high-resolution maps from sparse sensing data (30m forward at 2cm). This is accomplished by - (1) the efficient realization of the well-known Bayes filtering within the standard deep learning models that explicitly accounts for the sparsity pattern in stereo and LiDAR depth data, and (2) leveraging perceptual losses common in generative image completion. The proposed methodology outperforms the conventional baselines. Moreover, the learned features and the completed dense maps lead to improvements in the downstream navigation task.
format Preprint
id arxiv_https___arxiv_org_abs_2403_11876
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Bayesian Future Fusion for Self-Supervised, High-Resolution, Off-Road Mapping
Aich, Shubhra
Wang, Wenshan
Maheshwari, Parv
Sivaprakasam, Matthew
Triest, Samuel
Ho, Cherie
Gregory, Jason M.
Rogers III, John G.
Scherer, Sebastian
Robotics
Computer Vision and Pattern Recognition
Machine Learning
High-speed off-road navigation requires long-range, high-resolution maps to enable robots to safely navigate over different surfaces while avoiding dangerous obstacles. However, due to limited computational power and sensing noise, most approaches to off-road mapping focus on producing coarse (20-40cm) maps of the environment. In this paper, we propose Future Fusion, a framework capable of generating dense, high-resolution maps from sparse sensing data (30m forward at 2cm). This is accomplished by - (1) the efficient realization of the well-known Bayes filtering within the standard deep learning models that explicitly accounts for the sparsity pattern in stereo and LiDAR depth data, and (2) leveraging perceptual losses common in generative image completion. The proposed methodology outperforms the conventional baselines. Moreover, the learned features and the completed dense maps lead to improvements in the downstream navigation task.
title Deep Bayesian Future Fusion for Self-Supervised, High-Resolution, Off-Road Mapping
topic Robotics
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2403.11876