An End-to-End Learning-Based Multi-Sensor Fusion for Autonomous Vehicle Localization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Changhong, Lin, Jiarong, Sui, Zhiqiang, Qu, XiaoZhi, Wang, Rui, Sheng, Kehua, Zhang, Bo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916645795004416
author Lin, Changhong
Lin, Jiarong
Sui, Zhiqiang
Qu, XiaoZhi
Wang, Rui
Sheng, Kehua
Zhang, Bo
author_facet Lin, Changhong
Lin, Jiarong
Sui, Zhiqiang
Qu, XiaoZhi
Wang, Rui
Sheng, Kehua
Zhang, Bo
contents Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the precision of the uncertainty modeling. Traditional methods of uncertainty modeling typically assume a Gaussian distribution and involve manual heuristic parameter tuning. However, these methods struggle to scale effectively and address long-tail scenarios. To address these challenges, we propose a learning-based method that encodes sensor information using higher-order neural network features, thereby eliminating the need for uncertainty estimation. This method significantly eliminates the need for parameter fine-tuning by developing an end-to-end neural network that is specifically designed for multi-sensor fusion. In our experiments, we demonstrate the effectiveness of our approach in real-world autonomous driving scenarios. Results show that the proposed method outperforms existing multi-sensor fusion methods in terms of both accuracy and robustness. A video of the results can be viewed at https://youtu.be/q4iuobMbjME.
format Preprint
id arxiv_https___arxiv_org_abs_2503_05088
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An End-to-End Learning-Based Multi-Sensor Fusion for Autonomous Vehicle Localization
Lin, Changhong
Lin, Jiarong
Sui, Zhiqiang
Qu, XiaoZhi
Wang, Rui
Sheng, Kehua
Zhang, Bo
Robotics
Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the precision of the uncertainty modeling. Traditional methods of uncertainty modeling typically assume a Gaussian distribution and involve manual heuristic parameter tuning. However, these methods struggle to scale effectively and address long-tail scenarios. To address these challenges, we propose a learning-based method that encodes sensor information using higher-order neural network features, thereby eliminating the need for uncertainty estimation. This method significantly eliminates the need for parameter fine-tuning by developing an end-to-end neural network that is specifically designed for multi-sensor fusion. In our experiments, we demonstrate the effectiveness of our approach in real-world autonomous driving scenarios. Results show that the proposed method outperforms existing multi-sensor fusion methods in terms of both accuracy and robustness. A video of the results can be viewed at https://youtu.be/q4iuobMbjME.
title An End-to-End Learning-Based Multi-Sensor Fusion for Autonomous Vehicle Localization
topic Robotics
url https://arxiv.org/abs/2503.05088