RAVE: End-to-end Hierarchical Visual Localization with Rasterized and Vectorized HD map

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Miao, Jinyu, Wen, Tuopu, Jiang, Kun, Qian, Kangan, Fu, Zheng, Wang, Yunlong, Zhang, Zhihuang, Yang, Mengmeng, Huang, Jin, Zhong, Zhihua, Yang, Diange
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911170317778944
author Miao, Jinyu
Wen, Tuopu
Jiang, Kun
Qian, Kangan
Fu, Zheng
Wang, Yunlong
Zhang, Zhihuang
Yang, Mengmeng
Huang, Jin
Zhong, Zhihua
Yang, Diange
author_facet Miao, Jinyu
Wen, Tuopu
Jiang, Kun
Qian, Kangan
Fu, Zheng
Wang, Yunlong
Zhang, Zhihuang
Yang, Mengmeng
Huang, Jin
Zhong, Zhihua
Yang, Diange
contents Accurate localization serves as an important component in autonomous driving systems. Traditional rule-based localization involves many standalone modules, which is theoretically fragile and requires costly hyperparameter tuning, therefore sacrificing the accuracy and generalization. In this paper, we propose an end-to-end visual localization system, RAVE, in which the surrounding images are associated with the HD map data to estimate pose. To ensure high-quality observations for localization, a low-rank flow-based prior fusion module (FLORA) is developed to incorporate misaligned map prior into the perceived BEV features. Pursuing a balance among efficiency, interpretability, and accuracy, a hierarchical localization module is proposed, which efficiently estimates poses through a decoupled BEV neural matching-based pose solver (DEMA) using rasterized HD map, and then refines the estimation through a Transformer-based pose regressor (POET) using vectorized HD map. The experimental results demonstrate that our method can perform robust and accurate localization under varying environmental conditions while running efficiently.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00862
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RAVE: End-to-end Hierarchical Visual Localization with Rasterized and Vectorized HD map
Miao, Jinyu
Wen, Tuopu
Jiang, Kun
Qian, Kangan
Fu, Zheng
Wang, Yunlong
Zhang, Zhihuang
Yang, Mengmeng
Huang, Jin
Zhong, Zhihua
Yang, Diange
Robotics
Accurate localization serves as an important component in autonomous driving systems. Traditional rule-based localization involves many standalone modules, which is theoretically fragile and requires costly hyperparameter tuning, therefore sacrificing the accuracy and generalization. In this paper, we propose an end-to-end visual localization system, RAVE, in which the surrounding images are associated with the HD map data to estimate pose. To ensure high-quality observations for localization, a low-rank flow-based prior fusion module (FLORA) is developed to incorporate misaligned map prior into the perceived BEV features. Pursuing a balance among efficiency, interpretability, and accuracy, a hierarchical localization module is proposed, which efficiently estimates poses through a decoupled BEV neural matching-based pose solver (DEMA) using rasterized HD map, and then refines the estimation through a Transformer-based pose regressor (POET) using vectorized HD map. The experimental results demonstrate that our method can perform robust and accurate localization under varying environmental conditions while running efficiently.
title RAVE: End-to-end Hierarchical Visual Localization with Rasterized and Vectorized HD map
topic Robotics
url https://arxiv.org/abs/2503.00862