VLG-Loc: Vision-Language Global Localization from Labeled Footprint Maps

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Aoki, Mizuho, Honda, Kohei, Yoshimura, Yasuhiro, Ishita, Takeshi, Yonetani, Ryo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918253928906752
author Aoki, Mizuho
Honda, Kohei
Yoshimura, Yasuhiro
Ishita, Takeshi
Yonetani, Ryo
author_facet Aoki, Mizuho
Honda, Kohei
Yoshimura, Yasuhiro
Ishita, Takeshi
Yonetani, Ryo
contents This paper presents Vision-Language Global Localization (VLG-Loc), a novel global localization method that uses human-readable labeled footprint maps containing only names and areas of distinctive visual landmarks in an environment. While humans naturally localize themselves using such maps, translating this capability to robotic systems remains highly challenging due to the difficulty of establishing correspondences between observed landmarks and those in the map without geometric and appearance details. To address this challenge, VLG-Loc leverages a vision-language model (VLM) to search the robot's multi-directional image observations for the landmarks noted in the map. The method then identifies robot poses within a Monte Carlo localization framework, where the found landmarks are used to evaluate the likelihood of each pose hypothesis. Experimental validation in simulated and real-world retail environments demonstrates superior robustness compared to existing scan-based methods, particularly under environmental changes. Further improvements are achieved through the probabilistic fusion of visual and scan-based localization.
format Preprint
id arxiv_https___arxiv_org_abs_2512_12793
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VLG-Loc: Vision-Language Global Localization from Labeled Footprint Maps
Aoki, Mizuho
Honda, Kohei
Yoshimura, Yasuhiro
Ishita, Takeshi
Yonetani, Ryo
Robotics
This paper presents Vision-Language Global Localization (VLG-Loc), a novel global localization method that uses human-readable labeled footprint maps containing only names and areas of distinctive visual landmarks in an environment. While humans naturally localize themselves using such maps, translating this capability to robotic systems remains highly challenging due to the difficulty of establishing correspondences between observed landmarks and those in the map without geometric and appearance details. To address this challenge, VLG-Loc leverages a vision-language model (VLM) to search the robot's multi-directional image observations for the landmarks noted in the map. The method then identifies robot poses within a Monte Carlo localization framework, where the found landmarks are used to evaluate the likelihood of each pose hypothesis. Experimental validation in simulated and real-world retail environments demonstrates superior robustness compared to existing scan-based methods, particularly under environmental changes. Further improvements are achieved through the probabilistic fusion of visual and scan-based localization.
title VLG-Loc: Vision-Language Global Localization from Labeled Footprint Maps
topic Robotics
url https://arxiv.org/abs/2512.12793