OMCL: Open-vocabulary Monte Carlo Localization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kruzhkov, Evgenii, Memmesheimer, Raphael, Behnke, Sven
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912997275860992
author Kruzhkov, Evgenii
Memmesheimer, Raphael
Behnke, Sven
author_facet Kruzhkov, Evgenii
Memmesheimer, Raphael
Behnke, Sven
contents Robust robot localization is an important prerequisite for navigation, but it becomes challenging when the map and robot measurements are obtained from different sensors. Prior methods are often tailored to specific environments, relying on closed-set semantics or fine-tuned features. In this work, we extend Monte Carlo Localization with vision-language features, allowing OMCL to robustly compute the likelihood of visual observations given a camera pose and a 3D map created from posed RGB-D images or aligned point clouds. These open-vocabulary features enable us to associate observations and map elements from different modalities, and to natively initialize global localization through natural language descriptions of nearby objects. We evaluate our approach using Matterport3D and Replica for indoor scenes and demonstrate generalization on SemanticKITTI for outdoor scenes.
format Preprint
id arxiv_https___arxiv_org_abs_2512_15557
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OMCL: Open-vocabulary Monte Carlo Localization
Kruzhkov, Evgenii
Memmesheimer, Raphael
Behnke, Sven
Robotics
Robust robot localization is an important prerequisite for navigation, but it becomes challenging when the map and robot measurements are obtained from different sensors. Prior methods are often tailored to specific environments, relying on closed-set semantics or fine-tuned features. In this work, we extend Monte Carlo Localization with vision-language features, allowing OMCL to robustly compute the likelihood of visual observations given a camera pose and a 3D map created from posed RGB-D images or aligned point clouds. These open-vocabulary features enable us to associate observations and map elements from different modalities, and to natively initialize global localization through natural language descriptions of nearby objects. We evaluate our approach using Matterport3D and Replica for indoor scenes and demonstrate generalization on SemanticKITTI for outdoor scenes.
title OMCL: Open-vocabulary Monte Carlo Localization
topic Robotics
url https://arxiv.org/abs/2512.15557