Autonomous Frontier-Based Exploration with VLM Guidance

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Aitha, Aarush, Zakhor, Avideh
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914590722359296
author Aitha, Aarush
Zakhor, Avideh
author_facet Aitha, Aarush
Zakhor, Avideh
contents Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advanced reasoning of Vision-Language Models (VLMs). We introduce a novel exploration pipeline where a VLM performs high-level strategic decision-making, guiding a conventional low-level robotics control stack. At decision points, the robot generates a multimodal prompt with its current map and visual imagery of potential paths, or frontiers. The VLM analyzes this prompt to select the most promising frontier, replacing simple geometric heuristics with contextual spatial reasoning. This approach, validated in simulation across six indoor environments, improves map coverage by up to 24\% over existing methods. Our pipeline is lightweight, training-free, and easily transferable to any robot with standard sensors and an internet connection.
format Preprint
id arxiv_https___arxiv_org_abs_2605_23165
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Autonomous Frontier-Based Exploration with VLM Guidance
Aitha, Aarush
Zakhor, Avideh
Robotics
Artificial Intelligence
Computation and Language
Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advanced reasoning of Vision-Language Models (VLMs). We introduce a novel exploration pipeline where a VLM performs high-level strategic decision-making, guiding a conventional low-level robotics control stack. At decision points, the robot generates a multimodal prompt with its current map and visual imagery of potential paths, or frontiers. The VLM analyzes this prompt to select the most promising frontier, replacing simple geometric heuristics with contextual spatial reasoning. This approach, validated in simulation across six indoor environments, improves map coverage by up to 24\% over existing methods. Our pipeline is lightweight, training-free, and easily transferable to any robot with standard sensors and an internet connection.
title Autonomous Frontier-Based Exploration with VLM Guidance
topic Robotics
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2605.23165