Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Xueying, Lyu, Feng, Wu, Hao, Liu, Mingliu, Liu, Jia-Nan, Liu, Guozi
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2604.02318
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912999472627712
author Li, Xueying
Lyu, Feng
Wu, Hao
Liu, Mingliu
Liu, Jia-Nan
Liu, Guozi
author_facet Li, Xueying
Lyu, Feng
Wu, Hao
Liu, Mingliu
Liu, Jia-Nan
Liu, Guozi
contents Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to inefficient behaviors such as local oscillation and redundant revisiting. We argue that this stems from a lack of metacognitive capabilities: the agent cannot monitor its exploration progress, diagnose strategy failures, or adapt accordingly. To address this, we propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction. Spatial memory builds a persistent 3D semantic map. History-aware planning penalizes revisiting to improve efficiency. Reflective correction detects stagnation and uses an LLM to generate corrective rules that guide future frontier selection. Experiments on GOAT-Bench, HM3D-OVON, and A-EQA show that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, demonstrating that metacognitive reasoning significantly improves robustness and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2604_02318
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning
Li, Xueying
Lyu, Feng
Wu, Hao
Liu, Mingliu
Liu, Jia-Nan
Liu, Guozi
Robotics
Computer Vision and Pattern Recognition
Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to inefficient behaviors such as local oscillation and redundant revisiting. We argue that this stems from a lack of metacognitive capabilities: the agent cannot monitor its exploration progress, diagnose strategy failures, or adapt accordingly. To address this, we propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction. Spatial memory builds a persistent 3D semantic map. History-aware planning penalizes revisiting to improve efficiency. Reflective correction detects stagnation and uses an LLM to generate corrective rules that guide future frontier selection. Experiments on GOAT-Bench, HM3D-OVON, and A-EQA show that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, demonstrating that metacognitive reasoning significantly improves robustness and efficiency.
title Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.02318