Cover Image

One Agent to Guide Them All: Empowering MLLMs for Vision-and-Language Navigation via Explicit World Representation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Zerui, Zheng, Hongpei, Zhao, Fangguo, Chan, Aidan, Zhou, Jian, Lin, Sihao, Li, Shijie, Wu, Qi
Format:	Preprint
Published:	2026
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Vision-Guided MPPI for Agile Drone Racing: Navigating Arbitrary Gate Poses via Neural Signed Distance Fields
by: Zhao, Fangguo, et al.
Published: (2026)

BadNAVer: Exploring Jailbreak Attacks On Vision-and-Language Navigation
by: Lyu, Wenqi, et al.
Published: (2025)

Fast-SmartWay: Panoramic-Free End-to-End Zero-Shot Vision-and-Language Navigation
by: Shi, Xiangyu, et al.
Published: (2025)

One Hand to Rule Them All: Canonical Representations for Unified Dexterous Manipulation
by: Wei, Zhenyu, et al.
Published: (2026)

VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
by: Lin, Sihao, et al.
Published: (2025)

DV-VLN: Dual Verification for Reliable LLM-Based Vision-and-Language Navigation
by: Li, Zijun, et al.
Published: (2026)

Rethinking Reference Trajectories in Agile Drone Racing: A Unified Reference-Free Model-Based Controller via MPPI
by: Zhao, Fangguo, et al.
Published: (2025)

Decoupled Action Expert: Confining Task Knowledge to the Conditioning Pathway
by: Zhou, Jian, et al.
Published: (2025)

SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigation
by: Shi, Xiangyu, et al.
Published: (2025)

Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environments
by: Li, Zerui, et al.
Published: (2025)

PokeVLA: Empowering Pocket-Sized Vision-Language-Action Model with Comprehensive World Knowledge Guidance
by: Zheng, Yupeng, et al.
Published: (2026)

AgentVLN: Towards Agentic Vision-and-Language Navigation
by: Xin, Zihao, et al.
Published: (2026)

One Filter to Deploy Them All: Robust Safety for Quadrupedal Navigation in Unknown Environments
by: Lin, Albert, et al.
Published: (2024)

Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMs
by: Qiao, Yanyuan, et al.
Published: (2024)

One Map to Find Them All: Real-time Open-Vocabulary Mapping for Zero-shot Multi-Object Navigation
by: Busch, Finn Lukas, et al.
Published: (2024)

T-araVLN: Translator for Agricultural Robotic Agents on Vision-and-Language Navigation
by: Zhao, Xiaobei, et al.
Published: (2025)

VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents
by: Zhao, Xunyi, et al.
Published: (2025)

One Ring to Rule Them All: Constrained Distributional Control for Massive-Scale Heterogeneous Robotic Ensemble Systems
by: Arias, Andres, et al.
Published: (2025)

IntentionNav: A Benchmark for Intent-Driven Object Navigation from Implicit Human Instruction
by: Qian, Lin, et al.
Published: (2026)

Follow the Signs: Using Textual Cues and LLMs to Guide Efficient Robot Navigation
by: Cao, Jing, et al.
Published: (2026)

GeoVLA: Empowering 3D Representations in Vision-Language-Action Models
by: Sun, Lin, et al.
Published: (2025)

Imitation Learning-Based Online Time-Optimal Control with Multiple-Waypoint Constraints for Quadrotors
by: Zhou, Jin, et al.
Published: (2024)

WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation
by: Zhao, Baining, et al.
Published: (2026)

P$^{3}$Nav: End-to-End Perception, Prediction and Planning for Vision-and-Language Navigation
by: Li, Tianfu, et al.
Published: (2026)

IMAC-AgriVLN: Can Agricultural Vision-and-Language Navigation Agents be Aware of Instruction Mistakes?
by: Zhao, Xiaobei, et al.
Published: (2026)

Can Pretrained Vision-Language Embeddings Alone Guide Robot Navigation?
by: Subedi, Nitesh, et al.
Published: (2025)

Foresight Social-aware Reinforcement Learning for Robot Navigation
by: Zhou, Yanying, et al.
Published: (2021)

GeoNav: Empowering MLLMs with dual-scale geospatial reasoning for language-goal aerial navigation
by: Xu, Haotian, et al.
Published: (2025)

Sparse Video Generation Propels Real-World Beyond-the-View Vision-Language Navigation
by: Zhang, Hai, et al.
Published: (2026)

SPAN-Nav: Generalized Spatial Awareness for Versatile Vision-Language Navigation
by: Liu, Jiahang, et al.
Published: (2026)

LiveVLN: Breaking the Stop-and-Go Loop in Vision-Language Navigation
by: Wang, Xiangchen, et al.
Published: (2026)

Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigation
by: Wang, Zihan, et al.
Published: (2024)

One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion
by: Bohlinger, Nico, et al.
Published: (2024)

VISTA: Generative Visual Imagination for Vision-and-Language Navigation
by: Huang, Yanjia, et al.
Published: (2025)

Gate-Aware Online Planning for Two-Player Autonomous Drone Racing
by: Zhao, Fangguo, et al.
Published: (2024)

LOONG: Online Time-Optimal Autonomous Flight for MAVs in Cluttered Environments
by: Guan, Xin, et al.
Published: (2026)

Vision-Language Navigation with Continual Learning
by: Li, Zhiyuan, et al.
Published: (2024)

Cog-GA: A Large Language Models-based Generative Agent for Vision-Language Navigation in Continuous Environments
by: Li, Zhiyuan, et al.
Published: (2024)

WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models
by: Chen, Hongjin, et al.
Published: (2026)

Building Explicit World Model for Zero-Shot Open-World Object Manipulation
by: Li, Xiaotong, et al.
Published: (2026)