Cover Image

VLM-MPC: Vision Language Foundation Model (VLM)-Guided Model Predictive Controller (MPC) for Autonomous Driving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Long, Keke, Shi, Haotian, Liu, Jiaxi, Li, Xiaopeng
Format:	Preprint
Published:	2024
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models
by: You, Junwei, et al.
Published: (2024)

GenerativeMPC: VLM-RAG-guided Whole-Body MPC with Virtual Impedance for Bimanual Mobile Manipulation
by: Fernando, Marcelino Julio, et al.
Published: (2026)

TPS-Drive: Task-Guided Representation Purification for VLM-based Autonomous Driving
by: Li, Jiaxiang, et al.
Published: (2026)

VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Driving
by: Qu, Yansong, et al.
Published: (2025)

A Low-Rank Method for Vision Language Model Hallucination Mitigation in Autonomous Driving
by: Long, Keke, et al.
Published: (2025)

VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Driving
by: Liu, Haichao, et al.
Published: (2025)

VLM-RRT: Vision Language Model Guided RRT Search for Autonomous UAV Navigation
by: Ye, Jianlin, et al.
Published: (2025)

SwarmVLM: VLM-Guided Impedance Control for Autonomous Navigation of Heterogeneous Robots in Dynamic Warehousing
by: Zafar, Malaika, et al.
Published: (2025)

Safety Reinforced Model Predictive Control (SRMPC): Improving MPC with Reinforcement Learning for Motion Planning in Autonomous Driving
by: Fischer, Johannes, et al.
Published: (2025)

LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving
by: Sha, Hao, et al.
Published: (2023)

A Hierarchical Test Platform for Vision Language Model (VLM)-Integrated Real-World Autonomous Driving
by: Zhou, Yupeng, et al.
Published: (2025)

AppleVLM: End-to-end Autonomous Driving with Advanced Perception and Planning-Enhanced Vision-Language Models
by: Han, Yuxuan, et al.
Published: (2026)

Learning Based MPC for Autonomous Driving Using a Low Dimensional Residual Model
by: Li, Yaoyu, et al.
Published: (2024)

DRO-EDL-MPC: Evidential Deep Learning-Based Distributionally Robust Model Predictive Control for Safe Autonomous Driving
by: Ham, Hyeongchan, et al.
Published: (2025)

DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving
by: Huang, Zilin, et al.
Published: (2026)

Situation-Aware Interactive MPC Switching for Autonomous Driving
by: Qi, Shuhao, et al.
Published: (2025)

A3VLM: Actionable Articulation-Aware Vision Language Model
by: Huang, Siyuan, et al.
Published: (2024)

VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Driving
by: Huang, Zilin, et al.
Published: (2024)

VLM-Auto: VLM-based Autonomous Driving Assistant with Human-like Behavior and Understanding for Complex Road Scenes
by: Guo, Ziang, et al.
Published: (2024)

Offline Deep Model Predictive Control (MPC) for Visual Navigation
by: Bouzid, Taha, et al.
Published: (2024)

HumanoidVLM: Vision-Language-Guided Impedance Control for Contact-Rich Humanoid Manipulation
by: Mahmoud, Yara, et al.
Published: (2026)

VERDI: VLM-Embedded Reasoning for Autonomous Driving
by: Feng, Bowen, et al.
Published: (2025)

COVLM-RL: Critical Object-Oriented Reasoning for Autonomous Driving Using VLM-Guided Reinforcement Learning
by: Li, Lin, et al.
Published: (2025)

LPV-MPC for Lateral Control in Full-Scale Autonomous Racing
by: Jardali, Hassan, et al.
Published: (2026)

VLM-C4L: Continual Core Dataset Learning with Corner Case Optimization via Vision-Language Models for Autonomous Driving
by: Hu, Haibo, et al.
Published: (2025)

Courteous MPC for Autonomous Driving with CBF-inspired Risk Assessment
by: Zhang, Yanze, et al.
Published: (2024)

VDT-Auto: End-to-end Autonomous Driving with VLM-Guided Diffusion Transformers
by: Guo, Ziang, et al.
Published: (2025)

UA-MPC: Uncertainty-Aware Model Predictive Control for Motorized LiDAR Odometry
by: Li, Jianping, et al.
Published: (2024)

MonoMPC: Monocular Vision Based Navigation with Learned Collision Model and Risk-Aware Model Predictive Control
by: Sharma, Basant, et al.
Published: (2025)

E-MPC: Edge-assisted Model Predictive Control
by: Lou, Yuan-Yao, et al.
Published: (2024)

RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedback
by: Wang, Yufei, et al.
Published: (2024)

TransformerMPC: Accelerating Model Predictive Control via Transformers
by: Zinage, Vrushabh, et al.
Published: (2024)

CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systems
by: Liu, Haichao, et al.
Published: (2025)

SimpleVSF: VLM-Scoring Fusion for Trajectory Prediction of End-to-End Autonomous Driving
by: Zheng, Peiru, et al.
Published: (2025)

Embedded Hierarchical MPC for Autonomous Navigation
by: Benders, Dennis, et al.
Published: (2024)

CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Models
by: Sheng, Zihao, et al.
Published: (2025)

TransMPC: Transformer-based Explicit MPC with Variable Prediction Horizon
by: Wu, Sichao, et al.
Published: (2025)

LLA-MPC: Fast Adaptive Control for Autonomous Racing
by: AL-Sunni, Maitham F., et al.
Published: (2025)

Residual MPC: Blending Reinforcement Learning with GPU-Parallelized Model Predictive Control
by: Jeon, Se Hwan, et al.
Published: (2025)

LVLM-MPC Collaboration for Autonomous Driving: A Safety-Aware and Task-Scalable Control Architecture
by: Atsuta, Kazuki, et al.
Published: (2025)