Cover Image

HERMES: A Holistic End-to-End Risk-Aware Multimodal Embodied System with Vision-Language Models for Long-Tail Autonomous Driving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Weizhe, You, Junwei, Liu, Jiaxi, Wang, Zhaoyi, Gan, Rui, Huang, Zilin, Wei, Feng, Ran, Bin
Format:	Preprint
Published:	2026
Subjects:	Robotics Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SEAL: Vision-Language Model-Based Safe End-to-End Cooperative Autonomous Driving with Adaptive Long-Tail Modeling
by: You, Junwei, et al.
Published: (2025)

V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models
by: You, Junwei, et al.
Published: (2024)

V2X-QA: A Comprehensive Reasoning Dataset and Benchmark for Multimodal Large Language Models in Autonomous Driving Across Ego, Infrastructure, and Cooperative Views
by: You, Junwei, et al.
Published: (2026)

Embodied Cognition Augmented End2End Autonomous Driving
by: Niu, Ling, et al.
Published: (2025)

Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving
by: Sun, Jiangxin, et al.
Published: (2026)

FocalAD: Local Motion Planning for End-to-End Autonomous Driving
by: Sun, Bin, et al.
Published: (2025)

Reinforced Refinement with Self-Aware Expansion for End-to-End Autonomous Driving
by: Liu, Haochen, et al.
Published: (2025)

Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving
by: Song, Ziying, et al.
Published: (2025)

LightEMMA: Lightweight End-to-End Multimodal Model for Autonomous Driving
by: Qiao, Zhijie, et al.
Published: (2025)

DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving
by: Jia, Xiaosong, et al.
Published: (2025)

Unveiling the Surprising Efficacy of Navigation Understanding in End-to-End Autonomous Driving
by: Hua, Zhihua, et al.
Published: (2026)

VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving
by: Zhao, Rui, et al.
Published: (2026)

RiskNet: Interaction-Aware Risk Forecasting for Autonomous Driving in Long-Tail Scenarios
by: Liu, Qichao, et al.
Published: (2025)

Risk Map As Middleware: Towards Interpretable Cooperative End-to-end Autonomous Driving for Risk-Aware Planning
by: Lei, Mingyue, et al.
Published: (2025)

EMMA: End-to-End Multimodal Model for Autonomous Driving
by: Hwang, Jyh-Jing, et al.
Published: (2024)

CoReVLA: A Dual-Stage End-to-End Autonomous Driving Framework for Long-Tail Scenarios via Collect-and-Refine
by: Fang, Shiyu, et al.
Published: (2025)

VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Driving
by: Huang, Zilin, et al.
Published: (2024)

StyleDrive: Towards Driving-Style Aware Benchmarking of End-To-End Autonomous Driving
by: Hao, Ruiyang, et al.
Published: (2025)

ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Driving
by: Feng, Renju, et al.
Published: (2025)

AlignDrive: Aligned Lateral-Longitudinal Planning for End-to-End Autonomous Driving
by: Wu, Yanhao, et al.
Published: (2026)

Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving
by: Jiang, Bo, et al.
Published: (2024)

Enhancing End-to-End Autonomous Driving with Risk Semantic Distillaion from VLM
by: Qin, Jack, et al.
Published: (2025)

Collision Risk Estimation via Loss Prediction in End-to-End Autonomous Driving
by: Xiong, Ziliang, et al.
Published: (2025)

FlowDrive: Energy Flow Field for End-to-End Autonomous Driving
by: Jiang, Hao, et al.
Published: (2025)

Exploring the Causality of End-to-End Autonomous Driving
by: Li, Jiankun, et al.
Published: (2024)

DriveSafer: End-to-End Autonomous Driving with Safety Guidance
by: Sural, Shounak, et al.
Published: (2026)

ComDrive: Comfort-Oriented End-to-End Autonomous Driving
by: Wang, Junming, et al.
Published: (2024)

Unleashing the Potential of Diffusion Models for End-to-End Autonomous Driving
by: Zheng, Yinan, et al.
Published: (2026)

Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling
by: Moon, Seokha, et al.
Published: (2026)

GMF-Drive: Gated Mamba Fusion with Spatial-Aware BEV Representation for End-to-End Autonomous Driving
by: Wang, Jian, et al.
Published: (2025)

OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving
by: Xing, Shuo, et al.
Published: (2024)

DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving
by: Huang, Zilin, et al.
Published: (2026)

FeaXDrive: Feasibility-aware Trajectory-Centric Diffusion Planning for End-to-End Autonomous Driving
by: Wang, Baoyun, et al.
Published: (2026)

Communication Resources Constrained Hierarchical Federated Learning for End-to-End Autonomous Driving
by: Kou, Wei-Bin, et al.
Published: (2023)

DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving
by: Liao, Bencheng, et al.
Published: (2024)

Drive in Corridors: Enhancing the Safety of End-to-end Autonomous Driving via Corridor Learning and Planning
by: Zhang, Zhiwei, et al.
Published: (2025)

Percept-WAM: Perception-Enhanced World-Awareness-Action Model for Robust End-to-End Autonomous Driving
by: Han, Jianhua, et al.
Published: (2025)

NetRoller: Interfacing General and Specialized Models for End-to-End Autonomous Driving
by: Xin, Ren, et al.
Published: (2025)

PIE: Perception and Interaction Enhanced End-to-End Motion Planning for Autonomous Driving
by: Yuan, Chengran, et al.
Published: (2025)

IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving
by: Zhang, Chenghao, et al.
Published: (2026)