Cover Image

A Framework for a Capability-driven Evaluation of Scenario Understanding for Multimodal Large Language Models in Autonomous Driving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sohn, Tin Stribor, Reis, Philipp, Dillitzer, Maximilian, Bach, Johannes, Corso, Jason J., Sax, Eric
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SNOW: Spatio-Temporal Scene Understanding with World Knowledge for Open-World Embodied Reasoning
by: Sohn, Tin Stribor, et al.
Published: (2025)

Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation
by: Sohn, Tin Stribor, et al.
Published: (2025)

R4: Retrieval-Augmented Reasoning for Vision-Language Models in 4D Spatio-Temporal Space
by: Sohn, Tin Stribor, et al.
Published: (2025)

Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review
by: Ransiek, Joshua, et al.
Published: (2024)

An Analysis of Driver-Initiated Takeovers during Assisted Driving and their Effect on Driver Satisfaction
by: Schwager, Robin, et al.
Published: (2024)

Behavior Forests: Real-Time Discovery of Dynamic Behavior for Data Selection
by: Reis, Philipp, et al.
Published: (2024)

SAFERad: A Framework to Enable Radar Data for Safety-Relevant Perception Tasks
by: Brühl, Tim, et al.
Published: (2025)

Improving Driver Satisfaction with a Driving Function Learning from Implicit Human Feedback -- a Test Group Study
by: Schwager, Robin, et al.
Published: (2026)

CLIPping the Limits: Finding the Sweet Spot for Relevant Images in Automated Driving Systems Perception Testing
by: Rigoll, Philipp, et al.
Published: (2024)

Tracking Meets Large Multimodal Models for Driving Scenario Understanding
by: Ishaq, Ayesha, et al.
Published: (2025)

Modular Autonomy with Conversational Interaction: An LLM-driven Framework for Decision Making in Autonomous Driving
by: Seegert, Marvin, et al.
Published: (2026)

Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios
by: Moller, Korbinian, et al.
Published: (2025)

Safety2Drive: Safety-Critical Scenario Benchmark for the Evaluation of Autonomous Driving
by: Li, Jingzheng, et al.
Published: (2025)

CALMM-Drive: Confidence-Aware Autonomous Driving with Large Multimodal Model
by: Yao, Ruoyu, et al.
Published: (2024)

Multimodal Large Language Model Driven Scenario Testing for Autonomous Vehicles
by: Lu, Qiujing, et al.
Published: (2024)

Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis
by: Gao, Yuan, et al.
Published: (2025)

Beyond ADE and FDE: A Comprehensive Evaluation Framework for Safety-Critical Prediction in Multi-Agent Autonomous Driving Scenarios
by: Liu, Feifei, et al.
Published: (2025)

LLM-Driven Scenario-Aware Planning for Autonomous Driving
by: Li, He, et al.
Published: (2026)

DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understanding
by: Ishaq, Ayesha, et al.
Published: (2025)

Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models
by: Mei, Yuewen, et al.
Published: (2025)

Investigating Driving Interactions: A Robust Multi-Agent Simulation Framework for Autonomous Vehicles
by: Kaufeld, Marc, et al.
Published: (2024)

FRENETIX: A High-Performance and Modular Motion Planning Framework for Autonomous Driving
by: Trauth, Rainer, et al.
Published: (2024)

StyleVLA: Driving Style-Aware Vision Language Action Model for Autonomous Driving
by: Gao, Yuan, et al.
Published: (2026)

A Reinforcement Learning-Boosted Motion Planning Framework: Comprehensive Generalization Performance in Autonomous Driving
by: Trauth, Rainer, et al.
Published: (2024)

Anomaly Detection in Autonomous Driving: A Survey
by: Bogdoll, Daniel, et al.
Published: (2022)

A Superalignment Framework in Autonomous Driving with Large Language Models
by: Kong, Xiangrui, et al.
Published: (2024)

Unifying Language-Action Understanding and Generation for Autonomous Driving
by: Wang, Xinyang, et al.
Published: (2026)

V2V-GoT: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models and Graph-of-Thoughts
by: Chiu, Hsu-kuang, et al.
Published: (2025)

Quantitative Representation of Scenario Difficulty for Autonomous Driving Based on Adversarial Policy Search
by: Yang, Shuo, et al.
Published: (2024)

Unsupervised Learning for Detection of Rare Driving Scenarios
by: Le, Dat, et al.
Published: (2025)

LLM-attacker: Enhancing Closed-loop Adversarial Scenario Generation for Autonomous Driving with Large Language Models
by: Mei, Yuewen, et al.
Published: (2025)

Navigating Dimensionality through State Machines in Automotive System Validation
by: Adolph, Laurenz, et al.
Published: (2024)

Large Language Model based Interactive Decision-Making for Autonomous Driving
by: Dong, Xinwei, et al.
Published: (2026)

Precise and Efficient Collision Prediction under Uncertainty in Autonomous Driving
by: Kaufeld, Marc, et al.
Published: (2025)

Enhancing Autonomous Driving Safety with Collision Scenario Integration
by: Wang, Zi, et al.
Published: (2025)

Scenarios Engineering driven Autonomous Transportation in Open-Pit Mines
by: Teng, Siyu, et al.
Published: (2024)

RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Driving
by: Huang, Zhijian, et al.
Published: (2024)

SCOUT: A Lightweight Framework for Scenario Coverage Assessment in Autonomous Driving
by: Yildiz, Anil, et al.
Published: (2025)

Planning by Simulation: Motion Planning with Learning-based Parallel Scenario Prediction for Autonomous Driving
by: Niu, Tian, et al.
Published: (2024)

Intention-based and Risk-Aware Trajectory Prediction for Autonomous Driving in Complex Traffic Scenarios
by: Wei, Wen, et al.
Published: (2024)