DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ma, Enhui, Zhang, Jiahuan, Zheng, Guantian, Tang, Tao, Li, Shengbo Eben, Lu, Yuhang, Zhou, Xia, Zhang, Xueyang, Zhan, Yifei, Zhan, Kun, Hao, Zhihui, Lang, Xianpeng, Yu, Kaicheng
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911478646308864
author Ma, Enhui
Zhang, Jiahuan
Zheng, Guantian
Tang, Tao
Li, Shengbo Eben
Lu, Yuhang
Zhou, Xia
Zhang, Xueyang
Zhan, Yifei
Zhan, Kun
Hao, Zhihui
Lang, Xianpeng
Yu, Kaicheng
author_facet Ma, Enhui
Zhang, Jiahuan
Zheng, Guantian
Tang, Tao
Li, Shengbo Eben
Lu, Yuhang
Zhou, Xia
Zhang, Xueyang
Zhan, Yifei
Zhan, Kun
Hao, Zhihui
Lang, Xianpeng
Yu, Kaicheng
contents Multimodal Large Language Models (MLLMs) are rapidly becoming the intelligence brain of end-to-end autonomous driving systems. A key challenge is to assess whether MLLMs can truly understand and follow complex real-world traffic rules. However, existing benchmarks mainly focus on single-rule scenarios like traffic sign recognition, neglecting the complexity of multi-rule concurrency and conflicts in real driving. Consequently, models perform well on simple tasks but often fail or violate rules in real world complex situations. To bridge this gap, we propose DriveCombo, a text and vision-based benchmark for compositional traffic rule reasoning. Inspired by human drivers' cognitive development, we propose a systematic Five-Level Cognitive Ladder that evaluates reasoning from single-rule understanding to multi-rule integration and conflict resolution, enabling quantitative assessment across cognitive stages. We further propose a Rule2Scene Agent that maps language-based traffic rules to dynamic driving scenes through rule crafting and scene generation, enabling scene-level traffic rule visual reasoning. Evaluations of 14 mainstream MLLMs reveal performance drops as task complexity grows, particularly during rule conflicts. After splitting the dataset and fine-tuning on the training set, we further observe substantial improvements in both traffic rule reasoning and downstream planning capabilities. These results highlight the effectiveness of DriveCombo in advancing compliant and intelligent autonomous driving systems.
format Preprint
id arxiv_https___arxiv_org_abs_2603_01637
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
Ma, Enhui
Zhang, Jiahuan
Zheng, Guantian
Tang, Tao
Li, Shengbo Eben
Lu, Yuhang
Zhou, Xia
Zhang, Xueyang
Zhan, Yifei
Zhan, Kun
Hao, Zhihui
Lang, Xianpeng
Yu, Kaicheng
Computer Vision and Pattern Recognition
Multimodal Large Language Models (MLLMs) are rapidly becoming the intelligence brain of end-to-end autonomous driving systems. A key challenge is to assess whether MLLMs can truly understand and follow complex real-world traffic rules. However, existing benchmarks mainly focus on single-rule scenarios like traffic sign recognition, neglecting the complexity of multi-rule concurrency and conflicts in real driving. Consequently, models perform well on simple tasks but often fail or violate rules in real world complex situations. To bridge this gap, we propose DriveCombo, a text and vision-based benchmark for compositional traffic rule reasoning. Inspired by human drivers' cognitive development, we propose a systematic Five-Level Cognitive Ladder that evaluates reasoning from single-rule understanding to multi-rule integration and conflict resolution, enabling quantitative assessment across cognitive stages. We further propose a Rule2Scene Agent that maps language-based traffic rules to dynamic driving scenes through rule crafting and scene generation, enabling scene-level traffic rule visual reasoning. Evaluations of 14 mainstream MLLMs reveal performance drops as task complexity grows, particularly during rule conflicts. After splitting the dataset and fine-tuning on the training set, we further observe substantial improvements in both traffic rule reasoning and downstream planning capabilities. These results highlight the effectiveness of DriveCombo in advancing compliant and intelligent autonomous driving systems.
title DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.01637