A Comprehensive LLM-powered Framework for Driving Intelligence Evaluation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913723530084352 |
|---|---|
| author | You, Shanhe Luo, Xuewen Liang, Xinhe Yu, Jiashu Zheng, Chen Gong, Jiangtao |
| author_facet | You, Shanhe Luo, Xuewen Liang, Xinhe Yu, Jiashu Zheng, Chen Gong, Jiangtao |
| contents | Evaluation methods for autonomous driving are crucial for algorithm optimization. However, due to the complexity of driving intelligence, there is currently no comprehensive evaluation method for the level of autonomous driving intelligence. In this paper, we propose an evaluation framework for driving behavior intelligence in complex traffic environments, aiming to fill this gap. We constructed a natural language evaluation dataset of human professional drivers and passengers through naturalistic driving experiments and post-driving behavior evaluation interviews. Based on this dataset, we developed an LLM-powered driving evaluation framework. The effectiveness of this framework was validated through simulated experiments in the CARLA urban traffic simulator and further corroborated by human assessment. Our research provides valuable insights for evaluating and designing more intelligent, human-like autonomous driving agents. The implementation details of the framework and detailed information about the dataset can be found at Github. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_05164 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Comprehensive LLM-powered Framework for Driving Intelligence Evaluation You, Shanhe Luo, Xuewen Liang, Xinhe Yu, Jiashu Zheng, Chen Gong, Jiangtao Robotics Artificial Intelligence 68T45 Evaluation methods for autonomous driving are crucial for algorithm optimization. However, due to the complexity of driving intelligence, there is currently no comprehensive evaluation method for the level of autonomous driving intelligence. In this paper, we propose an evaluation framework for driving behavior intelligence in complex traffic environments, aiming to fill this gap. We constructed a natural language evaluation dataset of human professional drivers and passengers through naturalistic driving experiments and post-driving behavior evaluation interviews. Based on this dataset, we developed an LLM-powered driving evaluation framework. The effectiveness of this framework was validated through simulated experiments in the CARLA urban traffic simulator and further corroborated by human assessment. Our research provides valuable insights for evaluating and designing more intelligent, human-like autonomous driving agents. The implementation details of the framework and detailed information about the dataset can be found at Github. |
| title | A Comprehensive LLM-powered Framework for Driving Intelligence Evaluation |
| topic | Robotics Artificial Intelligence 68T45 |
| url | https://arxiv.org/abs/2503.05164 |