Foundation Models for Autonomous Driving System: An Initial Roadmap
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918424100208640 |
|---|---|
| author | Wu, Xiongfei Cheng, Mingfei Ren, Xiaoning Hu, Qiang Chen, Jianlang Huang, Yuheng Cordy, Maxime Zhang, Yao Xie, Xiaofei Ma, Lei Traon, Yves Le |
| author_facet | Wu, Xiongfei Cheng, Mingfei Ren, Xiaoning Hu, Qiang Chen, Jianlang Huang, Yuheng Cordy, Maxime Zhang, Yao Xie, Xiaofei Ma, Lei Traon, Yves Le |
| contents | Recent advances in foundation models (FMs), including large language models (LLMs), vision-language models (VLMs), and world models, have opened new opportunities for autonomous driving systems (ADSs) in perception, reasoning, decision-making, and interaction. However, ADSs are safety-critical cyber-physical systems, and integrating FMs into them raises substantial software engineering challenges in data curation, system design, deployment, evaluation, and assurance. To clarify this rapidly evolving landscape, we present an initial roadmap, grounded in a structured literature review, for integrating FMs into autonomous driving across three dimensions: FM infrastructure, in-vehicle integration, and practical deployment. For each dimension, we summarize the state of the art, identify key challenges, and highlight open research opportunities. Based on this analysis, we outline research directions for building reliable, safe, and trustworthy FM-enabled ADSs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_00911 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Foundation Models for Autonomous Driving System: An Initial Roadmap Wu, Xiongfei Cheng, Mingfei Ren, Xiaoning Hu, Qiang Chen, Jianlang Huang, Yuheng Cordy, Maxime Zhang, Yao Xie, Xiaofei Ma, Lei Traon, Yves Le Software Engineering Recent advances in foundation models (FMs), including large language models (LLMs), vision-language models (VLMs), and world models, have opened new opportunities for autonomous driving systems (ADSs) in perception, reasoning, decision-making, and interaction. However, ADSs are safety-critical cyber-physical systems, and integrating FMs into them raises substantial software engineering challenges in data curation, system design, deployment, evaluation, and assurance. To clarify this rapidly evolving landscape, we present an initial roadmap, grounded in a structured literature review, for integrating FMs into autonomous driving across three dimensions: FM infrastructure, in-vehicle integration, and practical deployment. For each dimension, we summarize the state of the art, identify key challenges, and highlight open research opportunities. Based on this analysis, we outline research directions for building reliable, safe, and trustworthy FM-enabled ADSs. |
| title | Foundation Models for Autonomous Driving System: An Initial Roadmap |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2504.00911 |