Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912382295474176 |
|---|---|
| author | Lebioda, Krzysztof Petrovic, Nenad Pan, Fengjunjie Zolfaghari, Vahid Schamschurko, Andre Knoll, Alois |
| author_facet | Lebioda, Krzysztof Petrovic, Nenad Pan, Fengjunjie Zolfaghari, Vahid Schamschurko, Andre Knoll, Alois |
| contents | Large Language Models (LLMs) are taking many industries by storm. They possess impressive reasoning capabilities and are capable of handling complex problems, as shown by their steadily improving scores on coding and mathematical benchmarks. However, are the models currently available truly capable of addressing real-world challenges, such as those found in the automotive industry? How well can they understand high-level, abstract instructions? Can they translate these instructions directly into functional code, or do they still need help and supervision? In this work, we put one of the current state-of-the-art models to the test. We evaluate its performance in the task of translating abstract requirements, extracted from automotive standards and documents, into configuration code for CARLA simulations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_13263 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations Lebioda, Krzysztof Petrovic, Nenad Pan, Fengjunjie Zolfaghari, Vahid Schamschurko, Andre Knoll, Alois Software Engineering Large Language Models (LLMs) are taking many industries by storm. They possess impressive reasoning capabilities and are capable of handling complex problems, as shown by their steadily improving scores on coding and mathematical benchmarks. However, are the models currently available truly capable of addressing real-world challenges, such as those found in the automotive industry? How well can they understand high-level, abstract instructions? Can they translate these instructions directly into functional code, or do they still need help and supervision? In this work, we put one of the current state-of-the-art models to the test. We evaluate its performance in the task of translating abstract requirements, extracted from automotive standards and documents, into configuration code for CARLA simulations. |
| title | Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2505.13263 |