Mind the Gap: Evaluating LLM Understanding of Human-Taught Road Safety Principles
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917086632083456 |
|---|---|
| author | Kranti, Chalamalasetti |
| author_facet | Kranti, Chalamalasetti |
| contents | Following road safety norms is non-negotiable not only for humans but also for the AI systems that govern autonomous vehicles. In this work, we evaluate how well multi-modal large language models (LLMs) understand road safety concepts, specifically through schematic and illustrative representations. We curate a pilot dataset of images depicting traffic signs and road-safety norms sourced from school text books and use it to evaluate models capabilities in a zero-shot setting. Our preliminary results show that these models struggle with safety reasoning and reveal gaps between human learning and model interpretation. We further provide an analysis of these performance gaps for future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_13909 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Mind the Gap: Evaluating LLM Understanding of Human-Taught Road Safety Principles Kranti, Chalamalasetti Computer Vision and Pattern Recognition Following road safety norms is non-negotiable not only for humans but also for the AI systems that govern autonomous vehicles. In this work, we evaluate how well multi-modal large language models (LLMs) understand road safety concepts, specifically through schematic and illustrative representations. We curate a pilot dataset of images depicting traffic signs and road-safety norms sourced from school text books and use it to evaluate models capabilities in a zero-shot setting. Our preliminary results show that these models struggle with safety reasoning and reveal gaps between human learning and model interpretation. We further provide an analysis of these performance gaps for future research. |
| title | Mind the Gap: Evaluating LLM Understanding of Human-Taught Road Safety Principles |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2511.13909 |