V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard?
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917462572793856 |
|---|---|
| author | Jongwiriyanurak, Natchapon Zeng, Zichao Goo, June Moh Wang, Xinglei Ilyankou, Ilya Sriroongvikrai, Kerkritt Christie, Nicola Wang, Meihui Chen, Huanfa Haworth, James |
| author_facet | Jongwiriyanurak, Natchapon Zeng, Zichao Goo, June Moh Wang, Xinglei Ilyankou, Ilya Sriroongvikrai, Kerkritt Christie, Nicola Wang, Meihui Chen, Huanfa Haworth, James |
| contents | Road safety assessments are critical yet costly, especially in Low- and Middle-Income Countries (LMICs), where most roads remain unrated. Traditional methods require expert annotation and training data, while supervised learning-based approaches struggle to generalise across regions. In this paper, we introduce \textit{V-RoAst}, a zero-shot Visual Question Answering (VQA) framework using Vision-Language Models (VLMs) to classify road safety attributes defined by the iRAP standard. We introduce the first open-source dataset from ThaiRAP, consisting of over 2,000 curated street-level images from Thailand annotated for this task. We evaluate Gemini-1.5-flash and GPT-4o-mini on this dataset and benchmark their performance against VGGNet and ResNet baselines. While VLMs underperform on spatial awareness, they generalise well to unseen classes and offer flexible prompt-based reasoning without retraining. Our results show that VLMs can serve as automatic road assessment tools when integrated with complementary data. This work is the first to explore VLMs for zero-shot infrastructure risk assessment and opens new directions for automatic, low-cost road safety mapping. Code and dataset: https://github.com/PongNJ/V-RoAst. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_10872 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard? Jongwiriyanurak, Natchapon Zeng, Zichao Goo, June Moh Wang, Xinglei Ilyankou, Ilya Sriroongvikrai, Kerkritt Christie, Nicola Wang, Meihui Chen, Huanfa Haworth, James Computer Vision and Pattern Recognition Artificial Intelligence Emerging Technologies Road safety assessments are critical yet costly, especially in Low- and Middle-Income Countries (LMICs), where most roads remain unrated. Traditional methods require expert annotation and training data, while supervised learning-based approaches struggle to generalise across regions. In this paper, we introduce \textit{V-RoAst}, a zero-shot Visual Question Answering (VQA) framework using Vision-Language Models (VLMs) to classify road safety attributes defined by the iRAP standard. We introduce the first open-source dataset from ThaiRAP, consisting of over 2,000 curated street-level images from Thailand annotated for this task. We evaluate Gemini-1.5-flash and GPT-4o-mini on this dataset and benchmark their performance against VGGNet and ResNet baselines. While VLMs underperform on spatial awareness, they generalise well to unseen classes and offer flexible prompt-based reasoning without retraining. Our results show that VLMs can serve as automatic road assessment tools when integrated with complementary data. This work is the first to explore VLMs for zero-shot infrastructure risk assessment and opens new directions for automatic, low-cost road safety mapping. Code and dataset: https://github.com/PongNJ/V-RoAst. |
| title | V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard? |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Emerging Technologies |
| url | https://arxiv.org/abs/2408.10872 |