Effective Damage Data Generation by Fusing Imagery with Human Knowledge Using Vision-Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915423137562624 |
|---|---|
| author | Wei, Jie Ardiles-Cruz, Erika Panasyuk, Aleksey Blasch, Erik |
| author_facet | Wei, Jie Ardiles-Cruz, Erika Panasyuk, Aleksey Blasch, Erik |
| contents | It is of crucial importance to assess damages promptly and accurately in humanitarian assistance and disaster response (HADR). Current deep learning approaches struggle to generalize effectively due to the imbalance of data classes, scarcity of moderate damage examples, and human inaccuracy in pixel labeling during HADR situations. To accommodate for these limitations and exploit state-of-the-art techniques in vision-language models (VLMs) to fuse imagery with human knowledge understanding, there is an opportunity to generate a diversified set of image-based damage data effectively. Our initial experimental results suggest encouraging data generation quality, which demonstrates an improvement in classifying scenes with different levels of structural damage to buildings, roads, and infrastructures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_01380 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Effective Damage Data Generation by Fusing Imagery with Human Knowledge Using Vision-Language Models Wei, Jie Ardiles-Cruz, Erika Panasyuk, Aleksey Blasch, Erik Computer Vision and Pattern Recognition Artificial Intelligence It is of crucial importance to assess damages promptly and accurately in humanitarian assistance and disaster response (HADR). Current deep learning approaches struggle to generalize effectively due to the imbalance of data classes, scarcity of moderate damage examples, and human inaccuracy in pixel labeling during HADR situations. To accommodate for these limitations and exploit state-of-the-art techniques in vision-language models (VLMs) to fuse imagery with human knowledge understanding, there is an opportunity to generate a diversified set of image-based damage data effectively. Our initial experimental results suggest encouraging data generation quality, which demonstrates an improvement in classifying scenes with different levels of structural damage to buildings, roads, and infrastructures. |
| title | Effective Damage Data Generation by Fusing Imagery with Human Knowledge Using Vision-Language Models |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2508.01380 |