Robust Disaster Assessment from Aerial Imagery Using Text-to-Image Synthetic Data
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929354094673920 |
|---|---|
| author | Kalluri, Tarun Lee, Jihyeon Sohn, Kihyuk Singla, Sahil Chandraker, Manmohan Xu, Joseph Liu, Jeremiah |
| author_facet | Kalluri, Tarun Lee, Jihyeon Sohn, Kihyuk Singla, Sahil Chandraker, Manmohan Xu, Joseph Liu, Jeremiah |
| contents | We present a simple and efficient method to leverage emerging text-to-image generative models in creating large-scale synthetic supervision for the task of damage assessment from aerial images. While significant recent advances have resulted in improved techniques for damage assessment using aerial or satellite imagery, they still suffer from poor robustness to domains where manual labeled data is unavailable, directly impacting post-disaster humanitarian assistance in such under-resourced geographies. Our contribution towards improving domain robustness in this scenario is two-fold. Firstly, we leverage the text-guided mask-based image editing capabilities of generative models and build an efficient and easily scalable pipeline to generate thousands of post-disaster images from low-resource domains. Secondly, we propose a simple two-stage training approach to train robust models while using manual supervision from different source domains along with the generated synthetic target domain data. We validate the strength of our proposed framework under cross-geography domain transfer setting from xBD and SKAI images in both single-source and multi-source settings, achieving significant improvements over a source-only baseline in each case. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_13779 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Robust Disaster Assessment from Aerial Imagery Using Text-to-Image Synthetic Data Kalluri, Tarun Lee, Jihyeon Sohn, Kihyuk Singla, Sahil Chandraker, Manmohan Xu, Joseph Liu, Jeremiah Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning We present a simple and efficient method to leverage emerging text-to-image generative models in creating large-scale synthetic supervision for the task of damage assessment from aerial images. While significant recent advances have resulted in improved techniques for damage assessment using aerial or satellite imagery, they still suffer from poor robustness to domains where manual labeled data is unavailable, directly impacting post-disaster humanitarian assistance in such under-resourced geographies. Our contribution towards improving domain robustness in this scenario is two-fold. Firstly, we leverage the text-guided mask-based image editing capabilities of generative models and build an efficient and easily scalable pipeline to generate thousands of post-disaster images from low-resource domains. Secondly, we propose a simple two-stage training approach to train robust models while using manual supervision from different source domains along with the generated synthetic target domain data. We validate the strength of our proposed framework under cross-geography domain transfer setting from xBD and SKAI images in both single-source and multi-source settings, achieving significant improvements over a source-only baseline in each case. |
| title | Robust Disaster Assessment from Aerial Imagery Using Text-to-Image Synthetic Data |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2405.13779 |