Generalizable Disaster Damage Assessment via Change Detection with Vision Foundation Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ahn, Kyeongjin, Han, Sungwon, Park, Sungwon, Kim, Jihee, Park, Sangyoon, Cha, Meeyoung
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917896113881088
author Ahn, Kyeongjin
Han, Sungwon
Park, Sungwon
Kim, Jihee
Park, Sangyoon
Cha, Meeyoung
author_facet Ahn, Kyeongjin
Han, Sungwon
Park, Sungwon
Kim, Jihee
Park, Sangyoon
Cha, Meeyoung
contents The increasing frequency and intensity of natural disasters call for rapid and accurate damage assessment. In response, disaster benchmark datasets from high-resolution satellite imagery have been constructed to develop methods for detecting damaged areas. However, these methods face significant challenges when applied to previously unseen regions due to the limited geographical and disaster-type diversity in the existing datasets. We introduce DAVI (Disaster Assessment with VIsion foundation model), a novel approach that addresses domain disparities and detects structural damage at the building level without requiring ground-truth labels for target regions. DAVI combines task-specific knowledge from a model trained on source regions with task-agnostic knowledge from an image segmentation model to generate pseudo labels indicating potential damage in target regions. It then utilizes a two-stage refinement process, which operate at both pixel and image levels, to accurately identify changes in disaster-affected areas. Our evaluation, including a case study on the 2023 Türkiye earthquake, demonstrates that our model achieves exceptional performance across diverse terrains (e.g., North America, Asia, and the Middle East) and disaster types (e.g., wildfires, hurricanes, and tsunamis). This confirms its robustness in disaster assessment without dependence on ground-truth labels and highlights its practical applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08020
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generalizable Disaster Damage Assessment via Change Detection with Vision Foundation Model
Ahn, Kyeongjin
Han, Sungwon
Park, Sungwon
Kim, Jihee
Park, Sangyoon
Cha, Meeyoung
Computer Vision and Pattern Recognition
The increasing frequency and intensity of natural disasters call for rapid and accurate damage assessment. In response, disaster benchmark datasets from high-resolution satellite imagery have been constructed to develop methods for detecting damaged areas. However, these methods face significant challenges when applied to previously unseen regions due to the limited geographical and disaster-type diversity in the existing datasets. We introduce DAVI (Disaster Assessment with VIsion foundation model), a novel approach that addresses domain disparities and detects structural damage at the building level without requiring ground-truth labels for target regions. DAVI combines task-specific knowledge from a model trained on source regions with task-agnostic knowledge from an image segmentation model to generate pseudo labels indicating potential damage in target regions. It then utilizes a two-stage refinement process, which operate at both pixel and image levels, to accurately identify changes in disaster-affected areas. Our evaluation, including a case study on the 2023 Türkiye earthquake, demonstrates that our model achieves exceptional performance across diverse terrains (e.g., North America, Asia, and the Middle East) and disaster types (e.g., wildfires, hurricanes, and tsunamis). This confirms its robustness in disaster assessment without dependence on ground-truth labels and highlights its practical applicability.
title Generalizable Disaster Damage Assessment via Change Detection with Vision Foundation Model
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.08020