Integration of Large Vision Language Models for Efficient Post-disaster Damage Assessment and Reporting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Zhaohui, Shamsabadi, Elyas Asadi, Jiang, Sheng, Shen, Luming, Dias-da-Costa, Daniel
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915003457601536
author Chen, Zhaohui
Shamsabadi, Elyas Asadi
Jiang, Sheng
Shen, Luming
Dias-da-Costa, Daniel
author_facet Chen, Zhaohui
Shamsabadi, Elyas Asadi
Jiang, Sheng
Shen, Luming
Dias-da-Costa, Daniel
contents Traditional natural disaster response involves significant coordinated teamwork where speed and efficiency are key. Nonetheless, human limitations can delay critical actions and inadvertently increase human and economic losses. Agentic Large Vision Language Models (LVLMs) offer a new avenue to address this challenge, with the potential for substantial socio-economic impact, particularly by improving resilience and resource access in underdeveloped regions. We introduce DisasTeller, the first multi-LVLM-powered framework designed to automate tasks in post-disaster management, including on-site assessment, emergency alerts, resource allocation, and recovery planning. By coordinating four specialised LVLM agents with GPT-4 as the core model, DisasTeller autonomously implements disaster response activities, reducing human execution time and optimising resource distribution. Our evaluations through both LVLMs and humans demonstrate DisasTeller's effectiveness in streamlining disaster response. This framework not only supports expert teams but also simplifies access to disaster management processes for non-experts, bridging the gap between traditional response methods and LVLM-driven efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2411_01511
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Integration of Large Vision Language Models for Efficient Post-disaster Damage Assessment and Reporting
Chen, Zhaohui
Shamsabadi, Elyas Asadi
Jiang, Sheng
Shen, Luming
Dias-da-Costa, Daniel
Multiagent Systems
Computation and Language
Traditional natural disaster response involves significant coordinated teamwork where speed and efficiency are key. Nonetheless, human limitations can delay critical actions and inadvertently increase human and economic losses. Agentic Large Vision Language Models (LVLMs) offer a new avenue to address this challenge, with the potential for substantial socio-economic impact, particularly by improving resilience and resource access in underdeveloped regions. We introduce DisasTeller, the first multi-LVLM-powered framework designed to automate tasks in post-disaster management, including on-site assessment, emergency alerts, resource allocation, and recovery planning. By coordinating four specialised LVLM agents with GPT-4 as the core model, DisasTeller autonomously implements disaster response activities, reducing human execution time and optimising resource distribution. Our evaluations through both LVLMs and humans demonstrate DisasTeller's effectiveness in streamlining disaster response. This framework not only supports expert teams but also simplifies access to disaster management processes for non-experts, bridging the gap between traditional response methods and LVLM-driven efficiency.
title Integration of Large Vision Language Models for Efficient Post-disaster Damage Assessment and Reporting
topic Multiagent Systems
Computation and Language
url https://arxiv.org/abs/2411.01511