Damage Assessment after Natural Disasters with UAVs: Semantic Feature Extraction using Deep Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hewawiththi, Nethmi S., Viduranga, M. Mahesha, Warnasooriya, Vanodhya G., Fernando, Tharindu, Suraweera, Himal A., Sridharan, Sridha, Fookes, Clinton
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912156349366272
author Hewawiththi, Nethmi S.
Viduranga, M. Mahesha
Warnasooriya, Vanodhya G.
Fernando, Tharindu
Suraweera, Himal A.
Sridharan, Sridha
Fookes, Clinton
author_facet Hewawiththi, Nethmi S.
Viduranga, M. Mahesha
Warnasooriya, Vanodhya G.
Fernando, Tharindu
Suraweera, Himal A.
Sridharan, Sridha
Fookes, Clinton
contents Unmanned aerial vehicle-assisted disaster recovery missions have been promoted recently due to their reliability and flexibility. Machine learning algorithms running onboard significantly enhance the utility of UAVs by enabling real-time data processing and efficient decision-making, despite being in a resource-constrained environment. However, the limited bandwidth and intermittent connectivity make transmitting the outputs to ground stations challenging. This paper proposes a novel semantic extractor that can be adopted into any machine learning downstream task for identifying the critical data required for decision-making. The semantic extractor can be executed onboard which results in a reduction of data that needs to be transmitted to ground stations. We test the proposed architecture together with the semantic extractor on two publicly available datasets, FloodNet and RescueNet, for two downstream tasks: visual question answering and disaster damage level classification. Our experimental results demonstrate the proposed method maintains high accuracy across different downstream tasks while significantly reducing the volume of transmitted data, highlighting the effectiveness of our semantic extractor in capturing task-specific salient information.
format Preprint
id arxiv_https___arxiv_org_abs_2412_10756
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Damage Assessment after Natural Disasters with UAVs: Semantic Feature Extraction using Deep Learning
Hewawiththi, Nethmi S.
Viduranga, M. Mahesha
Warnasooriya, Vanodhya G.
Fernando, Tharindu
Suraweera, Himal A.
Sridharan, Sridha
Fookes, Clinton
Computer Vision and Pattern Recognition
Machine Learning
Unmanned aerial vehicle-assisted disaster recovery missions have been promoted recently due to their reliability and flexibility. Machine learning algorithms running onboard significantly enhance the utility of UAVs by enabling real-time data processing and efficient decision-making, despite being in a resource-constrained environment. However, the limited bandwidth and intermittent connectivity make transmitting the outputs to ground stations challenging. This paper proposes a novel semantic extractor that can be adopted into any machine learning downstream task for identifying the critical data required for decision-making. The semantic extractor can be executed onboard which results in a reduction of data that needs to be transmitted to ground stations. We test the proposed architecture together with the semantic extractor on two publicly available datasets, FloodNet and RescueNet, for two downstream tasks: visual question answering and disaster damage level classification. Our experimental results demonstrate the proposed method maintains high accuracy across different downstream tasks while significantly reducing the volume of transmitted data, highlighting the effectiveness of our semantic extractor in capturing task-specific salient information.
title Damage Assessment after Natural Disasters with UAVs: Semantic Feature Extraction using Deep Learning
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2412.10756