Data Augmentation in Earth Observation: A Diffusion Model Approach

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sousa, Tiago, Ries, Benoît, Guelfi, Nicolas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913758493802496
author Sousa, Tiago
Ries, Benoît
Guelfi, Nicolas
author_facet Sousa, Tiago
Ries, Benoît
Guelfi, Nicolas
contents High-quality Earth Observation (EO) imagery is essential for accurate analysis and informed decision making across sectors. However, data scarcity caused by atmospheric conditions, seasonal variations, and limited geographical coverage hinders the effective application of Artificial Intelligence (AI) in EO. Traditional data augmentation techniques, which rely on basic parameterized image transformations, often fail to introduce sufficient diversity across key semantic axes. These axes include natural changes such as snow and floods, human impacts like urbanization and roads, and disasters such as wildfires and storms, which limits the accuracy of AI models in EO applications. To address this, we propose a four-stage data augmentation approach that integrates diffusion models to enhance semantic diversity. Our method employs meta-prompts for instruction generation, vision-language models for rich captioning, EO-specific diffusion model fine-tuning, and iterative data augmentation. Extensive experiments using four augmentation techniques demonstrate that our approach consistently outperforms established methods, generating semantically diverse EO images and improving AI model performance.
format Preprint
id arxiv_https___arxiv_org_abs_2406_06218
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data Augmentation in Earth Observation: A Diffusion Model Approach
Sousa, Tiago
Ries, Benoît
Guelfi, Nicolas
Computer Vision and Pattern Recognition
Artificial Intelligence
Software Engineering
I.4.9; I.4.9; I.2.m
High-quality Earth Observation (EO) imagery is essential for accurate analysis and informed decision making across sectors. However, data scarcity caused by atmospheric conditions, seasonal variations, and limited geographical coverage hinders the effective application of Artificial Intelligence (AI) in EO. Traditional data augmentation techniques, which rely on basic parameterized image transformations, often fail to introduce sufficient diversity across key semantic axes. These axes include natural changes such as snow and floods, human impacts like urbanization and roads, and disasters such as wildfires and storms, which limits the accuracy of AI models in EO applications. To address this, we propose a four-stage data augmentation approach that integrates diffusion models to enhance semantic diversity. Our method employs meta-prompts for instruction generation, vision-language models for rich captioning, EO-specific diffusion model fine-tuning, and iterative data augmentation. Extensive experiments using four augmentation techniques demonstrate that our approach consistently outperforms established methods, generating semantically diverse EO images and improving AI model performance.
title Data Augmentation in Earth Observation: A Diffusion Model Approach
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Software Engineering
I.4.9; I.4.9; I.2.m
url https://arxiv.org/abs/2406.06218