Cloud gap-filling with deep learning for improved grassland monitoring

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Tsardanidis, Iason, Koukos, Alkiviadis, Sitokonstantinou, Vasileios, Drivas, Thanassis, Kontoes, Charalampos
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909702794772480
author Tsardanidis, Iason
Koukos, Alkiviadis
Sitokonstantinou, Vasileios
Drivas, Thanassis
Kontoes, Charalampos
author_facet Tsardanidis, Iason
Koukos, Alkiviadis
Sitokonstantinou, Vasileios
Drivas, Thanassis
Kontoes, Charalampos
contents Uninterrupted optical image time series are crucial for the timely monitoring of agricultural land changes, particularly in grasslands. However, the continuity of such time series is often disrupted by clouds. In response to this challenge, we propose an innovative deep learning method that integrates cloud-free optical (Sentinel-2) observations and weather-independent (Sentinel-1) Synthetic Aperture Radar (SAR) data. Our approach employs a hybrid architecture combining Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to generate continuous Normalized Difference Vegetation Index (NDVI) time series, highlighting the role of NDVI in the synergy between SAR and optical data. We demonstrate the significance of observation continuity by assessing the impact of the generated NDVI time series on the downstream task of grassland mowing event detection. We conducted our study in Lithuania, a country characterized by extensive cloud coverage, and compared our approach with alternative interpolation techniques (i.e., linear, Akima, quadratic). Our method outperformed these techniques, achieving an average Mean Absolute Error (MAE) of 0.024 and a coefficient of determination R^2 of 0.92. Additionally, our analysis revealed improvement in the performance of the mowing event detection, with F1-score up to 84% using two widely applied mowing detection methodologies. Our method also effectively mitigated sudden shifts and noise originating from cloudy observations, which are often missed by conventional cloud masks and adversely affect mowing detection precision.
format Preprint
id arxiv_https___arxiv_org_abs_2403_09554
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Cloud gap-filling with deep learning for improved grassland monitoring
Tsardanidis, Iason
Koukos, Alkiviadis
Sitokonstantinou, Vasileios
Drivas, Thanassis
Kontoes, Charalampos
Computer Vision and Pattern Recognition
Image and Video Processing
Uninterrupted optical image time series are crucial for the timely monitoring of agricultural land changes, particularly in grasslands. However, the continuity of such time series is often disrupted by clouds. In response to this challenge, we propose an innovative deep learning method that integrates cloud-free optical (Sentinel-2) observations and weather-independent (Sentinel-1) Synthetic Aperture Radar (SAR) data. Our approach employs a hybrid architecture combining Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to generate continuous Normalized Difference Vegetation Index (NDVI) time series, highlighting the role of NDVI in the synergy between SAR and optical data. We demonstrate the significance of observation continuity by assessing the impact of the generated NDVI time series on the downstream task of grassland mowing event detection. We conducted our study in Lithuania, a country characterized by extensive cloud coverage, and compared our approach with alternative interpolation techniques (i.e., linear, Akima, quadratic). Our method outperformed these techniques, achieving an average Mean Absolute Error (MAE) of 0.024 and a coefficient of determination R^2 of 0.92. Additionally, our analysis revealed improvement in the performance of the mowing event detection, with F1-score up to 84% using two widely applied mowing detection methodologies. Our method also effectively mitigated sudden shifts and noise originating from cloudy observations, which are often missed by conventional cloud masks and adversely affect mowing detection precision.
title Cloud gap-filling with deep learning for improved grassland monitoring
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2403.09554