Deep Learning for In-Orbit Cloud Segmentation and Classification in Hyperspectral Satellite Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kovac, Daniel, Mucha, Jan, Justo, Jon Alvarez, Mekyska, Jiri, Galaz, Zoltan, Novotny, Krystof, Pitonak, Radoslav, Knezik, Jan, Herec, Jonas, Johansen, Tor Arne
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929275106492416
author Kovac, Daniel
Mucha, Jan
Justo, Jon Alvarez
Mekyska, Jiri
Galaz, Zoltan
Novotny, Krystof
Pitonak, Radoslav
Knezik, Jan
Herec, Jonas
Johansen, Tor Arne
author_facet Kovac, Daniel
Mucha, Jan
Justo, Jon Alvarez
Mekyska, Jiri
Galaz, Zoltan
Novotny, Krystof
Pitonak, Radoslav
Knezik, Jan
Herec, Jonas
Johansen, Tor Arne
contents This article explores the latest Convolutional Neural Networks (CNNs) for cloud detection aboard hyperspectral satellites. The performance of the latest 1D CNN (1D-Justo-LiuNet) and two recent 2D CNNs (nnU-net and 2D-Justo-UNet-Simple) for cloud segmentation and classification is assessed. Evaluation criteria include precision and computational efficiency for in-orbit deployment. Experiments utilize NASA's EO-1 Hyperion data, with varying spectral channel numbers after Principal Component Analysis. Results indicate that 1D-Justo-LiuNet achieves the highest accuracy, outperforming 2D CNNs, while maintaining compactness with larger spectral channel sets, albeit with increased inference times. However, the performance of 1D CNN degrades with significant channel reduction. In this context, the 2D-Justo-UNet-Simple offers the best balance for in-orbit deployment, considering precision, memory, and time costs. While nnU-net is suitable for on-ground processing, deployment of lightweight 1D-Justo-LiuNet is recommended for high-precision applications. Alternatively, lightweight 2D-Justo-UNet-Simple is recommended for balanced costs between timing and precision in orbit.
format Preprint
id arxiv_https___arxiv_org_abs_2403_08695
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Learning for In-Orbit Cloud Segmentation and Classification in Hyperspectral Satellite Data
Kovac, Daniel
Mucha, Jan
Justo, Jon Alvarez
Mekyska, Jiri
Galaz, Zoltan
Novotny, Krystof
Pitonak, Radoslav
Knezik, Jan
Herec, Jonas
Johansen, Tor Arne
Computer Vision and Pattern Recognition
Image and Video Processing
This article explores the latest Convolutional Neural Networks (CNNs) for cloud detection aboard hyperspectral satellites. The performance of the latest 1D CNN (1D-Justo-LiuNet) and two recent 2D CNNs (nnU-net and 2D-Justo-UNet-Simple) for cloud segmentation and classification is assessed. Evaluation criteria include precision and computational efficiency for in-orbit deployment. Experiments utilize NASA's EO-1 Hyperion data, with varying spectral channel numbers after Principal Component Analysis. Results indicate that 1D-Justo-LiuNet achieves the highest accuracy, outperforming 2D CNNs, while maintaining compactness with larger spectral channel sets, albeit with increased inference times. However, the performance of 1D CNN degrades with significant channel reduction. In this context, the 2D-Justo-UNet-Simple offers the best balance for in-orbit deployment, considering precision, memory, and time costs. While nnU-net is suitable for on-ground processing, deployment of lightweight 1D-Justo-LiuNet is recommended for high-precision applications. Alternatively, lightweight 2D-Justo-UNet-Simple is recommended for balanced costs between timing and precision in orbit.
title Deep Learning for In-Orbit Cloud Segmentation and Classification in Hyperspectral Satellite Data
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2403.08695