Onboard Hyperspectral Super-Resolution with Deep Pushbroom Neural Network

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Piccinini, Davide, Valsesia, Diego, Magli, Enrico
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917070131691520
author Piccinini, Davide
Valsesia, Diego
Magli, Enrico
author_facet Piccinini, Davide
Valsesia, Diego
Magli, Enrico
contents Hyperspectral imagers on satellites obtain the fine spectral signatures essential for distinguishing one material from another at the expense of limited spatial resolution. Enhancing the latter is thus a desirable preprocessing step in order to further improve the detection capabilities offered by hyperspectral images on downstream tasks. At the same time, there is a growing interest towards deploying inference methods directly onboard of satellites, which calls for lightweight image super-resolution methods that can be run on the payload in real time. In this paper, we present a novel neural network design, called Deep Pushbroom Super-Resolution (DPSR) that matches the pushbroom acquisition of hyperspectral sensors by processing an image line by line in the along-track direction with a causal memory mechanism to exploit previously acquired lines. This design greatly limits memory requirements and computational complexity, achieving onboard real-time performance, i.e., the ability to super-resolve a line in the time it takes to acquire the next one, on low-power hardware. Experiments show that the quality of the super-resolved images is competitive or even outperforms state-of-the-art methods that are significantly more complex.
format Preprint
id arxiv_https___arxiv_org_abs_2507_20765
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Onboard Hyperspectral Super-Resolution with Deep Pushbroom Neural Network
Piccinini, Davide
Valsesia, Diego
Magli, Enrico
Image and Video Processing
Computer Vision and Pattern Recognition
Hyperspectral imagers on satellites obtain the fine spectral signatures essential for distinguishing one material from another at the expense of limited spatial resolution. Enhancing the latter is thus a desirable preprocessing step in order to further improve the detection capabilities offered by hyperspectral images on downstream tasks. At the same time, there is a growing interest towards deploying inference methods directly onboard of satellites, which calls for lightweight image super-resolution methods that can be run on the payload in real time. In this paper, we present a novel neural network design, called Deep Pushbroom Super-Resolution (DPSR) that matches the pushbroom acquisition of hyperspectral sensors by processing an image line by line in the along-track direction with a causal memory mechanism to exploit previously acquired lines. This design greatly limits memory requirements and computational complexity, achieving onboard real-time performance, i.e., the ability to super-resolve a line in the time it takes to acquire the next one, on low-power hardware. Experiments show that the quality of the super-resolved images is competitive or even outperforms state-of-the-art methods that are significantly more complex.
title Onboard Hyperspectral Super-Resolution with Deep Pushbroom Neural Network
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.20765