Flow-Matching Guided Deep Unfolding for Hyperspectral Image Reconstruction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ai, Yi, Cai, Yuanhao, Zhang, Yulun, Yang, Xiaokang
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912623112486912
author Ai, Yi
Cai, Yuanhao
Zhang, Yulun
Yang, Xiaokang
author_facet Ai, Yi
Cai, Yuanhao
Zhang, Yulun
Yang, Xiaokang
contents Hyperspectral imaging (HSI) provides rich spatial-spectral information but remains costly to acquire due to hardware limitations and the difficulty of reconstructing three-dimensional data from compressed measurements. Although compressive sensing systems such as CASSI improve efficiency, accurate reconstruction is still challenged by severe degradation and loss of fine spectral details. We propose the Flow-Matching-guided Unfolding network (FMU), which, to our knowledge, is the first to integrate flow matching into HSI reconstruction by embedding its generative prior within a deep unfolding framework. To further strengthen the learned dynamics, we introduce a mean velocity loss that enforces global consistency of the flow, leading to a more robust and accurate reconstruction. This hybrid design leverages the interpretability of optimization-based methods and the generative capacity of flow matching. Extensive experiments on both simulated and real datasets show that FMU significantly outperforms existing approaches in reconstruction quality. Code and models will be available at https://github.com/YiAi03/FMU.
format Preprint
id arxiv_https___arxiv_org_abs_2510_01912
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Flow-Matching Guided Deep Unfolding for Hyperspectral Image Reconstruction
Ai, Yi
Cai, Yuanhao
Zhang, Yulun
Yang, Xiaokang
Computer Vision and Pattern Recognition
Hyperspectral imaging (HSI) provides rich spatial-spectral information but remains costly to acquire due to hardware limitations and the difficulty of reconstructing three-dimensional data from compressed measurements. Although compressive sensing systems such as CASSI improve efficiency, accurate reconstruction is still challenged by severe degradation and loss of fine spectral details. We propose the Flow-Matching-guided Unfolding network (FMU), which, to our knowledge, is the first to integrate flow matching into HSI reconstruction by embedding its generative prior within a deep unfolding framework. To further strengthen the learned dynamics, we introduce a mean velocity loss that enforces global consistency of the flow, leading to a more robust and accurate reconstruction. This hybrid design leverages the interpretability of optimization-based methods and the generative capacity of flow matching. Extensive experiments on both simulated and real datasets show that FMU significantly outperforms existing approaches in reconstruction quality. Code and models will be available at https://github.com/YiAi03/FMU.
title Flow-Matching Guided Deep Unfolding for Hyperspectral Image Reconstruction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.01912