A Deep Unfolding Framework for Diffractive Snapshot Spectral Imaging

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhuge, Zhengyue, Xu, Jiahui, Chen, Shiqi, Xu, Hao, Chen, Yueting, Xu, Zhihai, Feng, Huajun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908437309292544
author Zhuge, Zhengyue
Xu, Jiahui
Chen, Shiqi
Xu, Hao
Chen, Yueting
Xu, Zhihai
Feng, Huajun
author_facet Zhuge, Zhengyue
Xu, Jiahui
Chen, Shiqi
Xu, Hao
Chen, Yueting
Xu, Zhihai
Feng, Huajun
contents Snapshot hyperspectral imaging systems acquire spectral data cubes through compressed sensing. Recently, diffractive snapshot spectral imaging (DSSI) methods have attracted significant attention. While various optical designs and improvements continue to emerge, research on reconstruction algorithms remains limited. Although numerous networks and deep unfolding methods have been applied on similar tasks, they are not fully compatible with DSSI systems because of their distinct optical encoding mechanism. In this paper, we propose an efficient deep unfolding framework for diffractive systems, termed diffractive deep unfolding (DDU). Specifically, we derive an analytical solution for the data fidelity term in DSSI, ensuring both the efficiency and the effectiveness during the iterative reconstruction process. Given the severely ill-posed nature of the problem, we employ a network-based initialization strategy rather than non-learning-based methods or linear layers, leading to enhanced stability and performance. Our framework demonstrates strong compatibility with existing state-of-the-art (SOTA) models, which effectively address the initialization and prior subproblem. Extensive experiments validate the superiority of the proposed DDU framework, showcasing improved performance while maintaining comparable parameter counts and computational complexity. These results suggest that DDU provides a solid foundation for future unfolding-based methods in DSSI.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04622
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Deep Unfolding Framework for Diffractive Snapshot Spectral Imaging
Zhuge, Zhengyue
Xu, Jiahui
Chen, Shiqi
Xu, Hao
Chen, Yueting
Xu, Zhihai
Feng, Huajun
Image and Video Processing
Computer Vision and Pattern Recognition
Snapshot hyperspectral imaging systems acquire spectral data cubes through compressed sensing. Recently, diffractive snapshot spectral imaging (DSSI) methods have attracted significant attention. While various optical designs and improvements continue to emerge, research on reconstruction algorithms remains limited. Although numerous networks and deep unfolding methods have been applied on similar tasks, they are not fully compatible with DSSI systems because of their distinct optical encoding mechanism. In this paper, we propose an efficient deep unfolding framework for diffractive systems, termed diffractive deep unfolding (DDU). Specifically, we derive an analytical solution for the data fidelity term in DSSI, ensuring both the efficiency and the effectiveness during the iterative reconstruction process. Given the severely ill-posed nature of the problem, we employ a network-based initialization strategy rather than non-learning-based methods or linear layers, leading to enhanced stability and performance. Our framework demonstrates strong compatibility with existing state-of-the-art (SOTA) models, which effectively address the initialization and prior subproblem. Extensive experiments validate the superiority of the proposed DDU framework, showcasing improved performance while maintaining comparable parameter counts and computational complexity. These results suggest that DDU provides a solid foundation for future unfolding-based methods in DSSI.
title A Deep Unfolding Framework for Diffractive Snapshot Spectral Imaging
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.04622