Degradation-Aware Metric Prompting for Hyperspectral Image Restoration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Binfeng, Wang, Di, Guo, Haonan, Fu, Ying, Zhang, Jing
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916073090056192
author Wang, Binfeng
Wang, Di
Guo, Haonan
Fu, Ying
Zhang, Jing
author_facet Wang, Binfeng
Wang, Di
Guo, Haonan
Fu, Ying
Zhang, Jing
contents Unified hyperspectral image (HSI) restoration aims to recover diverse degradations within a single model. However, current methods often rely on impractical explicit priors or opaque black-box representations that overfit to training distributions, hampering generalization to unseen scenarios. To bridge this gap, we propose Degradation-Aware Metric Prompting (DAMP), a novel framework that characterizes multi-dimensional degradations through interpretable spatial-spectral metrics. These metrics serve as Degradation Prompts (DP), enabling the model to capture shared characteristics across tasks and adapt to unknown corruptions. Central to our framework is the Degradation-Adaptive Mixture-of-Experts (DAMoE), where Spatial-Spectral Adaptive Modules (SSAMs) serve as experts that utilize learnable fusion coefficients to specialize in distinct degradation degrees. By using DP as a gating router, DAMoE dynamically activates specialized experts tailored to the specific degradation profile. Extensive experiments on natural and remote sensing HSI datasets demonstrate that DAMP achieves state-of-the-art performance and exhibits exceptional zero-shot generalization on unseen restoration tasks. Code is publicly available at \href{DAMP}{https://github.com/MiliLab/DAMP}.
format Preprint
id arxiv_https___arxiv_org_abs_2512_20251
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Degradation-Aware Metric Prompting for Hyperspectral Image Restoration
Wang, Binfeng
Wang, Di
Guo, Haonan
Fu, Ying
Zhang, Jing
Computer Vision and Pattern Recognition
Image and Video Processing
Unified hyperspectral image (HSI) restoration aims to recover diverse degradations within a single model. However, current methods often rely on impractical explicit priors or opaque black-box representations that overfit to training distributions, hampering generalization to unseen scenarios. To bridge this gap, we propose Degradation-Aware Metric Prompting (DAMP), a novel framework that characterizes multi-dimensional degradations through interpretable spatial-spectral metrics. These metrics serve as Degradation Prompts (DP), enabling the model to capture shared characteristics across tasks and adapt to unknown corruptions. Central to our framework is the Degradation-Adaptive Mixture-of-Experts (DAMoE), where Spatial-Spectral Adaptive Modules (SSAMs) serve as experts that utilize learnable fusion coefficients to specialize in distinct degradation degrees. By using DP as a gating router, DAMoE dynamically activates specialized experts tailored to the specific degradation profile. Extensive experiments on natural and remote sensing HSI datasets demonstrate that DAMP achieves state-of-the-art performance and exhibits exceptional zero-shot generalization on unseen restoration tasks. Code is publicly available at \href{DAMP}{https://github.com/MiliLab/DAMP}.
title Degradation-Aware Metric Prompting for Hyperspectral Image Restoration
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2512.20251