Physically Interpretable Multi-Degradation Image Restoration via Deep Unfolding and Explainable Convolution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Hu, Lei, Xiaoning, Xu, Xichen, Dang, Depeng, Ma, Lizhuang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909900540477440
author Gao, Hu
Lei, Xiaoning
Xu, Xichen
Dang, Depeng
Ma, Lizhuang
author_facet Gao, Hu
Lei, Xiaoning
Xu, Xichen
Dang, Depeng
Ma, Lizhuang
contents Although image restoration has advanced significantly, most existing methods target only a single type of degradation. In real-world scenarios, images often contain multiple degradations simultaneously, such as rain, noise, and haze, requiring models capable of handling diverse degradation types. Moreover, methods that improve performance through module stacking often suffer from limited interpretability. In this paper, we propose a novel interpretability-driven approach for multi-degradation image restoration, built upon a deep unfolding network that maps the iterative process of a mathematical optimization algorithm into a learnable network structure. Specifically, we employ an improved second-order semi-smooth Newton algorithm to ensure that each module maintains clear physical interpretability. To further enhance interpretability and adaptability, we design an explainable convolution module inspired by the human brain's flexible information processing and the intrinsic characteristics of images, allowing the network to flexibly leverage learned knowledge and autonomously adjust parameters for different input. The resulting tightly integrated architecture, named InterIR, demonstrates excellent performance in multi-degradation restoration while remaining highly competitive on single-degradation tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2511_10166
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Physically Interpretable Multi-Degradation Image Restoration via Deep Unfolding and Explainable Convolution
Gao, Hu
Lei, Xiaoning
Xu, Xichen
Dang, Depeng
Ma, Lizhuang
Computer Vision and Pattern Recognition
Although image restoration has advanced significantly, most existing methods target only a single type of degradation. In real-world scenarios, images often contain multiple degradations simultaneously, such as rain, noise, and haze, requiring models capable of handling diverse degradation types. Moreover, methods that improve performance through module stacking often suffer from limited interpretability. In this paper, we propose a novel interpretability-driven approach for multi-degradation image restoration, built upon a deep unfolding network that maps the iterative process of a mathematical optimization algorithm into a learnable network structure. Specifically, we employ an improved second-order semi-smooth Newton algorithm to ensure that each module maintains clear physical interpretability. To further enhance interpretability and adaptability, we design an explainable convolution module inspired by the human brain's flexible information processing and the intrinsic characteristics of images, allowing the network to flexibly leverage learned knowledge and autonomously adjust parameters for different input. The resulting tightly integrated architecture, named InterIR, demonstrates excellent performance in multi-degradation restoration while remaining highly competitive on single-degradation tasks.
title Physically Interpretable Multi-Degradation Image Restoration via Deep Unfolding and Explainable Convolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.10166