M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Shiwei, Wang, Yongzhen, Hu, Bingwen, Zhang, Liyan, Zhang, Xiao-Ping, Wei, Mingqiang
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908888051220480
author Wang, Shiwei
Wang, Yongzhen
Hu, Bingwen
Zhang, Liyan
Zhang, Xiao-Ping
Wei, Mingqiang
author_facet Wang, Shiwei
Wang, Yongzhen
Hu, Bingwen
Zhang, Liyan
Zhang, Xiao-Ping
Wei, Mingqiang
contents While Transformer-based architectures have dominated recent advances in all-in-one image restoration, they remain fundamentally reactive: propagating degradations rather than proactively suppressing them. In the absence of explicit suppression mechanisms, degraded signals interfere with feature learning, compelling the decoder to balance artifact removal and detail preservation, thereby increasing model complexity and limiting adaptability. To address these challenges, we propose M2IR, a novel restoration framework that proactively regulates degradation propagation during the encoding stage and efficiently eliminates residual degradations during decoding. Specifically, the Mamba-Style Transformer (MST) block performs pixel-wise selective state modulation to mitigate degradations while preserving structural integrity. In parallel, the Adaptive Degradation Expert Collaboration (ADEC) module utilizes degradation-specific experts guided by a DA-CLIP-driven router and complemented by a shared expert to eliminate residual degradations through targeted and cooperative restoration. By integrating the MST block and ADEC module, M2IR transitions from passive reaction to active degradation control, effectively harnessing learned representations to achieve superior generalization, enhanced adaptability, and refined recovery of fine-grained details across diverse all-in-one image restoration benchmarks. Our source codes are available at https://github.com/Im34v/M2IR.
format Preprint
id arxiv_https___arxiv_org_abs_2603_14816
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts
Wang, Shiwei
Wang, Yongzhen
Hu, Bingwen
Zhang, Liyan
Zhang, Xiao-Ping
Wei, Mingqiang
Computer Vision and Pattern Recognition
While Transformer-based architectures have dominated recent advances in all-in-one image restoration, they remain fundamentally reactive: propagating degradations rather than proactively suppressing them. In the absence of explicit suppression mechanisms, degraded signals interfere with feature learning, compelling the decoder to balance artifact removal and detail preservation, thereby increasing model complexity and limiting adaptability. To address these challenges, we propose M2IR, a novel restoration framework that proactively regulates degradation propagation during the encoding stage and efficiently eliminates residual degradations during decoding. Specifically, the Mamba-Style Transformer (MST) block performs pixel-wise selective state modulation to mitigate degradations while preserving structural integrity. In parallel, the Adaptive Degradation Expert Collaboration (ADEC) module utilizes degradation-specific experts guided by a DA-CLIP-driven router and complemented by a shared expert to eliminate residual degradations through targeted and cooperative restoration. By integrating the MST block and ADEC module, M2IR transitions from passive reaction to active degradation control, effectively harnessing learned representations to achieve superior generalization, enhanced adaptability, and refined recovery of fine-grained details across diverse all-in-one image restoration benchmarks. Our source codes are available at https://github.com/Im34v/M2IR.
title M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.14816