IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Hanting, Jin, Tao, Lin, Wang, Wang, Shulei, Huang, Hai, Ji, Shengpeng, Zhao, Zhou
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916768641974272
author Wang, Hanting
Jin, Tao
Lin, Wang
Wang, Shulei
Huang, Hai
Ji, Shengpeng
Zhao, Zhou
author_facet Wang, Hanting
Jin, Tao
Lin, Wang
Wang, Shulei
Huang, Hai
Ji, Shengpeng
Zhao, Zhou
contents Bridge models in image restoration construct a diffusion process from degraded to clear images. However, existing methods typically require training a bridge model from scratch for each specific type of degradation, resulting in high computational costs and limited performance. This work aims to efficiently leverage pretrained generative priors within existing image restoration bridges to eliminate this requirement. The main challenge is that standard generative models are typically designed for a diffusion process that starts from pure noise, while restoration tasks begin with a low-quality image, resulting in a mismatch in the state distributions between the two processes. To address this challenge, we propose a transition equation that bridges two diffusion processes with the same endpoint distribution. Based on this, we introduce the IRBridge framework, which enables the direct utilization of generative models within image restoration bridges, offering a more flexible and adaptable approach to image restoration. Extensive experiments on six image restoration tasks demonstrate that IRBridge efficiently integrates generative priors, resulting in improved robustness and generalization performance. Code will be available at GitHub.
format Preprint
id arxiv_https___arxiv_org_abs_2505_24406
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models
Wang, Hanting
Jin, Tao
Lin, Wang
Wang, Shulei
Huang, Hai
Ji, Shengpeng
Zhao, Zhou
Computer Vision and Pattern Recognition
Bridge models in image restoration construct a diffusion process from degraded to clear images. However, existing methods typically require training a bridge model from scratch for each specific type of degradation, resulting in high computational costs and limited performance. This work aims to efficiently leverage pretrained generative priors within existing image restoration bridges to eliminate this requirement. The main challenge is that standard generative models are typically designed for a diffusion process that starts from pure noise, while restoration tasks begin with a low-quality image, resulting in a mismatch in the state distributions between the two processes. To address this challenge, we propose a transition equation that bridges two diffusion processes with the same endpoint distribution. Based on this, we introduce the IRBridge framework, which enables the direct utilization of generative models within image restoration bridges, offering a more flexible and adaptable approach to image restoration. Extensive experiments on six image restoration tasks demonstrate that IRBridge efficiently integrates generative priors, resulting in improved robustness and generalization performance. Code will be available at GitHub.
title IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.24406