Stochastic Generative Plug-and-Play Priors

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Park, Chicago Y., Chandler, Edward P., Hu, Yuyang, McCann, Michael T., Garcia-Cardona, Cristina, Wohlberg, Brendt, Kamilov, Ulugbek S.
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915915777441792
author Park, Chicago Y.
Chandler, Edward P.
Hu, Yuyang
McCann, Michael T.
Garcia-Cardona, Cristina
Wohlberg, Brendt
Kamilov, Ulugbek S.
author_facet Park, Chicago Y.
Chandler, Edward P.
Hu, Yuyang
McCann, Michael T.
Garcia-Cardona, Cristina
Wohlberg, Brendt
Kamilov, Ulugbek S.
contents Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into optimization algorithms. Score-based diffusion models (SBDMs) have recently demonstrated strong generative performance through a denoiser trained across a wide range of noise levels. Despite their shared reliance on denoisers, it remains unclear how to systematically use SBDMs as priors within the PnP framework without relying on reverse diffusion sampling. In this paper, we establish a score-based interpretation of PnP that justifies using pretrained SBDMs directly within PnP algorithms. Building on this connection, we introduce a stochastic generative PnP (SGPnP) framework that injects noise to better leverage the expressive generative SBDM priors, thereby improving robustness in severely ill-posed inverse problems. We provide a new theory showing that this noise injection induces optimization on a Gaussian-smoothed objective and promotes escape from strict saddle points. Experiments on challenging inverse tasks, such as multi-coil MRI reconstruction and large-mask natural image inpainting, demonstrate consistent improvement over conventional PnP methods and achieve performance competitive with diffusion-based solvers.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03603
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Stochastic Generative Plug-and-Play Priors
Park, Chicago Y.
Chandler, Edward P.
Hu, Yuyang
McCann, Michael T.
Garcia-Cardona, Cristina
Wohlberg, Brendt
Kamilov, Ulugbek S.
Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into optimization algorithms. Score-based diffusion models (SBDMs) have recently demonstrated strong generative performance through a denoiser trained across a wide range of noise levels. Despite their shared reliance on denoisers, it remains unclear how to systematically use SBDMs as priors within the PnP framework without relying on reverse diffusion sampling. In this paper, we establish a score-based interpretation of PnP that justifies using pretrained SBDMs directly within PnP algorithms. Building on this connection, we introduce a stochastic generative PnP (SGPnP) framework that injects noise to better leverage the expressive generative SBDM priors, thereby improving robustness in severely ill-posed inverse problems. We provide a new theory showing that this noise injection induces optimization on a Gaussian-smoothed objective and promotes escape from strict saddle points. Experiments on challenging inverse tasks, such as multi-coil MRI reconstruction and large-mask natural image inpainting, demonstrate consistent improvement over conventional PnP methods and achieve performance competitive with diffusion-based solvers.
title Stochastic Generative Plug-and-Play Priors
topic Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
url https://arxiv.org/abs/2604.03603