Plug-and-Play image restoration with Stochastic deNOising REgularization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Renaud, Marien, Prost, Jean, Leclaire, Arthur, Papadakis, Nicolas
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910999157669888
author Renaud, Marien
Prost, Jean
Leclaire, Arthur
Papadakis, Nicolas
author_facet Renaud, Marien
Prost, Jean
Leclaire, Arthur
Papadakis, Nicolas
contents Plug-and-Play (PnP) algorithms are a class of iterative algorithms that address image inverse problems by combining a physical model and a deep neural network for regularization. Even if they produce impressive image restoration results, these algorithms rely on a non-standard use of a denoiser on images that are less and less noisy along the iterations, which contrasts with recent algorithms based on Diffusion Models (DM), where the denoiser is applied only on re-noised images. We propose a new PnP framework, called Stochastic deNOising REgularization (SNORE), which applies the denoiser only on images with noise of the adequate level. It is based on an explicit stochastic regularization, which leads to a stochastic gradient descent algorithm to solve ill-posed inverse problems. A convergence analysis of this algorithm and its annealing extension is provided. Experimentally, we prove that SNORE is competitive with respect to state-of-the-art methods on deblurring and inpainting tasks, both quantitatively and qualitatively.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01779
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Plug-and-Play image restoration with Stochastic deNOising REgularization
Renaud, Marien
Prost, Jean
Leclaire, Arthur
Papadakis, Nicolas
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Plug-and-Play (PnP) algorithms are a class of iterative algorithms that address image inverse problems by combining a physical model and a deep neural network for regularization. Even if they produce impressive image restoration results, these algorithms rely on a non-standard use of a denoiser on images that are less and less noisy along the iterations, which contrasts with recent algorithms based on Diffusion Models (DM), where the denoiser is applied only on re-noised images. We propose a new PnP framework, called Stochastic deNOising REgularization (SNORE), which applies the denoiser only on images with noise of the adequate level. It is based on an explicit stochastic regularization, which leads to a stochastic gradient descent algorithm to solve ill-posed inverse problems. A convergence analysis of this algorithm and its annealing extension is provided. Experimentally, we prove that SNORE is competitive with respect to state-of-the-art methods on deblurring and inpainting tasks, both quantitatively and qualitatively.
title Plug-and-Play image restoration with Stochastic deNOising REgularization
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2402.01779