Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Meng, Xiangming, Kabashima, Yoshiyuki
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913554688376832
author Meng, Xiangming
Kabashima, Yoshiyuki
author_facet Meng, Xiangming
Kabashima, Yoshiyuki
contents With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative models. However, while remarkable reconstruction performances have been achieved, their inference time is typically too slow since most of them rely on the seminal diffusion posterior sampling (DPS) framework and thus to approximate the intractable likelihood score, time-consuming gradient calculation through back-propagation is needed. To address this issue, this paper provides a fast and effective solution by proposing a simple closed-form approximation to the likelihood score. For both diffusion and flow-based models, extensive experiments are conducted on various noisy linear inverse problems such as noisy super-resolution, denoising, deblurring, and colorization. In all these tasks, our method (namely DMPS) demonstrates highly competitive or even better reconstruction performances while being significantly faster than all the baseline methods.
format Preprint
id arxiv_https___arxiv_org_abs_2211_12343
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems
Meng, Xiangming
Kabashima, Yoshiyuki
Machine Learning
Computer Vision and Pattern Recognition
Information Theory
With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative models. However, while remarkable reconstruction performances have been achieved, their inference time is typically too slow since most of them rely on the seminal diffusion posterior sampling (DPS) framework and thus to approximate the intractable likelihood score, time-consuming gradient calculation through back-propagation is needed. To address this issue, this paper provides a fast and effective solution by proposing a simple closed-form approximation to the likelihood score. For both diffusion and flow-based models, extensive experiments are conducted on various noisy linear inverse problems such as noisy super-resolution, denoising, deblurring, and colorization. In all these tasks, our method (namely DMPS) demonstrates highly competitive or even better reconstruction performances while being significantly faster than all the baseline methods.
title Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems
topic Machine Learning
Computer Vision and Pattern Recognition
Information Theory
url https://arxiv.org/abs/2211.12343