Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Janati, Yazid, Moufad, Badr, Durmus, Alain, Moulines, Eric, Olsson, Jimmy
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929589087895552
author Janati, Yazid
Moufad, Badr
Durmus, Alain
Moulines, Eric
Olsson, Jimmy
author_facet Janati, Yazid
Moufad, Badr
Durmus, Alain
Moulines, Eric
Olsson, Jimmy
contents Recent advancements in solving Bayesian inverse problems have spotlighted denoising diffusion models (DDMs) as effective priors. Although these have great potential, DDM priors yield complex posterior distributions that are challenging to sample. Existing approaches to posterior sampling in this context address this problem either by retraining model-specific components, leading to stiff and cumbersome methods, or by introducing approximations with uncontrolled errors that affect the accuracy of the produced samples. We present an innovative framework, divide-and-conquer posterior sampling, which leverages the inherent structure of DDMs to construct a sequence of intermediate posteriors that guide the produced samples to the target posterior. Our method significantly reduces the approximation error associated with current techniques without the need for retraining. We demonstrate the versatility and effectiveness of our approach for a wide range of Bayesian inverse problems. The code is available at \url{https://github.com/Badr-MOUFAD/dcps}
format Preprint
id arxiv_https___arxiv_org_abs_2403_11407
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
Janati, Yazid
Moufad, Badr
Durmus, Alain
Moulines, Eric
Olsson, Jimmy
Machine Learning
Recent advancements in solving Bayesian inverse problems have spotlighted denoising diffusion models (DDMs) as effective priors. Although these have great potential, DDM priors yield complex posterior distributions that are challenging to sample. Existing approaches to posterior sampling in this context address this problem either by retraining model-specific components, leading to stiff and cumbersome methods, or by introducing approximations with uncontrolled errors that affect the accuracy of the produced samples. We present an innovative framework, divide-and-conquer posterior sampling, which leverages the inherent structure of DDMs to construct a sequence of intermediate posteriors that guide the produced samples to the target posterior. Our method significantly reduces the approximation error associated with current techniques without the need for retraining. We demonstrate the versatility and effectiveness of our approach for a wide range of Bayesian inverse problems. The code is available at \url{https://github.com/Badr-MOUFAD/dcps}
title Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
topic Machine Learning
url https://arxiv.org/abs/2403.11407