Provable Diffusion Posterior Sampling for Bayesian Inversion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chang, Jinyuan, Duan, Chenguang, Jiao, Yuling, Li, Ruoxuan, Yang, Jerry Zhijian, Yuan, Cheng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915661922435072
author Chang, Jinyuan
Duan, Chenguang
Jiao, Yuling
Li, Ruoxuan
Yang, Jerry Zhijian
Yuan, Cheng
author_facet Chang, Jinyuan
Duan, Chenguang
Jiao, Yuling
Li, Ruoxuan
Yang, Jerry Zhijian
Yuan, Cheng
contents This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a warm-start strategy to initialize the particles. To approximate the posterior score, we develop a Monte Carlo estimator in which particles are generated using Langevin dynamics, avoiding the heuristic approximations commonly used in prior work. The score governing the Langevin dynamics is learned from data, enabling the model to capture rich structural features of the underlying prior distribution. On the theoretical side, we provide non-asymptotic error bounds, showing that the method converges even for complex, multi-modal target posterior distributions. These bounds explicitly quantify the errors arising from posterior score estimation, the warm-start initialization, and the posterior sampling procedure. Our analysis further clarifies how the prior score-matching error and the condition number of the Bayesian inverse problem influence overall performance. Finally, we present numerical experiments demonstrating the effectiveness of the proposed method across a range of inverse problems.
format Preprint
id arxiv_https___arxiv_org_abs_2512_08022
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Provable Diffusion Posterior Sampling for Bayesian Inversion
Chang, Jinyuan
Duan, Chenguang
Jiao, Yuling
Li, Ruoxuan
Yang, Jerry Zhijian
Yuan, Cheng
Machine Learning
Numerical Analysis
Probability
Statistics Theory
This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a warm-start strategy to initialize the particles. To approximate the posterior score, we develop a Monte Carlo estimator in which particles are generated using Langevin dynamics, avoiding the heuristic approximations commonly used in prior work. The score governing the Langevin dynamics is learned from data, enabling the model to capture rich structural features of the underlying prior distribution. On the theoretical side, we provide non-asymptotic error bounds, showing that the method converges even for complex, multi-modal target posterior distributions. These bounds explicitly quantify the errors arising from posterior score estimation, the warm-start initialization, and the posterior sampling procedure. Our analysis further clarifies how the prior score-matching error and the condition number of the Bayesian inverse problem influence overall performance. Finally, we present numerical experiments demonstrating the effectiveness of the proposed method across a range of inverse problems.
title Provable Diffusion Posterior Sampling for Bayesian Inversion
topic Machine Learning
Numerical Analysis
Probability
Statistics Theory
url https://arxiv.org/abs/2512.08022