Diffusion Generative Modelling for Divide-and-Conquer MCMC

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Trojan, C., Fearnhead, P., Nemeth, C.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913393592500224
author Trojan, C.
Fearnhead, P.
Nemeth, C.
author_facet Trojan, C.
Fearnhead, P.
Nemeth, C.
contents Divide-and-conquer MCMC is a strategy for parallelising Markov Chain Monte Carlo sampling by running independent samplers on disjoint subsets of a dataset and merging their output. An ongoing challenge in the literature is to efficiently perform this merging without imposing distributional assumptions on the posteriors. We propose using diffusion generative modelling to fit density approximations to the subposterior distributions. This approach outperforms existing methods on challenging merging problems, while its computational cost scales more efficiently to high dimensional problems than existing density estimation approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2406_11664
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Diffusion Generative Modelling for Divide-and-Conquer MCMC
Trojan, C.
Fearnhead, P.
Nemeth, C.
Machine Learning
Computation
Divide-and-conquer MCMC is a strategy for parallelising Markov Chain Monte Carlo sampling by running independent samplers on disjoint subsets of a dataset and merging their output. An ongoing challenge in the literature is to efficiently perform this merging without imposing distributional assumptions on the posteriors. We propose using diffusion generative modelling to fit density approximations to the subposterior distributions. This approach outperforms existing methods on challenging merging problems, while its computational cost scales more efficiently to high dimensional problems than existing density estimation approaches.
title Diffusion Generative Modelling for Divide-and-Conquer MCMC
topic Machine Learning
Computation
url https://arxiv.org/abs/2406.11664