Accelerated Parallel Tempering via Neural Transports

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Leo, Potaptchik, Peter, He, Jiajun, Du, Yuanqi, Doucet, Arnaud, Vargas, Francisco, Dau, Hai-Dang, Syed, Saifuddin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911542048456704
author Zhang, Leo
Potaptchik, Peter
He, Jiajun
Du, Yuanqi
Doucet, Arnaud
Vargas, Francisco
Dau, Hai-Dang
Syed, Saifuddin
author_facet Zhang, Leo
Potaptchik, Peter
He, Jiajun
Du, Yuanqi
Doucet, Arnaud
Vargas, Francisco
Dau, Hai-Dang
Syed, Saifuddin
contents Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeting high-dimensional, multimodal, or complex target distributions. Parallel Tempering (PT) enhances MCMC's sample efficiency through annealing and parallel computation, propagating samples from tractable reference distributions to intractable targets via state swapping across interpolating distributions. The effectiveness of PT is limited by the often minimal overlap between adjacent distributions in challenging problems, which requires increasing the computational resources to compensate. We introduce a framework that accelerates PT by leveraging neural samplers -- including normalising flows, diffusion models, and controlled diffusions -- to reduce the required overlap. Our approach utilises neural samplers in parallel, circumventing the computational burden of neural samplers while preserving the asymptotic consistency of classical PT. We demonstrate theoretically and empirically on a variety of multimodal sampling problems that our method improves sample quality, reduces the computational cost compared to classical PT, and enables efficient free energy/normalising constant estimation.
format Preprint
id arxiv_https___arxiv_org_abs_2502_10328
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Accelerated Parallel Tempering via Neural Transports
Zhang, Leo
Potaptchik, Peter
He, Jiajun
Du, Yuanqi
Doucet, Arnaud
Vargas, Francisco
Dau, Hai-Dang
Syed, Saifuddin
Machine Learning
Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeting high-dimensional, multimodal, or complex target distributions. Parallel Tempering (PT) enhances MCMC's sample efficiency through annealing and parallel computation, propagating samples from tractable reference distributions to intractable targets via state swapping across interpolating distributions. The effectiveness of PT is limited by the often minimal overlap between adjacent distributions in challenging problems, which requires increasing the computational resources to compensate. We introduce a framework that accelerates PT by leveraging neural samplers -- including normalising flows, diffusion models, and controlled diffusions -- to reduce the required overlap. Our approach utilises neural samplers in parallel, circumventing the computational burden of neural samplers while preserving the asymptotic consistency of classical PT. We demonstrate theoretically and empirically on a variety of multimodal sampling problems that our method improves sample quality, reduces the computational cost compared to classical PT, and enables efficient free energy/normalising constant estimation.
title Accelerated Parallel Tempering via Neural Transports
topic Machine Learning
url https://arxiv.org/abs/2502.10328