Saved in:
Bibliographic Details
Main Authors: Margossian, Charles C., Zhong, Chenyang, Mukherjee, Sumit
Format: Preprint
Published: 2021
Subjects:
Online Access:https://arxiv.org/abs/2110.10801
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917339185807360
author Margossian, Charles C.
Zhong, Chenyang
Mukherjee, Sumit
author_facet Margossian, Charles C.
Zhong, Chenyang
Mukherjee, Sumit
contents Ising and Potts models are an important class of discrete probability distributions which originated from statistical physics and since then have found applications in several disciplines. Simulation from these models is a well known challenging problem. In this paper, we study a class of Markov chain Monte Carlo algorithms, in which we introduce an auxiliary Gaussian variable such that, conditional on this variable, the discrete states are independent. This approach is broadly applicable to Ising and Potts models, including ones in which the coupling matrix admits negative entries, as in spin glass and Hopfield models. We focus on a block Gibbs sampler version of this algorithm, which alternates between sampling the auxiliary Gaussian and the discrete states, and derive mixing time bounds for a wide class of Ising/Potts models at both high and low temperatures, yielding results analogous to those derived for the Heat Bath and Swendsen-Wang algorithms. We present novel choices of auxiliary Gaussian variables which scale well with the number of states in the Potts model, and which can take advantage of the low rank structure of the coupling matrix, if any. Finally, we numerically evaluate the performance of the auxiliary Gaussian Gibbs sampler with several competing algorithms, across a range of examples.
format Preprint
id arxiv_https___arxiv_org_abs_2110_10801
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Efficient Sampling for Ising and Potts Models using Auxiliary Gaussian Variables
Margossian, Charles C.
Zhong, Chenyang
Mukherjee, Sumit
Computation
Ising and Potts models are an important class of discrete probability distributions which originated from statistical physics and since then have found applications in several disciplines. Simulation from these models is a well known challenging problem. In this paper, we study a class of Markov chain Monte Carlo algorithms, in which we introduce an auxiliary Gaussian variable such that, conditional on this variable, the discrete states are independent. This approach is broadly applicable to Ising and Potts models, including ones in which the coupling matrix admits negative entries, as in spin glass and Hopfield models. We focus on a block Gibbs sampler version of this algorithm, which alternates between sampling the auxiliary Gaussian and the discrete states, and derive mixing time bounds for a wide class of Ising/Potts models at both high and low temperatures, yielding results analogous to those derived for the Heat Bath and Swendsen-Wang algorithms. We present novel choices of auxiliary Gaussian variables which scale well with the number of states in the Potts model, and which can take advantage of the low rank structure of the coupling matrix, if any. Finally, we numerically evaluate the performance of the auxiliary Gaussian Gibbs sampler with several competing algorithms, across a range of examples.
title Efficient Sampling for Ising and Potts Models using Auxiliary Gaussian Variables
topic Computation
url https://arxiv.org/abs/2110.10801