Conjugate Generalised Bayesian Inference for Discrete Doubly Intractable Problems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Laplante, William, Altamirano, Matias, Knoblauch, Jeremias, Duncan, Andrew, Briol, François-Xavier
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914173938565120
author Laplante, William
Altamirano, Matias
Knoblauch, Jeremias
Duncan, Andrew
Briol, François-Xavier
author_facet Laplante, William
Altamirano, Matias
Knoblauch, Jeremias
Duncan, Andrew
Briol, François-Xavier
contents Doubly intractable problems occur when both the likelihood and the posterior are available only in unnormalised form, with computationally intractable normalisation constants. Bayesian inference then typically requires direct approximation of the posterior through specialised and typically expensive MCMC methods. In this paper, we provide a computationally efficient alternative in the form of a novel generalised Bayesian posterior that allows for conjugate inference within the class of exponential family models for discrete data. We derive theoretical guarantees to characterise the asymptotic behaviour of the generalised posterior, supporting its use for inference. The method is evaluated on a range of challenging intractable exponential family models, including the Conway-Maxwell-Poisson graphical model of multivariate count data, autoregressive discrete time series models, and Markov random fields such as the Ising and Potts models. The computational gains are significant; in our experiments, the method is between 10 and 6000 times faster than state-of-the-art Bayesian computational methods.
format Preprint
id arxiv_https___arxiv_org_abs_2511_23275
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Conjugate Generalised Bayesian Inference for Discrete Doubly Intractable Problems
Laplante, William
Altamirano, Matias
Knoblauch, Jeremias
Duncan, Andrew
Briol, François-Xavier
Methodology
Doubly intractable problems occur when both the likelihood and the posterior are available only in unnormalised form, with computationally intractable normalisation constants. Bayesian inference then typically requires direct approximation of the posterior through specialised and typically expensive MCMC methods. In this paper, we provide a computationally efficient alternative in the form of a novel generalised Bayesian posterior that allows for conjugate inference within the class of exponential family models for discrete data. We derive theoretical guarantees to characterise the asymptotic behaviour of the generalised posterior, supporting its use for inference. The method is evaluated on a range of challenging intractable exponential family models, including the Conway-Maxwell-Poisson graphical model of multivariate count data, autoregressive discrete time series models, and Markov random fields such as the Ising and Potts models. The computational gains are significant; in our experiments, the method is between 10 and 6000 times faster than state-of-the-art Bayesian computational methods.
title Conjugate Generalised Bayesian Inference for Discrete Doubly Intractable Problems
topic Methodology
url https://arxiv.org/abs/2511.23275