Learning Informed Prior Distributions with Normalizing Flows for Bayesian Analysis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Roch, Hendrik, Shen, Chun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910092107972608
author Roch, Hendrik
Shen, Chun
author_facet Roch, Hendrik
Shen, Chun
contents We investigate the use of normalizing flow (NF) models as flexible priors in Bayesian inference via Markov Chain Monte Carlo (MCMC) sampling for iterative Bayesian calibration. Trained on posteriors from previous analyses, these models can be used as informative priors that capture non-trivial distributions and correlations in subsequent inference tasks. We compare different training strategies and loss functions, finding that training based on Kullback-Leibler (KL) divergence and unsupervised learning consistently yield the most accurate reproductions of reference distributions. We apply such a sequential Bayesian workflow to a high-energy nuclear physics problem; MCMC with NF-based priors reproduces the results of one-shot joint inference well, provided the target distributions are unimodal. In cases with pronounced multi-modality or dataset tension, distortions may arise, underscoring the need for caution in multi-stage Bayesian inference. A comparison between the pocoMC MCMC sampler and the standard emcee sampler further demonstrates the importance of advanced and robust algorithms for exploring the posterior space. Overall, our results establish NF-based priors as a practical and efficient tool for sequential Bayesian inference in high-dimensional parameter spaces.
format Preprint
id arxiv_https___arxiv_org_abs_2509_14911
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Informed Prior Distributions with Normalizing Flows for Bayesian Analysis
Roch, Hendrik
Shen, Chun
Nuclear Theory
High Energy Physics - Phenomenology
We investigate the use of normalizing flow (NF) models as flexible priors in Bayesian inference via Markov Chain Monte Carlo (MCMC) sampling for iterative Bayesian calibration. Trained on posteriors from previous analyses, these models can be used as informative priors that capture non-trivial distributions and correlations in subsequent inference tasks. We compare different training strategies and loss functions, finding that training based on Kullback-Leibler (KL) divergence and unsupervised learning consistently yield the most accurate reproductions of reference distributions. We apply such a sequential Bayesian workflow to a high-energy nuclear physics problem; MCMC with NF-based priors reproduces the results of one-shot joint inference well, provided the target distributions are unimodal. In cases with pronounced multi-modality or dataset tension, distortions may arise, underscoring the need for caution in multi-stage Bayesian inference. A comparison between the pocoMC MCMC sampler and the standard emcee sampler further demonstrates the importance of advanced and robust algorithms for exploring the posterior space. Overall, our results establish NF-based priors as a practical and efficient tool for sequential Bayesian inference in high-dimensional parameter spaces.
title Learning Informed Prior Distributions with Normalizing Flows for Bayesian Analysis
topic Nuclear Theory
High Energy Physics - Phenomenology
url https://arxiv.org/abs/2509.14911