Normalizing Flow Regression for Bayesian Inference with Offline Likelihood Evaluations

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Li, Chengkun, Huggins, Bobby, Mikkola, Petrus, Acerbi, Luigi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917986379497472
author Li, Chengkun
Huggins, Bobby
Mikkola, Petrus
Acerbi, Luigi
author_facet Li, Chengkun
Huggins, Bobby
Mikkola, Petrus
Acerbi, Luigi
contents Bayesian inference with computationally expensive likelihood evaluations remains a significant challenge in many scientific domains. We propose normalizing flow regression (NFR), a novel offline inference method for approximating posterior distributions. Unlike traditional surrogate approaches that require additional sampling or inference steps, NFR directly yields a tractable posterior approximation through regression on existing log-density evaluations. We introduce training techniques specifically for flow regression, such as tailored priors and likelihood functions, to achieve robust posterior and model evidence estimation. We demonstrate NFR's effectiveness on synthetic benchmarks and real-world applications from neuroscience and biology, showing superior or comparable performance to existing methods. NFR represents a promising approach for Bayesian inference when standard methods are computationally prohibitive or existing model evaluations can be recycled.
format Preprint
id arxiv_https___arxiv_org_abs_2504_11554
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Normalizing Flow Regression for Bayesian Inference with Offline Likelihood Evaluations
Li, Chengkun
Huggins, Bobby
Mikkola, Petrus
Acerbi, Luigi
Machine Learning
Bayesian inference with computationally expensive likelihood evaluations remains a significant challenge in many scientific domains. We propose normalizing flow regression (NFR), a novel offline inference method for approximating posterior distributions. Unlike traditional surrogate approaches that require additional sampling or inference steps, NFR directly yields a tractable posterior approximation through regression on existing log-density evaluations. We introduce training techniques specifically for flow regression, such as tailored priors and likelihood functions, to achieve robust posterior and model evidence estimation. We demonstrate NFR's effectiveness on synthetic benchmarks and real-world applications from neuroscience and biology, showing superior or comparable performance to existing methods. NFR represents a promising approach for Bayesian inference when standard methods are computationally prohibitive or existing model evaluations can be recycled.
title Normalizing Flow Regression for Bayesian Inference with Offline Likelihood Evaluations
topic Machine Learning
url https://arxiv.org/abs/2504.11554