Primed Priors for Simulation-Based Validation of Bayesian Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fazio, Luna, Scholz, Maximilian, Aguilar, Javier Enrique, Bürkner, Paul-Christian
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912389802229760
author Fazio, Luna
Scholz, Maximilian
Aguilar, Javier Enrique
Bürkner, Paul-Christian
author_facet Fazio, Luna
Scholz, Maximilian
Aguilar, Javier Enrique
Bürkner, Paul-Christian
contents Simulation-based calibration (SBC) is a method for validating inference algorithms and model implementations through repeated inference on data simulated from a generative model. For a model to be generative, one must specify proper priors. However, in all but the simplest of cases, choosing priors for every model parameter is a nontrivial task. In particular, priors that are too broad can produce numerical issues due to extreme parameter values while overly narrow ones can exclude precisely those regions of the parameter space where legitimate problems in the implementation would have manifested. When the data to be analyzed is already available, the issue can be sidestepped by checking calibration on the corresponding posterior, but that is not always a viable option. In this paper, we adapt the framework of catalytic priors, which have been recently proposed for construction of data-based prior distributions, and propose primed priors, which do not require real data and can therefore facilitate prior specification in SBC. We discuss relevant connections of primed priors to the theory of catalytic priors and show their use for SBC in three simulation studies.
format Preprint
id arxiv_https___arxiv_org_abs_2408_06504
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Primed Priors for Simulation-Based Validation of Bayesian Models
Fazio, Luna
Scholz, Maximilian
Aguilar, Javier Enrique
Bürkner, Paul-Christian
Methodology
Simulation-based calibration (SBC) is a method for validating inference algorithms and model implementations through repeated inference on data simulated from a generative model. For a model to be generative, one must specify proper priors. However, in all but the simplest of cases, choosing priors for every model parameter is a nontrivial task. In particular, priors that are too broad can produce numerical issues due to extreme parameter values while overly narrow ones can exclude precisely those regions of the parameter space where legitimate problems in the implementation would have manifested. When the data to be analyzed is already available, the issue can be sidestepped by checking calibration on the corresponding posterior, but that is not always a viable option. In this paper, we adapt the framework of catalytic priors, which have been recently proposed for construction of data-based prior distributions, and propose primed priors, which do not require real data and can therefore facilitate prior specification in SBC. We discuss relevant connections of primed priors to the theory of catalytic priors and show their use for SBC in three simulation studies.
title Primed Priors for Simulation-Based Validation of Bayesian Models
topic Methodology
url https://arxiv.org/abs/2408.06504