Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866918306667036672 |
|---|---|
| author | Scheurer, Stefania Reiser, Philipp Brünnette, Tim Nowak, Wolfgang Guthke, Anneli Bürkner, Paul-Christian |
| author_facet | Scheurer, Stefania Reiser, Philipp Brünnette, Tim Nowak, Wolfgang Guthke, Anneli Bürkner, Paul-Christian |
| contents | Bayesian inference typically relies on a large number of model evaluations to estimate posterior distributions. Established methods like Markov Chain Monte Carlo (MCMC) and Amortized Bayesian Inference (ABI) can become computationally challenging. While ABI enables fast inference after training, generating sufficient training data still requires thousands of model simulations, which is infeasible for expensive models. Surrogate models offer a solution by providing approximate simulations at a lower computational cost, allowing the generation of large data sets for training. However, the introduced approximation errors and uncertainties can lead to overconfident posterior estimates. To address this, we propose Uncertainty-Aware Surrogate-based Amortized Bayesian Inference (UA-SABI) -- a framework that combines surrogate modeling and ABI while explicitly quantifying and propagating surrogate uncertainties through the inference pipeline. Our experiments show that this approach enables reliable, fast, and repeated Bayesian inference for computationally expensive models, even under tight time constraints. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_08683 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models Scheurer, Stefania Reiser, Philipp Brünnette, Tim Nowak, Wolfgang Guthke, Anneli Bürkner, Paul-Christian Machine Learning Methodology Bayesian inference typically relies on a large number of model evaluations to estimate posterior distributions. Established methods like Markov Chain Monte Carlo (MCMC) and Amortized Bayesian Inference (ABI) can become computationally challenging. While ABI enables fast inference after training, generating sufficient training data still requires thousands of model simulations, which is infeasible for expensive models. Surrogate models offer a solution by providing approximate simulations at a lower computational cost, allowing the generation of large data sets for training. However, the introduced approximation errors and uncertainties can lead to overconfident posterior estimates. To address this, we propose Uncertainty-Aware Surrogate-based Amortized Bayesian Inference (UA-SABI) -- a framework that combines surrogate modeling and ABI while explicitly quantifying and propagating surrogate uncertainties through the inference pipeline. Our experiments show that this approach enables reliable, fast, and repeated Bayesian inference for computationally expensive models, even under tight time constraints. |
| title | Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models |
| topic | Machine Learning Methodology |
| url | https://arxiv.org/abs/2505.08683 |