Demonstrating the power and flexibility of variational assumptions for amortized neural posterior estimation in environmental applications

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Maceda, Elliot, Hector, Emily C., Lenzi, Amanda, Reich, Brian J.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912809980264448
author Maceda, Elliot
Hector, Emily C.
Lenzi, Amanda
Reich, Brian J.
author_facet Maceda, Elliot
Hector, Emily C.
Lenzi, Amanda
Reich, Brian J.
contents Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood function by leveraging the fact that data can be quickly simulated from the model, but converge slowly and/or poorly in high-dimensional settings. In this paper, we propose a framework for Bayesian posterior estimation by mapping data to posteriors of parameters using a neural network trained on data simulated from the complex model. Posterior distributions of model parameters are efficiently obtained by feeding observed data into the trained neural network. We show theoretically that our posteriors converge to the true posteriors in Kullback-Leibler divergence. Our approach yields computationally efficient and theoretically justified uncertainty quantification, which is lacking in existing simulation-based neural network approaches. Comprehensive simulation studies highlight our method's robustness and accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2404_10899
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Demonstrating the power and flexibility of variational assumptions for amortized neural posterior estimation in environmental applications
Maceda, Elliot
Hector, Emily C.
Lenzi, Amanda
Reich, Brian J.
Computation
Machine Learning
Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood function by leveraging the fact that data can be quickly simulated from the model, but converge slowly and/or poorly in high-dimensional settings. In this paper, we propose a framework for Bayesian posterior estimation by mapping data to posteriors of parameters using a neural network trained on data simulated from the complex model. Posterior distributions of model parameters are efficiently obtained by feeding observed data into the trained neural network. We show theoretically that our posteriors converge to the true posteriors in Kullback-Leibler divergence. Our approach yields computationally efficient and theoretically justified uncertainty quantification, which is lacking in existing simulation-based neural network approaches. Comprehensive simulation studies highlight our method's robustness and accuracy.
title Demonstrating the power and flexibility of variational assumptions for amortized neural posterior estimation in environmental applications
topic Computation
Machine Learning
url https://arxiv.org/abs/2404.10899