Bayesian Adaptive Calibration and Optimal Design

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Oliveira, Rafael, Sejdinovic, Dino, Howard, David, Bonilla, Edwin V.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913654081847296
author Oliveira, Rafael
Sejdinovic, Dino
Howard, David
Bonilla, Edwin V.
author_facet Oliveira, Rafael
Sejdinovic, Dino
Howard, David
Bonilla, Edwin V.
contents The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simulations and then calibrated against real observations. Current machine learning approaches, however, mostly rely on rerunning simulations over a fixed set of designs available in the observed data, potentially neglecting informative correlations across the design space and requiring a large amount of simulations. Instead, we consider the calibration process from the perspective of Bayesian adaptive experimental design and propose a data-efficient algorithm to run maximally informative simulations within a batch-sequential process. At each round, the algorithm jointly estimates the parameters of the posterior distribution and optimal designs by maximising a variational lower bound of the expected information gain. The simulator is modelled as a sample from a Gaussian process, which allows us to correlate simulations and observed data with the unknown calibration parameters. We show the benefits of our method when compared to related approaches across synthetic and real-data problems.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14440
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bayesian Adaptive Calibration and Optimal Design
Oliveira, Rafael
Sejdinovic, Dino
Howard, David
Bonilla, Edwin V.
Machine Learning
The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simulations and then calibrated against real observations. Current machine learning approaches, however, mostly rely on rerunning simulations over a fixed set of designs available in the observed data, potentially neglecting informative correlations across the design space and requiring a large amount of simulations. Instead, we consider the calibration process from the perspective of Bayesian adaptive experimental design and propose a data-efficient algorithm to run maximally informative simulations within a batch-sequential process. At each round, the algorithm jointly estimates the parameters of the posterior distribution and optimal designs by maximising a variational lower bound of the expected information gain. The simulator is modelled as a sample from a Gaussian process, which allows us to correlate simulations and observed data with the unknown calibration parameters. We show the benefits of our method when compared to related approaches across synthetic and real-data problems.
title Bayesian Adaptive Calibration and Optimal Design
topic Machine Learning
url https://arxiv.org/abs/2405.14440