Efficient Learning of Accurate Surrogates for Simulations of Complex Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Diaw, A., McKerns, M., Sagert, I., Stanton, L. G., Murillo, M. S.
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911879434076160
author Diaw, A.
McKerns, M.
Sagert, I.
Stanton, L. G.
Murillo, M. S.
author_facet Diaw, A.
McKerns, M.
Sagert, I.
Stanton, L. G.
Murillo, M. S.
contents Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are interested in finding a surrogate that provides valid predictions of any potential future model evaluations, we introduce an online learning method empowered by optimizer-driven sampling. The method has two advantages over current approaches. First, it ensures that all turning points on the model response surface are included in the training data. Second, after any new model evaluations, surrogates are tested and "retrained" (updated) if the "score" drops below a validity threshold. Tests on benchmark functions reveal that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema, even when the scoring metric favors overall accuracy. We apply our method to simulations of nuclear matter to demonstrate that highly accurate surrogates for the nuclear equation of state can be reliably auto-generated from expensive calculations using a few model evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2207_12855
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Efficient Learning of Accurate Surrogates for Simulations of Complex Systems
Diaw, A.
McKerns, M.
Sagert, I.
Stanton, L. G.
Murillo, M. S.
Machine Learning
Nuclear Theory
Computational Physics
Data Analysis, Statistics and Probability
Plasma Physics
Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are interested in finding a surrogate that provides valid predictions of any potential future model evaluations, we introduce an online learning method empowered by optimizer-driven sampling. The method has two advantages over current approaches. First, it ensures that all turning points on the model response surface are included in the training data. Second, after any new model evaluations, surrogates are tested and "retrained" (updated) if the "score" drops below a validity threshold. Tests on benchmark functions reveal that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema, even when the scoring metric favors overall accuracy. We apply our method to simulations of nuclear matter to demonstrate that highly accurate surrogates for the nuclear equation of state can be reliably auto-generated from expensive calculations using a few model evaluations.
title Efficient Learning of Accurate Surrogates for Simulations of Complex Systems
topic Machine Learning
Nuclear Theory
Computational Physics
Data Analysis, Statistics and Probability
Plasma Physics
url https://arxiv.org/abs/2207.12855