Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Belakaria, Syrine, Letham, Benjamin, Doppa, Janardhan Rao, Engelhardt, Barbara, Ermon, Stefano, Bakshy, Eytan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909355988746240
author Belakaria, Syrine
Letham, Benjamin
Doppa, Janardhan Rao
Engelhardt, Barbara
Ermon, Stefano
Bakshy, Eytan
author_facet Belakaria, Syrine
Letham, Benjamin
Doppa, Janardhan Rao
Engelhardt, Barbara
Ermon, Stefano
Bakshy, Eytan
contents We consider the problem of active learning for global sensitivity analysis of expensive black-box functions. Our aim is to efficiently learn the importance of different input variables, e.g., in vehicle safety experimentation, we study the impact of the thickness of various components on safety objectives. Since function evaluations are expensive, we use active learning to prioritize experimental resources where they yield the most value. We propose novel active learning acquisition functions that directly target key quantities of derivative-based global sensitivity measures (DGSMs) under Gaussian process surrogate models. We showcase the first application of active learning directly to DGSMs, and develop tractable uncertainty reduction and information gain acquisition functions for these measures. Through comprehensive evaluation on synthetic and real-world problems, our study demonstrates how these active learning acquisition strategies substantially enhance the sample efficiency of DGSM estimation, particularly with limited evaluation budgets. Our work paves the way for more efficient and accurate sensitivity analysis in various scientific and engineering applications.
format Preprint
id arxiv_https___arxiv_org_abs_2407_09739
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes
Belakaria, Syrine
Letham, Benjamin
Doppa, Janardhan Rao
Engelhardt, Barbara
Ermon, Stefano
Bakshy, Eytan
Machine Learning
Artificial Intelligence
We consider the problem of active learning for global sensitivity analysis of expensive black-box functions. Our aim is to efficiently learn the importance of different input variables, e.g., in vehicle safety experimentation, we study the impact of the thickness of various components on safety objectives. Since function evaluations are expensive, we use active learning to prioritize experimental resources where they yield the most value. We propose novel active learning acquisition functions that directly target key quantities of derivative-based global sensitivity measures (DGSMs) under Gaussian process surrogate models. We showcase the first application of active learning directly to DGSMs, and develop tractable uncertainty reduction and information gain acquisition functions for these measures. Through comprehensive evaluation on synthetic and real-world problems, our study demonstrates how these active learning acquisition strategies substantially enhance the sample efficiency of DGSM estimation, particularly with limited evaluation budgets. Our work paves the way for more efficient and accurate sensitivity analysis in various scientific and engineering applications.
title Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2407.09739