Assessment of Uncertainty Quantification in Universal Differential Equations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Schmid, Nina, del Pozo, David Fernandes, Waegeman, Willem, Hasenauer, Jan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914833623941120
author Schmid, Nina
del Pozo, David Fernandes
Waegeman, Willem
Hasenauer, Jan
author_facet Schmid, Nina
del Pozo, David Fernandes
Waegeman, Willem
Hasenauer, Jan
contents Scientific Machine Learning is a new class of approaches that integrate physical knowledge and mechanistic models with data-driven techniques for uncovering governing equations of complex processes. Among the available approaches, Universal Differential Equations (UDEs) are used to combine prior knowledge in the form of mechanistic formulations with universal function approximators, like neural networks. Integral to the efficacy of UDEs is the joint estimation of parameters within mechanistic formulations and the universal function approximators using empirical data. The robustness and applicability of resultant models, however, hinge upon the rigorous quantification of uncertainties associated with these parameters, as well as the predictive capabilities of the overall model or its constituent components. With this work, we provide a formalisation of uncertainty quantification (UQ) for UDEs and investigate important frequentist and Bayesian methods. By analysing three synthetic examples of varying complexity, we evaluate the validity and efficiency of ensembles, variational inference and Markov chain Monte Carlo sampling as epistemic UQ methods for UDEs.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08853
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Assessment of Uncertainty Quantification in Universal Differential Equations
Schmid, Nina
del Pozo, David Fernandes
Waegeman, Willem
Hasenauer, Jan
Machine Learning
Quantitative Methods
Scientific Machine Learning is a new class of approaches that integrate physical knowledge and mechanistic models with data-driven techniques for uncovering governing equations of complex processes. Among the available approaches, Universal Differential Equations (UDEs) are used to combine prior knowledge in the form of mechanistic formulations with universal function approximators, like neural networks. Integral to the efficacy of UDEs is the joint estimation of parameters within mechanistic formulations and the universal function approximators using empirical data. The robustness and applicability of resultant models, however, hinge upon the rigorous quantification of uncertainties associated with these parameters, as well as the predictive capabilities of the overall model or its constituent components. With this work, we provide a formalisation of uncertainty quantification (UQ) for UDEs and investigate important frequentist and Bayesian methods. By analysing three synthetic examples of varying complexity, we evaluate the validity and efficiency of ensembles, variational inference and Markov chain Monte Carlo sampling as epistemic UQ methods for UDEs.
title Assessment of Uncertainty Quantification in Universal Differential Equations
topic Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2406.08853