Saved in:
Bibliographic Details
Main Authors: Rummel, Nic, Messenger, Daniel A., Becker, Stephen, Dukic, Vanja, Bortz, David M.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2502.08881
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914108406759424
author Rummel, Nic
Messenger, Daniel A.
Becker, Stephen
Dukic, Vanja
Bortz, David M.
author_facet Rummel, Nic
Messenger, Daniel A.
Becker, Stephen
Dukic, Vanja
Bortz, David M.
contents The Weak-form Estimation of Non-linear Dynamics (WENDy) framework is a recently developed approach for parameter estimation and inference of systems of ordinary differential equations (ODEs). Prior work demonstrated WENDy to be robust, computationally efficient, and accurate, but only works for ODEs which are linear-in-parameters. In this work, we derive a novel extension to accommodate systems of a more general class of ODEs that are nonlinear-in-parameters. Our new WENDy-MLE algorithm approximates a maximum likelihood estimator via local non-convex optimization methods. This is made possible by the availability of analytic expressions for the likelihood function and its first and second order derivatives. WENDy-MLE has better accuracy, a substantially larger domain of convergence, and is often faster than other weak form methods and the conventional output error least squares method. Moreover, we extend the framework to accommodate data corrupted by multiplicative log-normal noise. The WENDy.jl algorithm is efficiently implemented in Julia. In order to demonstrate the practical benefits of our approach, we present extensive numerical results comparing our method, other weak form methods, and output error least squares on a suite of benchmark systems of ODEs in terms of accuracy, precision, bias, and coverage.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08881
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle WENDy for Nonlinear-in-Parameters ODEs
Rummel, Nic
Messenger, Daniel A.
Becker, Stephen
Dukic, Vanja
Bortz, David M.
Machine Learning
Methodology
The Weak-form Estimation of Non-linear Dynamics (WENDy) framework is a recently developed approach for parameter estimation and inference of systems of ordinary differential equations (ODEs). Prior work demonstrated WENDy to be robust, computationally efficient, and accurate, but only works for ODEs which are linear-in-parameters. In this work, we derive a novel extension to accommodate systems of a more general class of ODEs that are nonlinear-in-parameters. Our new WENDy-MLE algorithm approximates a maximum likelihood estimator via local non-convex optimization methods. This is made possible by the availability of analytic expressions for the likelihood function and its first and second order derivatives. WENDy-MLE has better accuracy, a substantially larger domain of convergence, and is often faster than other weak form methods and the conventional output error least squares method. Moreover, we extend the framework to accommodate data corrupted by multiplicative log-normal noise. The WENDy.jl algorithm is efficiently implemented in Julia. In order to demonstrate the practical benefits of our approach, we present extensive numerical results comparing our method, other weak form methods, and output error least squares on a suite of benchmark systems of ODEs in terms of accuracy, precision, bias, and coverage.
title WENDy for Nonlinear-in-Parameters ODEs
topic Machine Learning
Methodology
url https://arxiv.org/abs/2502.08881