Saved in:
Bibliographic Details
Main Authors: Rielly, Victor, Lahouel, Kamel, Lew, Ethan, Fisher, Nicholas, Haney, Vicky, Wells, Michael, Jedynak, Bruno
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2306.10189
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912501514371072
author Rielly, Victor
Lahouel, Kamel
Lew, Ethan
Fisher, Nicholas
Haney, Vicky
Wells, Michael
Jedynak, Bruno
author_facet Rielly, Victor
Lahouel, Kamel
Lew, Ethan
Fisher, Nicholas
Haney, Vicky
Wells, Michael
Jedynak, Bruno
contents Learning a nonparametric system of ordinary differential equations from trajectories in a $d$-dimensional state space requires learning $d$ functions of $d$ variables. Explicit formulations often scale quadratically in $d$ unless additional knowledge about system properties, such as sparsity and symmetries, is available. In this work, we propose a linear approach, the multivariate occupation kernel method (MOCK), using the implicit formulation provided by vector-valued reproducing kernel Hilbert spaces. The solution for the vector field relies on multivariate occupation kernel functions associated with the trajectories and scales linearly with the dimension of the state space. We validate through experiments on a variety of simulated and real datasets ranging from 2 to 1024 dimensions. MOCK outperforms all other comparators on 3 of the 9 datasets on full trajectory prediction and 4 out of the 9 datasets on next-point prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2306_10189
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle MOCK: an Algorithm for Learning Nonparametric Differential Equations via Multivariate Occupation Kernel Functions
Rielly, Victor
Lahouel, Kamel
Lew, Ethan
Fisher, Nicholas
Haney, Vicky
Wells, Michael
Jedynak, Bruno
Machine Learning
Learning a nonparametric system of ordinary differential equations from trajectories in a $d$-dimensional state space requires learning $d$ functions of $d$ variables. Explicit formulations often scale quadratically in $d$ unless additional knowledge about system properties, such as sparsity and symmetries, is available. In this work, we propose a linear approach, the multivariate occupation kernel method (MOCK), using the implicit formulation provided by vector-valued reproducing kernel Hilbert spaces. The solution for the vector field relies on multivariate occupation kernel functions associated with the trajectories and scales linearly with the dimension of the state space. We validate through experiments on a variety of simulated and real datasets ranging from 2 to 1024 dimensions. MOCK outperforms all other comparators on 3 of the 9 datasets on full trajectory prediction and 4 out of the 9 datasets on next-point prediction.
title MOCK: an Algorithm for Learning Nonparametric Differential Equations via Multivariate Occupation Kernel Functions
topic Machine Learning
url https://arxiv.org/abs/2306.10189