When do neural ordinary differential equations generalize on complex networks?

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Laber, Moritz, Eliassi-Rad, Tina, Klein, Brennan
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917260925337600
author Laber, Moritz
Eliassi-Rad, Tina
Klein, Brennan
author_facet Laber, Moritz
Eliassi-Rad, Tina
Klein, Brennan
contents Neural ordinary differential equations (neural ODEs) can effectively learn dynamical systems from time series data, but their behavior on graph-structured data remains poorly understood, especially when applied to graphs with different size or structure than encountered during training. We study neural ODEs ($\mathtt{nODE}$s) with vector fields following the Barabási-Barzel form, trained on synthetic data from five common dynamical systems on graphs. Using the $\mathbb{S}^1$-model to generate graphs with realistic and tunable structure, we find that degree heterogeneity and the type of dynamical system are the primary factors in determining $\mathtt{nODE}$s' ability to generalize across graph sizes and properties. This extends to $\mathtt{nODE}$s' ability to capture fixed points and maintain performance amid missing data. Average clustering plays a secondary role in determining $\mathtt{nODE}$ performance. Our findings highlight $\mathtt{nODE}$s as a powerful approach to understanding complex systems but underscore challenges emerging from degree heterogeneity and clustering in realistic graphs.
format Preprint
id arxiv_https___arxiv_org_abs_2602_08980
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle When do neural ordinary differential equations generalize on complex networks?
Laber, Moritz
Eliassi-Rad, Tina
Klein, Brennan
Physics and Society
Machine Learning
Social and Information Networks
Neural ordinary differential equations (neural ODEs) can effectively learn dynamical systems from time series data, but their behavior on graph-structured data remains poorly understood, especially when applied to graphs with different size or structure than encountered during training. We study neural ODEs ($\mathtt{nODE}$s) with vector fields following the Barabási-Barzel form, trained on synthetic data from five common dynamical systems on graphs. Using the $\mathbb{S}^1$-model to generate graphs with realistic and tunable structure, we find that degree heterogeneity and the type of dynamical system are the primary factors in determining $\mathtt{nODE}$s' ability to generalize across graph sizes and properties. This extends to $\mathtt{nODE}$s' ability to capture fixed points and maintain performance amid missing data. Average clustering plays a secondary role in determining $\mathtt{nODE}$ performance. Our findings highlight $\mathtt{nODE}$s as a powerful approach to understanding complex systems but underscore challenges emerging from degree heterogeneity and clustering in realistic graphs.
title When do neural ordinary differential equations generalize on complex networks?
topic Physics and Society
Machine Learning
Social and Information Networks
url https://arxiv.org/abs/2602.08980