Invariant Manifolds of Discrete-time Dynamical Systems with Nonlinear Exosystems via Hybrid Physics-Informed Neural Networks

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Patsatzis, Dimitrios G., Kazantzis, Nikolaos, Kevrekidis, Ioannis G., Russo, Lucia, Siettos, Constantinos
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915984966680576
author Patsatzis, Dimitrios G.
Kazantzis, Nikolaos
Kevrekidis, Ioannis G.
Russo, Lucia
Siettos, Constantinos
author_facet Patsatzis, Dimitrios G.
Kazantzis, Nikolaos
Kevrekidis, Ioannis G.
Russo, Lucia
Siettos, Constantinos
contents We propose a hybrid physics-informed machine learning framework to approximate invariant manifolds (IMs) of discrete-time dynamical systems driven by exogenous autonomous dynamics (exosystems). Such systems appear in applications ranging from control theory to modeling collective multi-agent behavior (e.g., bird flocks, traffic dynamics) under hierarchical leadership. The IM learning problem is formulated as solving nonlinear functional equations derived from the invariance equation, expressing the manifold as a relationship between exogenous and system states. The proposed approach combines polynomial series with shallow neural networks, leveraging their complementary strengths. We focus on low- to medium-dimensional manifolds where polynomial expansions remain tractable. Near equilibrium, polynomial series provide interpretability and convergence, while farther away neural networks capture global structure through their universal approximation capability. A continuity penalty enforces consistency between both representations at their interface, and training is performed using analytically derived derivatives within the Levenberg-Marquardt scheme. Naturally, depending on the dimensionality of the input-driven system, one may also employ a purely neural network-based IM approximation, for which we also establish a universal approximation theorem based on certain assumptions on system dynamics. The framework is evaluated on two benchmark problems: an enzymatic bioreactor and a leader-follower car-following model. We analyze convergence, approximation accuracy, and computational cost, and compare standalone neural networks, polynomial expansions, and the hybrid method. Results show that the hybrid approach achieves superior accuracy compared to standalone schemes.
format Preprint
id arxiv_https___arxiv_org_abs_2506_13950
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Invariant Manifolds of Discrete-time Dynamical Systems with Nonlinear Exosystems via Hybrid Physics-Informed Neural Networks
Patsatzis, Dimitrios G.
Kazantzis, Nikolaos
Kevrekidis, Ioannis G.
Russo, Lucia
Siettos, Constantinos
Numerical Analysis
Machine Learning
Dynamical Systems
37M10, 37M21, 37N30, 37N35, 65P99, 65D15, 68T07
G.1.0; F.1.1; I.2.6
We propose a hybrid physics-informed machine learning framework to approximate invariant manifolds (IMs) of discrete-time dynamical systems driven by exogenous autonomous dynamics (exosystems). Such systems appear in applications ranging from control theory to modeling collective multi-agent behavior (e.g., bird flocks, traffic dynamics) under hierarchical leadership. The IM learning problem is formulated as solving nonlinear functional equations derived from the invariance equation, expressing the manifold as a relationship between exogenous and system states. The proposed approach combines polynomial series with shallow neural networks, leveraging their complementary strengths. We focus on low- to medium-dimensional manifolds where polynomial expansions remain tractable. Near equilibrium, polynomial series provide interpretability and convergence, while farther away neural networks capture global structure through their universal approximation capability. A continuity penalty enforces consistency between both representations at their interface, and training is performed using analytically derived derivatives within the Levenberg-Marquardt scheme. Naturally, depending on the dimensionality of the input-driven system, one may also employ a purely neural network-based IM approximation, for which we also establish a universal approximation theorem based on certain assumptions on system dynamics. The framework is evaluated on two benchmark problems: an enzymatic bioreactor and a leader-follower car-following model. We analyze convergence, approximation accuracy, and computational cost, and compare standalone neural networks, polynomial expansions, and the hybrid method. Results show that the hybrid approach achieves superior accuracy compared to standalone schemes.
title Invariant Manifolds of Discrete-time Dynamical Systems with Nonlinear Exosystems via Hybrid Physics-Informed Neural Networks
topic Numerical Analysis
Machine Learning
Dynamical Systems
37M10, 37M21, 37N30, 37N35, 65P99, 65D15, 68T07
G.1.0; F.1.1; I.2.6
url https://arxiv.org/abs/2506.13950