Saved in:
Bibliographic Details
Main Authors: Nayak, Indranil, Chakrabarty, Ananda, Kumar, Mrinal, Teixeira, Fernando, Goswami, Debdipta
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.12335
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913923236626432
author Nayak, Indranil
Chakrabarty, Ananda
Kumar, Mrinal
Teixeira, Fernando
Goswami, Debdipta
author_facet Nayak, Indranil
Chakrabarty, Ananda
Kumar, Mrinal
Teixeira, Fernando
Goswami, Debdipta
contents Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the temporally consistent Koopman autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE's superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12335
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Temporally Consistent Koopman Autoencoders for Forecasting Dynamical Systems
Nayak, Indranil
Chakrabarty, Ananda
Kumar, Mrinal
Teixeira, Fernando
Goswami, Debdipta
Machine Learning
Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the temporally consistent Koopman autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE's superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.
title Temporally Consistent Koopman Autoencoders for Forecasting Dynamical Systems
topic Machine Learning
url https://arxiv.org/abs/2403.12335