Saved in:
Bibliographic Details
Main Authors: Liang, Tongyi, Li, Han-Xiong
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.15284
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911782914752512
author Liang, Tongyi
Li, Han-Xiong
author_facet Liang, Tongyi
Li, Han-Xiong
contents Although deep learning-based methods have shown great success in spatiotemporal predictive learning, the framework of those models is designed mainly by intuition. How to make spatiotemporal forecasting with theoretical guarantees is still a challenging issue. In this work, we tackle this problem by applying domain knowledge from the dynamical system to the framework design of deep learning models. An observer theory-guided deep learning architecture, called Spatiotemporal Observer, is designed for predictive learning of high dimensional data. The characteristics of the proposed framework are twofold: firstly, it provides the generalization error bound and convergence guarantee for spatiotemporal prediction; secondly, dynamical regularization is introduced to enable the model to learn system dynamics better during training. Further experimental results show that this framework could capture the spatiotemporal dynamics and make accurate predictions in both one-step-ahead and multi-step-ahead forecasting scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2402_15284
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Spatiotemporal Observer Design for Predictive Learning of High-Dimensional Data
Liang, Tongyi
Li, Han-Xiong
Machine Learning
Artificial Intelligence
Systems and Control
Although deep learning-based methods have shown great success in spatiotemporal predictive learning, the framework of those models is designed mainly by intuition. How to make spatiotemporal forecasting with theoretical guarantees is still a challenging issue. In this work, we tackle this problem by applying domain knowledge from the dynamical system to the framework design of deep learning models. An observer theory-guided deep learning architecture, called Spatiotemporal Observer, is designed for predictive learning of high dimensional data. The characteristics of the proposed framework are twofold: firstly, it provides the generalization error bound and convergence guarantee for spatiotemporal prediction; secondly, dynamical regularization is introduced to enable the model to learn system dynamics better during training. Further experimental results show that this framework could capture the spatiotemporal dynamics and make accurate predictions in both one-step-ahead and multi-step-ahead forecasting scenarios.
title Spatiotemporal Observer Design for Predictive Learning of High-Dimensional Data
topic Machine Learning
Artificial Intelligence
Systems and Control
url https://arxiv.org/abs/2402.15284