Continuity-Preserving Convolutional Autoencoders for Learning Continuous Latent Dynamical Models from Images

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhu, Aiqing, Pan, Yuting, Li, Qianxiao
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909472839958528
author Zhu, Aiqing
Pan, Yuting
Li, Qianxiao
author_facet Zhu, Aiqing
Pan, Yuting
Li, Qianxiao
contents Continuous dynamical systems are cornerstones of many scientific and engineering disciplines. While machine learning offers powerful tools to model these systems from trajectory data, challenges arise when these trajectories are captured as images, resulting in pixel-level observations that are discrete in nature. Consequently, a naive application of a convolutional autoencoder can result in latent coordinates that are discontinuous in time. To resolve this, we propose continuity-preserving convolutional autoencoders (CpAEs) to learn continuous latent states and their corresponding continuous latent dynamical models from discrete image frames. We present a mathematical formulation for learning dynamics from image frames, which illustrates issues with previous approaches and motivates our methodology based on promoting the continuity of convolution filters, thereby preserving the continuity of the latent states. This approach enables CpAEs to produce latent states that evolve continuously with the underlying dynamics, leading to more accurate latent dynamical models. Extensive experiments across various scenarios demonstrate the effectiveness of CpAEs.
format Preprint
id arxiv_https___arxiv_org_abs_2502_00754
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Continuity-Preserving Convolutional Autoencoders for Learning Continuous Latent Dynamical Models from Images
Zhu, Aiqing
Pan, Yuting
Li, Qianxiao
Machine Learning
Computer Vision and Pattern Recognition
Continuous dynamical systems are cornerstones of many scientific and engineering disciplines. While machine learning offers powerful tools to model these systems from trajectory data, challenges arise when these trajectories are captured as images, resulting in pixel-level observations that are discrete in nature. Consequently, a naive application of a convolutional autoencoder can result in latent coordinates that are discontinuous in time. To resolve this, we propose continuity-preserving convolutional autoencoders (CpAEs) to learn continuous latent states and their corresponding continuous latent dynamical models from discrete image frames. We present a mathematical formulation for learning dynamics from image frames, which illustrates issues with previous approaches and motivates our methodology based on promoting the continuity of convolution filters, thereby preserving the continuity of the latent states. This approach enables CpAEs to produce latent states that evolve continuously with the underlying dynamics, leading to more accurate latent dynamical models. Extensive experiments across various scenarios demonstrate the effectiveness of CpAEs.
title Continuity-Preserving Convolutional Autoencoders for Learning Continuous Latent Dynamical Models from Images
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.00754