LaM-SLidE: Latent Space Modeling of Spatial Dynamical Systems via Linked Entities

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sestak, Florian, Toshev, Artur, Fürst, Andreas, Klambauer, Günter, Mayr, Andreas, Brandstetter, Johannes
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911377337090048
author Sestak, Florian
Toshev, Artur
Fürst, Andreas
Klambauer, Günter
Mayr, Andreas
Brandstetter, Johannes
author_facet Sestak, Florian
Toshev, Artur
Fürst, Andreas
Klambauer, Günter
Mayr, Andreas
Brandstetter, Johannes
contents Generative models are spearheading recent progress in deep learning, showcasing strong promise for trajectory sampling in dynamical systems as well. However, whereas latent space modeling paradigms have transformed image and video generation, similar approaches are more difficult for most dynamical systems. Such systems -- from chemical molecule structures to collective human behavior -- are described by interactions of entities, making them inherently linked to connectivity patterns, entity conservation, and the traceability of entities over time. Our approach, LaM-SLidE (Latent Space Modeling of Spatial Dynamical Systems via Linked Entities), bridges the gap between: (1) keeping the traceability of individual entities in a latent system representation, and (2) leveraging the efficiency and scalability of recent advances in image and video generation, where pre-trained encoder and decoder enable generative modeling directly in latent space. The core idea of LaM-SLidE is the introduction of identifier representations (IDs) that enable the retrieval of entity properties and entity composition from latent system representations, thus fostering traceability. Experimentally, across different domains, we show that LaM-SLidE performs favorably in terms of speed, accuracy, and generalizability. Code is available at https://github.com/ml-jku/LaM-SLidE .
format Preprint
id arxiv_https___arxiv_org_abs_2502_12128
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LaM-SLidE: Latent Space Modeling of Spatial Dynamical Systems via Linked Entities
Sestak, Florian
Toshev, Artur
Fürst, Andreas
Klambauer, Günter
Mayr, Andreas
Brandstetter, Johannes
Machine Learning
Artificial Intelligence
Generative models are spearheading recent progress in deep learning, showcasing strong promise for trajectory sampling in dynamical systems as well. However, whereas latent space modeling paradigms have transformed image and video generation, similar approaches are more difficult for most dynamical systems. Such systems -- from chemical molecule structures to collective human behavior -- are described by interactions of entities, making them inherently linked to connectivity patterns, entity conservation, and the traceability of entities over time. Our approach, LaM-SLidE (Latent Space Modeling of Spatial Dynamical Systems via Linked Entities), bridges the gap between: (1) keeping the traceability of individual entities in a latent system representation, and (2) leveraging the efficiency and scalability of recent advances in image and video generation, where pre-trained encoder and decoder enable generative modeling directly in latent space. The core idea of LaM-SLidE is the introduction of identifier representations (IDs) that enable the retrieval of entity properties and entity composition from latent system representations, thus fostering traceability. Experimentally, across different domains, we show that LaM-SLidE performs favorably in terms of speed, accuracy, and generalizability. Code is available at https://github.com/ml-jku/LaM-SLidE .
title LaM-SLidE: Latent Space Modeling of Spatial Dynamical Systems via Linked Entities
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2502.12128