Tracking Temporal Dynamics of Vector Sets with Gaussian Process

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Aida, Taichi, Komachi, Mamoru, Ogiso, Toshinobu, Takamura, Hiroya, Mochihashi, Daichi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915682063482880
author Aida, Taichi
Komachi, Mamoru
Ogiso, Toshinobu
Takamura, Hiroya
Mochihashi, Daichi
author_facet Aida, Taichi
Komachi, Mamoru
Ogiso, Toshinobu
Takamura, Hiroya
Mochihashi, Daichi
contents Understanding the temporal evolution of sets of vectors is a fundamental challenge across various domains, including ecology, crime analysis, and linguistics. For instance, ecosystem structures evolve due to interactions among plants, herbivores, and carnivores; the spatial distribution of crimes shifts in response to societal changes; and word embedding vectors reflect cultural and semantic trends over time. However, analyzing such time-varying sets of vectors is challenging due to their complicated structures, which also evolve over time. In this work, we propose a novel method for modeling the distribution underlying each set of vectors using infinite-dimensional Gaussian processes. By approximating the latent function in the Gaussian process with Random Fourier Features, we obtain compact and comparable vector representations over time. This enables us to track and visualize temporal transitions of vector sets in a low-dimensional space. We apply our method to both sociological data (crime distributions) and linguistic data (word embeddings), demonstrating its effectiveness in capturing temporal dynamics. Our results show that the proposed approach provides interpretable and robust representations, offering a powerful framework for analyzing structural changes in temporally indexed vector sets across diverse domains.
format Preprint
id arxiv_https___arxiv_org_abs_2512_15538
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tracking Temporal Dynamics of Vector Sets with Gaussian Process
Aida, Taichi
Komachi, Mamoru
Ogiso, Toshinobu
Takamura, Hiroya
Mochihashi, Daichi
Machine Learning
Computation and Language
Understanding the temporal evolution of sets of vectors is a fundamental challenge across various domains, including ecology, crime analysis, and linguistics. For instance, ecosystem structures evolve due to interactions among plants, herbivores, and carnivores; the spatial distribution of crimes shifts in response to societal changes; and word embedding vectors reflect cultural and semantic trends over time. However, analyzing such time-varying sets of vectors is challenging due to their complicated structures, which also evolve over time. In this work, we propose a novel method for modeling the distribution underlying each set of vectors using infinite-dimensional Gaussian processes. By approximating the latent function in the Gaussian process with Random Fourier Features, we obtain compact and comparable vector representations over time. This enables us to track and visualize temporal transitions of vector sets in a low-dimensional space. We apply our method to both sociological data (crime distributions) and linguistic data (word embeddings), demonstrating its effectiveness in capturing temporal dynamics. Our results show that the proposed approach provides interpretable and robust representations, offering a powerful framework for analyzing structural changes in temporally indexed vector sets across diverse domains.
title Tracking Temporal Dynamics of Vector Sets with Gaussian Process
topic Machine Learning
Computation and Language
url https://arxiv.org/abs/2512.15538