AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecasting

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Benechehab, Abdelhakim, Feofanov, Vasilii, Paolo, Giuseppe, Thomas, Albert, Filippone, Maurizio, Kégl, Balázs
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912232177139712
author Benechehab, Abdelhakim
Feofanov, Vasilii
Paolo, Giuseppe
Thomas, Albert
Filippone, Maurizio
Kégl, Balázs
author_facet Benechehab, Abdelhakim
Feofanov, Vasilii
Paolo, Giuseppe
Thomas, Albert
Filippone, Maurizio
Kégl, Balázs
contents Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying uncertainty in predictions. This study aims to tackle these critical limitations by introducing adapters; feature-space transformations that facilitate the effective use of pre-trained univariate time series FMs for multivariate tasks. Adapters operate by projecting multivariate inputs into a suitable latent space and applying the FM independently to each dimension. Inspired by the literature on representation learning and partially stochastic Bayesian neural networks, we present a range of adapters and optimization/inference strategies. Experiments conducted on both synthetic and real-world datasets confirm the efficacy of adapters, demonstrating substantial enhancements in forecasting accuracy and uncertainty quantification compared to baseline methods. Our framework, AdaPTS, positions adapters as a modular, scalable, and effective solution for leveraging time series FMs in multivariate contexts, thereby promoting their wider adoption in real-world applications. We release the code at https://github.com/abenechehab/AdaPTS.
format Preprint
id arxiv_https___arxiv_org_abs_2502_10235
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecasting
Benechehab, Abdelhakim
Feofanov, Vasilii
Paolo, Giuseppe
Thomas, Albert
Filippone, Maurizio
Kégl, Balázs
Machine Learning
Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying uncertainty in predictions. This study aims to tackle these critical limitations by introducing adapters; feature-space transformations that facilitate the effective use of pre-trained univariate time series FMs for multivariate tasks. Adapters operate by projecting multivariate inputs into a suitable latent space and applying the FM independently to each dimension. Inspired by the literature on representation learning and partially stochastic Bayesian neural networks, we present a range of adapters and optimization/inference strategies. Experiments conducted on both synthetic and real-world datasets confirm the efficacy of adapters, demonstrating substantial enhancements in forecasting accuracy and uncertainty quantification compared to baseline methods. Our framework, AdaPTS, positions adapters as a modular, scalable, and effective solution for leveraging time series FMs in multivariate contexts, thereby promoting their wider adoption in real-world applications. We release the code at https://github.com/abenechehab/AdaPTS.
title AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecasting
topic Machine Learning
url https://arxiv.org/abs/2502.10235