Accurate and Efficient Multivariate Time Series Forecasting via Offline Clustering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Niu, Yiming, Deng, Jinliang, Zhang, Lulu, Zhou, Zimu, Tong, Yongxin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908377805750272
author Niu, Yiming
Deng, Jinliang
Zhang, Lulu
Zhou, Zimu
Tong, Yongxin
author_facet Niu, Yiming
Deng, Jinliang
Zhang, Lulu
Zhou, Zimu
Tong, Yongxin
contents Accurate and efficient multivariate time series (MTS) forecasting is essential for applications such as traffic management and weather prediction, which depend on capturing long-range temporal dependencies and interactions between entities. Existing methods, particularly those based on Transformer architectures, compute pairwise dependencies across all time steps, leading to a computational complexity that scales quadratically with the length of the input. To overcome these challenges, we introduce the Forecaster with Offline Clustering Using Segments (FOCUS), a novel approach to MTS forecasting that simplifies long-range dependency modeling through the use of prototypes extracted via offline clustering. These prototypes encapsulate high-level events in the real-world system underlying the data, summarizing the key characteristics of similar time segments. In the online phase, FOCUS dynamically adapts these patterns to the current input and captures dependencies between the input segment and high-level events, enabling both accurate and efficient forecasting. By identifying prototypes during the offline clustering phase, FOCUS reduces the computational complexity of modeling long-range dependencies in the online phase to linear scaling. Extensive experiments across diverse benchmarks demonstrate that FOCUS achieves state-of-the-art accuracy while significantly reducing computational costs.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05738
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Accurate and Efficient Multivariate Time Series Forecasting via Offline Clustering
Niu, Yiming
Deng, Jinliang
Zhang, Lulu
Zhou, Zimu
Tong, Yongxin
Machine Learning
Artificial Intelligence
Accurate and efficient multivariate time series (MTS) forecasting is essential for applications such as traffic management and weather prediction, which depend on capturing long-range temporal dependencies and interactions between entities. Existing methods, particularly those based on Transformer architectures, compute pairwise dependencies across all time steps, leading to a computational complexity that scales quadratically with the length of the input. To overcome these challenges, we introduce the Forecaster with Offline Clustering Using Segments (FOCUS), a novel approach to MTS forecasting that simplifies long-range dependency modeling through the use of prototypes extracted via offline clustering. These prototypes encapsulate high-level events in the real-world system underlying the data, summarizing the key characteristics of similar time segments. In the online phase, FOCUS dynamically adapts these patterns to the current input and captures dependencies between the input segment and high-level events, enabling both accurate and efficient forecasting. By identifying prototypes during the offline clustering phase, FOCUS reduces the computational complexity of modeling long-range dependencies in the online phase to linear scaling. Extensive experiments across diverse benchmarks demonstrate that FOCUS achieves state-of-the-art accuracy while significantly reducing computational costs.
title Accurate and Efficient Multivariate Time Series Forecasting via Offline Clustering
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2505.05738