From Similarity to Superiority: Channel Clustering for Time Series Forecasting

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Jialin, Lenssen, Jan Eric, Feng, Aosong, Hu, Weihua, Fey, Matthias, Tassiulas, Leandros, Leskovec, Jure, Ying, Rex
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915006698749952
author Chen, Jialin
Lenssen, Jan Eric
Feng, Aosong
Hu, Weihua
Fey, Matthias
Tassiulas, Leandros
Leskovec, Jure
Ying, Rex
author_facet Chen, Jialin
Lenssen, Jan Eric
Feng, Aosong
Hu, Weihua
Fey, Matthias
Tassiulas, Leandros
Leskovec, Jure
Ying, Rex
contents Time series forecasting has attracted significant attention in recent decades. Previous studies have demonstrated that the Channel-Independent (CI) strategy improves forecasting performance by treating different channels individually, while it leads to poor generalization on unseen instances and ignores potentially necessary interactions between channels. Conversely, the Channel-Dependent (CD) strategy mixes all channels with even irrelevant and indiscriminate information, which, however, results in oversmoothing issues and limits forecasting accuracy. There is a lack of channel strategy that effectively balances individual channel treatment for improved forecasting performance without overlooking essential interactions between channels. Motivated by our observation of a correlation between the time series model's performance boost against channel mixing and the intrinsic similarity on a pair of channels, we developed a novel and adaptable Channel Clustering Module (CCM). CCM dynamically groups channels characterized by intrinsic similarities and leverages cluster information instead of individual channel identities, combining the best of CD and CI worlds. Extensive experiments on real-world datasets demonstrate that CCM can (1) boost the performance of CI and CD models by an average margin of 2.4% and 7.2% on long-term and short-term forecasting, respectively; (2) enable zero-shot forecasting with mainstream time series forecasting models; (3) uncover intrinsic time series patterns among channels and improve interpretability of complex time series models.
format Preprint
id arxiv_https___arxiv_org_abs_2404_01340
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Similarity to Superiority: Channel Clustering for Time Series Forecasting
Chen, Jialin
Lenssen, Jan Eric
Feng, Aosong
Hu, Weihua
Fey, Matthias
Tassiulas, Leandros
Leskovec, Jure
Ying, Rex
Machine Learning
Artificial Intelligence
Time series forecasting has attracted significant attention in recent decades. Previous studies have demonstrated that the Channel-Independent (CI) strategy improves forecasting performance by treating different channels individually, while it leads to poor generalization on unseen instances and ignores potentially necessary interactions between channels. Conversely, the Channel-Dependent (CD) strategy mixes all channels with even irrelevant and indiscriminate information, which, however, results in oversmoothing issues and limits forecasting accuracy. There is a lack of channel strategy that effectively balances individual channel treatment for improved forecasting performance without overlooking essential interactions between channels. Motivated by our observation of a correlation between the time series model's performance boost against channel mixing and the intrinsic similarity on a pair of channels, we developed a novel and adaptable Channel Clustering Module (CCM). CCM dynamically groups channels characterized by intrinsic similarities and leverages cluster information instead of individual channel identities, combining the best of CD and CI worlds. Extensive experiments on real-world datasets demonstrate that CCM can (1) boost the performance of CI and CD models by an average margin of 2.4% and 7.2% on long-term and short-term forecasting, respectively; (2) enable zero-shot forecasting with mainstream time series forecasting models; (3) uncover intrinsic time series patterns among channels and improve interpretability of complex time series models.
title From Similarity to Superiority: Channel Clustering for Time Series Forecasting
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2404.01340