Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series Forecasting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fei, Jingru, Yi, Kun, Fan, Wei, Zhang, Qi, Niu, Zhendong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929725669113856
author Fei, Jingru
Yi, Kun
Fan, Wei
Zhang, Qi
Niu, Zhendong
author_facet Fei, Jingru
Yi, Kun
Fan, Wei
Zhang, Qi
Niu, Zhendong
contents We propose an energy amplification technique to address the issue that existing models easily overlook low-energy components in time series forecasting. This technique comprises an energy amplification block and an energy restoration block. The energy amplification block enhances the energy of low-energy components to improve the model's learning efficiency for these components, while the energy restoration block returns the energy to its original level. Moreover, considering that the energy-amplified data typically displays two distinct energy peaks in the frequency spectrum, we integrate the energy amplification technique with a seasonal-trend forecaster to model the temporal relationships of these two peaks independently, serving as the backbone for our proposed model, Amplifier. Additionally, we propose a semi-channel interaction temporal relationship enhancement block for Amplifier, which enhances the model's ability to capture temporal relationships from the perspective of the commonality and specificity of each channel in the data. Extensive experiments on eight time series forecasting benchmarks consistently demonstrate our model's superiority in both effectiveness and efficiency compared to state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2501_17216
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series Forecasting
Fei, Jingru
Yi, Kun
Fan, Wei
Zhang, Qi
Niu, Zhendong
Machine Learning
We propose an energy amplification technique to address the issue that existing models easily overlook low-energy components in time series forecasting. This technique comprises an energy amplification block and an energy restoration block. The energy amplification block enhances the energy of low-energy components to improve the model's learning efficiency for these components, while the energy restoration block returns the energy to its original level. Moreover, considering that the energy-amplified data typically displays two distinct energy peaks in the frequency spectrum, we integrate the energy amplification technique with a seasonal-trend forecaster to model the temporal relationships of these two peaks independently, serving as the backbone for our proposed model, Amplifier. Additionally, we propose a semi-channel interaction temporal relationship enhancement block for Amplifier, which enhances the model's ability to capture temporal relationships from the perspective of the commonality and specificity of each channel in the data. Extensive experiments on eight time series forecasting benchmarks consistently demonstrate our model's superiority in both effectiveness and efficiency compared to state-of-the-art methods.
title Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series Forecasting
topic Machine Learning
url https://arxiv.org/abs/2501.17216