PENGUIN: Enhancing Transformer with Periodic-Nested Group Attention for Long-term Time Series Forecasting
Fuente:
arXiv
Saved in:
| Main Authors: | Sun, Tian, Chen, Yuqi, Sun, Weiwei |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Learning Spatio-Temporal Dynamics for Trajectory Recovery via Time-Aware Transformer
by: Sun, Tian, et al.
Published: (2025)
by: Sun, Tian, et al.
Published: (2025)
ContiFormer: Continuous-Time Transformer for Irregular Time Series Modeling
by: Chen, Yuqi, et al.
Published: (2024)
by: Chen, Yuqi, et al.
Published: (2024)
Attention as Robust Representation for Time Series Forecasting
by: Niu, PeiSong, et al.
Published: (2024)
by: Niu, PeiSong, et al.
Published: (2024)
Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting
by: Zhao, Yanjun, et al.
Published: (2024)
by: Zhao, Yanjun, et al.
Published: (2024)
Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers
by: Cheng, Xin, et al.
Published: (2024)
by: Cheng, Xin, et al.
Published: (2024)
PSformer: Parameter-efficient Transformer with Segment Attention for Time Series Forecasting
by: Wang, Yanlong, et al.
Published: (2024)
by: Wang, Yanlong, et al.
Published: (2024)
TimelyGPT: Extrapolatable Transformer Pre-training for Long-term Time-Series Forecasting in Healthcare
by: Song, Ziyang, et al.
Published: (2023)
by: Song, Ziyang, et al.
Published: (2023)
Nested Spatio-Temporal Time Series Forecasting
by: Ai, Yinghao, et al.
Published: (2026)
by: Ai, Yinghao, et al.
Published: (2026)
PeriodNet: Boosting the Potential of Attention Mechanism for Time Series Forecasting
by: Zhao, Bowen, et al.
Published: (2025)
by: Zhao, Bowen, et al.
Published: (2025)
Distilling Time Series Foundation Models for Efficient Forecasting
by: Li, Yuqi, et al.
Published: (2026)
by: Li, Yuqi, et al.
Published: (2026)
Long Input Sequence Network for Long Time Series Forecasting
by: Ma, Chao, et al.
Published: (2024)
by: Ma, Chao, et al.
Published: (2024)
Mixture-of-Linear-Experts for Long-term Time Series Forecasting
by: Ni, Ronghao, et al.
Published: (2023)
by: Ni, Ronghao, et al.
Published: (2023)
DRFormer: Multi-Scale Transformer Utilizing Diverse Receptive Fields for Long Time-Series Forecasting
by: Ding, Ruixin, et al.
Published: (2024)
by: Ding, Ruixin, et al.
Published: (2024)
VARMA-Enhanced Transformer for Time Series Forecasting
by: Song, Jiajun, et al.
Published: (2025)
by: Song, Jiajun, et al.
Published: (2025)
DySCo: Dynamic Semantic Compression for Effective Long-term Time Series Forecasting
by: Ao, Xiang, et al.
Published: (2026)
by: Ao, Xiang, et al.
Published: (2026)
Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping
by: Li, Zhe, et al.
Published: (2023)
by: Li, Zhe, et al.
Published: (2023)
xLSTMTime : Long-term Time Series Forecasting With xLSTM
by: Alharthi, Musleh, et al.
Published: (2024)
by: Alharthi, Musleh, et al.
Published: (2024)
SageFormer: Series-Aware Framework for Long-term Multivariate Time Series Forecasting
by: Zhang, Zhenwei, et al.
Published: (2023)
by: Zhang, Zhenwei, et al.
Published: (2023)
Breaking the Context Bottleneck on Long Time Series Forecasting
by: Ma, Chao, et al.
Published: (2024)
by: Ma, Chao, et al.
Published: (2024)
DMamba: Decomposition-enhanced Mamba for Time Series Forecasting
by: Chen, Ruxuan, et al.
Published: (2026)
by: Chen, Ruxuan, et al.
Published: (2026)
Introducing Spectral Attention for Long-Range Dependency in Time Series Forecasting
by: Kang, Bong Gyun, et al.
Published: (2024)
by: Kang, Bong Gyun, et al.
Published: (2024)
CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables
by: Lu, Jiecheng, et al.
Published: (2024)
by: Lu, Jiecheng, et al.
Published: (2024)
Enhancing Transformer-based models for Long Sequence Time Series Forecasting via Structured Matrix
by: Zhang, Zhicheng, et al.
Published: (2024)
by: Zhang, Zhicheng, et al.
Published: (2024)
To See Far, Look Close: Evolutionary Forecasting for Long-term Time Series
by: Ma, Jiaming, et al.
Published: (2026)
by: Ma, Jiaming, et al.
Published: (2026)
MoHETS: Long-term Time Series Forecasting with Mixture-of-Heterogeneous-Experts
by: Ortigossa, Evandro S., et al.
Published: (2026)
by: Ortigossa, Evandro S., et al.
Published: (2026)
FAITH: Frequency-domain Attention In Two Horizons for Time Series Forecasting
by: Li, Ruiqi, et al.
Published: (2024)
by: Li, Ruiqi, et al.
Published: (2024)
Non-stationary Diffusion For Probabilistic Time Series Forecasting
by: Ye, Weiwei, et al.
Published: (2025)
by: Ye, Weiwei, et al.
Published: (2025)
CAPS: Unifying Attention, Recurrence, and Alignment in Transformer-based Time Series Forecasting
by: Pati, Viresh, et al.
Published: (2026)
by: Pati, Viresh, et al.
Published: (2026)
TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecasting
by: Huang, Songtao, et al.
Published: (2025)
by: Huang, Songtao, et al.
Published: (2025)
Fourier-Mixed Window Attention: Accelerating Informer for Long Sequence Time-Series Forecasting
by: Tran, Nhat Thanh, et al.
Published: (2023)
by: Tran, Nhat Thanh, et al.
Published: (2023)
Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs
by: Zhao, Taibiao, et al.
Published: (2025)
by: Zhao, Taibiao, et al.
Published: (2025)
Revisiting Attention for Multivariate Time Series Forecasting
by: Wu, Haixiang
Published: (2024)
by: Wu, Haixiang
Published: (2024)
Are Self-Attentions Effective for Time Series Forecasting?
by: Kim, Dongbin, et al.
Published: (2024)
by: Kim, Dongbin, et al.
Published: (2024)
Dynamic Long-Term Time-Series Forecasting via Meta Transformer Networks
by: Ma'sum, Muhammad Anwar, et al.
Published: (2024)
by: Ma'sum, Muhammad Anwar, et al.
Published: (2024)
Quantum Kernel-Based Long Short-term Memory for Climate Time-Series Forecasting
by: Hsu, Yu-Chao, et al.
Published: (2024)
by: Hsu, Yu-Chao, et al.
Published: (2024)
Patch-Level Tokenization with CNN Encoders and Attention for Improved Transformer Time-Series Forecasting
by: Nagrath, Saurish, et al.
Published: (2026)
by: Nagrath, Saurish, et al.
Published: (2026)
A lightweight Spatial-Temporal Graph Neural Network for Long-term Time Series Forecasting
by: Moges, Henok Tenaw, et al.
Published: (2025)
by: Moges, Henok Tenaw, et al.
Published: (2025)
MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting
by: Yoon, Hyekyung, et al.
Published: (2026)
by: Yoon, Hyekyung, et al.
Published: (2026)
MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting
by: Cai, Xiuding, et al.
Published: (2024)
by: Cai, Xiuding, et al.
Published: (2024)
FreEformer: Frequency Enhanced Transformer for Multivariate Time Series Forecasting
by: Yue, Wenzhen, et al.
Published: (2025)
by: Yue, Wenzhen, et al.
Published: (2025)
Similar Items
-
Learning Spatio-Temporal Dynamics for Trajectory Recovery via Time-Aware Transformer
by: Sun, Tian, et al.
Published: (2025) -
ContiFormer: Continuous-Time Transformer for Irregular Time Series Modeling
by: Chen, Yuqi, et al.
Published: (2024) -
Attention as Robust Representation for Time Series Forecasting
by: Niu, PeiSong, et al.
Published: (2024) -
Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting
by: Zhao, Yanjun, et al.
Published: (2024) -
Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers
by: Cheng, Xin, et al.
Published: (2024)