Copertina

SPAT: Sensitivity-based Multihead-attention Pruning on Time Series Forecasting Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Guo, Suhan, Deng, Jiahong, Yi, Mengjun, Shen, Furao, Zhao, Jian
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

RAM: Replace Attention with MLP for Efficient Multivariate Time Series Forecasting
di: Guo, Suhan, et al.
Pubblicazione: (2024)

Multi-Scale Dilated Convolution Network for Long-Term Time Series Forecasting
di: Li, Feifei, et al.
Pubblicazione: (2024)

T-LLM: Teaching Large Language Models to Forecast Time Series via Temporal Distillation
di: Guo, Suhan, et al.
Pubblicazione: (2026)

Enhancing Epidemic Forecasting: Evaluating the Role of Mobility Data and Graph Convolutional Networks
di: Guo, Suhan, et al.
Pubblicazione: (2025)

MiCA: A Mobility-Informed Causal Adapter for Lightweight Epidemic Forecasting
di: Guo, Suhan, et al.
Pubblicazione: (2026)

Explaining Model Overfitting in CNNs via GMM Clustering
di: Dou, Hui, et al.
Pubblicazione: (2024)

Nested Spatio-Temporal Time Series Forecasting
di: Ai, Yinghao, et al.
Pubblicazione: (2026)

Less is More: Unlocking Specialization of Time Series Foundation Models via Structured Pruning
di: Zhao, Lifan, et al.
Pubblicazione: (2025)

Dual Prototypes for Adaptive Pre-Trained Model in Class-Incremental Learning
di: Xu, Zhiming, et al.
Pubblicazione: (2024)

Filter then Attend: Improving attention-based Time Series Forecasting with Spectral Filtering
di: Dayag, Elisha, et al.
Pubblicazione: (2025)

Region Seeding via Pre-Activation Regularization: A Geometric View of Piecewise Affine Neural Networks
di: Wei, Yi, et al.
Pubblicazione: (2026)

Logo-LLM: Local and Global Modeling with Large Language Models for Time Series Forecasting
di: Ou, Wenjie, et al.
Pubblicazione: (2025)

FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting
di: Ma, Shusen, et al.
Pubblicazione: (2024)

A Comparative Study of Pruning Methods in Transformer-based Time Series Forecasting
di: Kiefer, Nicholas, et al.
Pubblicazione: (2024)

ConceptFlow: Hierarchical and Fine-grained Concept-Based Explanation for Convolutional Neural Networks
di: Mu, Xinyu, et al.
Pubblicazione: (2025)

AffineLens: Capturing the Continuous Piecewise Affine Functions of Neural Networks
di: Wei, Yi, et al.
Pubblicazione: (2026)

Pushing the Limits of Distillation-Based Continual Learning via Classifier-Proximal Lightweight Plugins
di: Xu, Zhiming, et al.
Pubblicazione: (2025)

Towards Realistic Class-Incremental Learning with Free-Flow Increments
di: Xu, Zhiming, et al.
Pubblicazione: (2026)

RL-Selector: Reinforcement Learning-Guided Data Selection via Redundancy Assessment
di: Yang, Suorong, et al.
Pubblicazione: (2025)

Physics-inspired Energy Transition Neural Network for Sequence Learning
di: Wu, Zhou, et al.
Pubblicazione: (2025)

CC-Time: Cross-Model and Cross-Modality Time Series Forecasting
di: Chen, Peng, et al.
Pubblicazione: (2025)

WinNet: Make Only One Convolutional Layer Effective for Time Series Forecasting
di: Ou, Wenjie, et al.
Pubblicazione: (2023)

Training-Time Batch Normalization Reshapes Local Partition Geometry in Piecewise-Affine Networks
di: Qi, Xuan, et al.
Pubblicazione: (2026)

SEMPO: Lightweight Foundation Models for Time Series Forecasting
di: He, Hui, et al.
Pubblicazione: (2025)

SVTime: Small Time Series Forecasting Models Informed by "Physics" of Large Vision Model Forecasters
di: Shen, ChengAo, et al.
Pubblicazione: (2025)

DBLoss: Decomposition-based Loss Function for Time Series Forecasting
di: Qiu, Xiangfei, et al.
Pubblicazione: (2025)

DAM: Towards A Foundation Model for Time Series Forecasting
di: Darlow, Luke, et al.
Pubblicazione: (2024)

VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecasting
di: Zhang, Xudong, et al.
Pubblicazione: (2026)

Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting
di: Zhao, Lifan, et al.
Pubblicazione: (2024)

Perceiver-based CDF Modeling for Time Series Forecasting
di: Le, Cat P., et al.
Pubblicazione: (2023)

Rethinking Channel Dependence for Multivariate Time Series Forecasting: Learning from Leading Indicators
di: Zhao, Lifan, et al.
Pubblicazione: (2024)

Conditionally Whitened Generative Models for Probabilistic Time Series Forecasting
di: Yang, Yanfeng, et al.
Pubblicazione: (2025)

PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting
di: Zhu, Enqiang, et al.
Pubblicazione: (2025)

Towards Principled Test-Time Adaptation for Time Series Forecasting
di: Wang, Haochun, et al.
Pubblicazione: (2026)

Faithful and Interpretable Explanations for Complex Ensemble Time Series Forecasts using Surrogate Models and Forecastability Analysis
di: Zhao, Yikai, et al.
Pubblicazione: (2025)

Gaussian Process Latent Variable Modeling for Few-shot Time Series Forecasting
di: Cheng, Yunyao, et al.
Pubblicazione: (2022)

Apollo-Forecast: Overcoming Aliasing and Inference Speed Challenges in Language Models for Time Series Forecasting
di: Yin, Tianyi, et al.
Pubblicazione: (2024)

Position: Beyond Model-Centric Prediction -- Agentic Time Series Forecasting
di: Cheng, Mingyue, et al.
Pubblicazione: (2026)

CacheFL: Privacy-Preserving and Efficient Federated Cache Model Fine-Tuning for Vision-Language Models
di: Yi, Mengjun, et al.
Pubblicazione: (2025)

HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
di: Feng, Shibo, et al.
Pubblicazione: (2025)