Image de couverture de livre

Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhao, Yanjun, Zhou, Tian, Chen, Chao, Sun, Liang, Qian, Yi, Jin, Rong
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Does Vector Quantization Fail in Spatio-Temporal Forecasting? Exploring a Differentiable Sparse Soft-Vector Quantization Approach
par: Chen, Chao, et autres
Publié: (2023)

FusionSF: Fuse Heterogeneous Modalities in a Vector Quantized Framework for Robust Solar Power Forecasting
par: Ma, Ziqing, et autres
Publié: (2024)

Attention as Robust Representation for Time Series Forecasting
par: Niu, PeiSong, et autres
Publié: (2024)

BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecasting
par: Wang, Weiyan, et autres
Publié: (2025)

PENGUIN: Enhancing Transformer with Periodic-Nested Group Attention for Long-term Time Series Forecasting
par: Sun, Tian, et autres
Publié: (2025)

Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecasting
par: Hu, Yifan, et autres
Publié: (2025)

VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion Transformers
par: Deng, Juncan, et autres
Publié: (2024)

Transformer-VQ: Linear-Time Transformers via Vector Quantization
par: Lingle, Lucas D.
Publié: (2023)

CommVQ: Commutative Vector Quantization for KV Cache Compression
par: Li, Junyan, et autres
Publié: (2025)

Integer-only Quantized Transformers for Embedded FPGA-based Time-series Forecasting in AIoT
par: Ling, Tianheng, et autres
Publié: (2024)

VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generation
par: Noravesh, Farshad, et autres
Publié: (2026)

Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecasting
par: Liu, Peiyuan, et autres
Publié: (2024)

ArcVQ-VAE: A Spherical Vector Quantization Framework with ArcCosine Additive Margin
par: Kim, Jaeyung, et autres
Publié: (2026)

Baguan-TS: A Sequence-Native In-Context Learning Model for Time Series Forecasting with Covariates
par: Yang, Linxiao, et autres
Publié: (2026)

VARMA-Enhanced Transformer for Time Series Forecasting
par: Song, Jiajun, et autres
Publié: (2025)

LATST: Are Transformers Necessarily Complex for Time-Series Forecasting
par: Liang, Dizhen
Publié: (2024)

SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting
par: Xu, Xiongxiao, et autres
Publié: (2024)

VQ-DeepISC: Vector Quantized-Enabled Digital Semantic Communication with Channel Adaptive Image Transmission
par: Chen, Jianqiao, et autres
Publié: (2025)

VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantization
par: Zhang, Yiwei, et autres
Publié: (2024)

Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs
par: Zhao, Taibiao, et autres
Publié: (2025)

Less is more: Embracing sparsity and interpolation with Esiformer for time series forecasting
par: Guo, Yangyang, et autres
Publié: (2024)

FAF: A Feature-Adaptive Framework for Few-Shot Time Series Forecasting
par: Ouyang, Pengpeng, et autres
Publié: (2025)

MergeVQ: A Unified Framework for Visual Generation and Representation with Disentangled Token Merging and Quantization
par: Li, Siyuan, et autres
Publié: (2025)

Analytical Provisioning for Attention-FFN Disaggregated LLM Serving under Stochastic Workloads
par: Song, Chendong, et autres
Publié: (2026)

Accurate and Efficient Multi-Channel Time Series Forecasting via Sparse Attention Mechanism
par: Gao, Lei, et autres
Publié: (2026)

SEDformer: Event-Synchronous Spiking Transformers for Irregular Telemetry Time Series Forecasting
par: Zhou, Ziyu, et autres
Publié: (2026)

Breaking the Context Bottleneck on Long Time Series Forecasting
par: Ma, Chao, et autres
Publié: (2024)

Amplify Adjacent Token Differences: Enhancing Long Chain-of-Thought Reasoning with Shift-FFN
par: Xu, Yao, et autres
Publié: (2025)

SDMixer: Sparse Dual-Mixer for Time Series Forecasting
par: Ao, Xiang
Publié: (2026)

Understanding the Role of Textual Prompts in LLM for Time Series Forecasting: an Adapter View
par: Niu, Peisong, et autres
Publié: (2023)

Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecasting
par: Jin, Ming, et autres
Publié: (2023)

FreEformer: Frequency Enhanced Transformer for Multivariate Time Series Forecasting
par: Yue, Wenzhen, et autres
Publié: (2025)

Enhancing Large Language Models for Time-Series Forecasting via Vector-Injected In-Context Learning
par: Zhang, Jianqi, et autres
Publié: (2026)

UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulation
par: Zhou, Hanzhang, et autres
Publié: (2024)

Fredformer: Frequency Debiased Transformer for Time Series Forecasting
par: Piao, Xihao, et autres
Publié: (2024)

Why Do Transformers Fail to Forecast Time Series In-Context?
par: Zhou, Yufa, et autres
Publié: (2025)

CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables
par: Lu, Jiecheng, et autres
Publié: (2024)

HAS-VQ: Hessian-Adaptive Sparse Vector Quantization for High-Fidelity LLM Compression
par: Khasia, Vladimer
Publié: (2026)

HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
par: Feng, Shibo, et autres
Publié: (2025)

Nexus : An Agentic Framework for Time Series Forecasting
par: Das, Sarkar Snigdha Sarathi, et autres
Publié: (2026)