Cover Image

Transformers and Their Roles as Time Series Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Dennis, He, Yihan, Cao, Yuan, Fan, Jianqing, Liu, Han
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model
by: Cao, Defu, et al.
Published: (2024)

One-Layer Transformer Provably Learns One-Nearest Neighbor In Context
by: Li, Zihao, et al.
Published: (2024)

Time Series Foundational Models: Their Role in Anomaly Detection and Prediction
by: Shyalika, Chathurangi, et al.
Published: (2024)

Survey and Taxonomy: The Role of Data-Centric AI in Transformer-Based Time Series Forecasting
by: Xu, Jingjing, et al.
Published: (2024)

Transformers Simulate MLE for Sequence Generation in Bayesian Networks
by: Cao, Yuan, et al.
Published: (2025)

Synthetic Series-Symbol Data Generation for Time Series Foundation Models
by: Wang, Wenxuan, et al.
Published: (2025)

Discrete Prototypical Memories for Federated Time Series Foundation Models
by: Deng, Liwei, et al.
Published: (2026)

Learning Spectral Methods by Transformers
by: He, Yihan, et al.
Published: (2025)

Leveraging Intermediate Representations of Time Series Foundation Models for Anomaly Detection
by: Han, Chan Sik, et al.
Published: (2025)

UniCA: Unified Covariate Adaptation for Time Series Foundation Model
by: Han, Lu, et al.
Published: (2025)

EIDOS: Latent-Space Predictive Learning for Time Series Foundation Models
by: Zhou, Xinxing, et al.
Published: (2026)

Diversified Scaling Inference in Time Series Foundation Models
by: Hua, Ruijin, et al.
Published: (2026)

A Mamba Foundation Model for Time Series Forecasting
by: Ma, Haoyu, et al.
Published: (2024)

Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning
by: Wu, Shunyu, et al.
Published: (2025)

Towards Neural Scaling Laws for Time Series Foundation Models
by: Yao, Qingren, et al.
Published: (2024)

Evaluating Temporal Plasticity in Foundation Time Series Models for Incremental Fine-tuning
by: Liu, Jia, et al.
Published: (2025)

TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models
by: Li, Hongkai, et al.
Published: (2026)

Mitigating Data Scarcity in Time Series Analysis: A Foundation Model with Series-Symbol Data Generation
by: Wang, Wenxuan, et al.
Published: (2025)

Diffusion Transformers as Open-World Spatiotemporal Foundation Models
by: Yuan, Yuan, et al.
Published: (2024)

Estimating Time Series Foundation Model Transferability via In-Context Learning
by: Yao, Qingren, et al.
Published: (2025)

Foundation Models for Time Series: A Survey
by: Kottapalli, Siva Rama Krishna, et al.
Published: (2025)

TiCT: A Synthetically Pre-Trained Foundation Model for Time Series Classification
by: Yeh, Chin-Chia Michael, et al.
Published: (2025)

A Survey on Deep Learning based Time Series Analysis with Frequency Transformation
by: Yi, Kun, et al.
Published: (2023)

A Unified Hyperparameter Optimization Pipeline for Transformer-Based Time Series Forecasting Models
by: Xu, Jingjing, et al.
Published: (2025)

Time Series Foundation Models for Process Model Forecasting
by: Yu, Yongbo, et al.
Published: (2025)

A Time-Series Foundation Model by Universal Delay Embedding
by: Wang, Zijian, et al.
Published: (2025)

This Time is Different: An Observability Perspective on Time Series Foundation Models
by: Cohen, Ben, et al.
Published: (2025)

Ister: Linear Transformer for Efficient Multivariate Time Series Forecasting
by: Cao, Fanpu, et al.
Published: (2024)

Falcon-X: A Time Series Foundation Model for Heterogeneous Multivariate Modeling
by: Liu, Yiding, et al.
Published: (2026)

Transformers versus the EM Algorithm in Multi-class Clustering
by: He, Yihan, et al.
Published: (2025)

Distilling Time Series Foundation Models for Efficient Forecasting
by: Li, Yuqi, et al.
Published: (2026)

HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
by: Feng, Shibo, et al.
Published: (2025)

NuwaTS: a Foundation Model Mending Every Incomplete Time Series
by: Cheng, Jinguo, et al.
Published: (2024)

TS-Memory: Plug-and-Play Memory for Time Series Foundation Models
by: Lyu, Sisuo, et al.
Published: (2026)

Frequency Matters: When Time Series Foundation Models Fail Under Spectral Shift
by: Wang, Tianze, et al.
Published: (2025)

Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenization
by: Masserano, Luca, et al.
Published: (2024)

Leveraging Generic Time Series Foundation Models for EEG Classification
by: Gnassounou, Théo, et al.
Published: (2025)

Non-Stationarity in the Embedding Space of Time Series Foundation Models
by: Choi, Jinmyeong, et al.
Published: (2026)

Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalization
by: Gong, Peiliang, et al.
Published: (2025)

VARMA-Enhanced Transformer for Time Series Forecasting
by: Song, Jiajun, et al.
Published: (2025)