Cover Image

Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wen, Yunshi, Gifford, Wesley M., Reddy, Chandra, Nguyen, Lam M., Kalagnanam, Jayant, Julius, Anak Agung
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Abstracted Shapes as Tokens -- A Generalizable and Interpretable Model for Time-series Classification
by: Wen, Yunshi, et al.
Published: (2024)

Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series
by: Ekambaram, Vijay, et al.
Published: (2024)

TSPulse: Tiny Pre-Trained Models with Disentangled Representations for Rapid Time-Series Analysis
by: Ekambaram, Vijay, et al.
Published: (2025)

Learning to Shuffle: Block Reshuffling and Reversal Schemes for Stochastic Optimization
by: Nguyen, Lam M., et al.
Published: (2026)

Causal-Aware Foundation-Model for Bilevel Optimization in Discrete Choice Settings
by: Subramanian, Shivaram, et al.
Published: (2026)

Adaptive Conformal Anomaly Detection with Time Series Foundation Models for Signal Monitoring
by: Gil, Natalia Martinez, et al.
Published: (2026)

Efficient Embedding-based Synthetic Data Generation for Complex Reasoning Tasks
by: Jayaraman, Srideepika, et al.
Published: (2026)

Time Series Foundation Models as Strong Baselines in Transportation Forecasting: A Large-Scale Benchmark Analysis
by: Yanes-Pulido, Javier, et al.
Published: (2026)

TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model
by: Cao, Defu, et al.
Published: (2024)

MTS-JEPA: Multi-Resolution Joint-Embedding Predictive Architecture for Time-Series Anomaly Prediction
by: He, Yanan, et al.
Published: (2026)

Transformers and Their Roles as Time Series Foundation Models
by: Wu, Dennis, et al.
Published: (2025)

Deep Policy Iteration with Integer Programming for Inventory Management
by: Harsha, Pavithra, et al.
Published: (2021)

TabularFM: An Open Framework For Tabular Foundational Models
by: Tran, Quan M., et al.
Published: (2024)

Pruned Adaptation Modules: A Simple yet Strong Baseline for Continual Foundation Models
by: Yildirim, Elif Ceren Gok, et al.
Published: (2026)

Regularized Latent Dynamics Prediction is a Strong Baseline For Behavioral Foundation Models
by: Jajoo, Pranaya, et al.
Published: (2026)

Foundation Models for Time Series Analysis: A Tutorial and Survey
by: Liang, Yuxuan, et al.
Published: (2024)

Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation
by: Lima, Vinicius, et al.
Published: (2025)

Synthetic Series-Symbol Data Generation for Time Series Foundation Models
by: Wang, Wenxuan, et al.
Published: (2025)

Interactive Counterfactual Generation for Univariate Time Series
by: Schlegel, Udo, et al.
Published: (2024)

Improving Time Series Encoding with Noise-Aware Self-Supervised Learning and an Efficient Encoder
by: Nguyen, Duy A., et al.
Published: (2023)

How Foundational are Foundation Models for Time Series Forecasting?
by: Karaouli, Nouha, et al.
Published: (2025)

Adapting Time Series Foundation Models through Data Mixtures
by: Lee, Thomas L., et al.
Published: (2026)

Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting
by: Liu, Qingxiang, et al.
Published: (2024)

Evaluating Time Series Foundation Models on Noisy Periodic Time Series
by: Gupta, Syamantak Datta
Published: (2025)

Leveraging Generic Time Series Foundation Models for EEG Classification
by: Gnassounou, Théo, et al.
Published: (2025)

Adapt Data to Model: Adaptive Transformation Optimization for Domain-shared Time Series Foundation Models
by: Qiu, Yunzhong, et al.
Published: (2026)

Olivia: Harmonizing Time Series Foundation Models with Power Spectral Density
by: Fei, Jingru, et al.
Published: (2026)

Generalized Prompt Tuning: Adapting Frozen Univariate Time Series Foundation Models for Multivariate Healthcare Time Series
by: Liu, Mingzhu, et al.
Published: (2024)

NOVA: Discovering Well-Conditioned Winograd Transforms through Numerical Optimization of Vandermonde Arithmetic
by: Lohia, Jayant
Published: (2025)

Self-Supervised Learning via Flow-Guided Neural Operator on Time-Series Data
by: Nguyen, Duy, et al.
Published: (2026)

Time Series Foundation Models for Multivariate Financial Time Series Forecasting
by: Marconi, Ben A.
Published: (2025)

On the Internal Semantics of Time-Series Foundation Models
by: Pandey, Atharva, et al.
Published: (2025)

Universal Redundancies in Time Series Foundation Models
by: Bao, Anthony, et al.
Published: (2026)

Federated Foundation Models on Heterogeneous Time Series
by: Chen, Shengchao, et al.
Published: (2024)

Multi-Scale Finetuning for Encoder-based Time Series Foundation Models
by: Qiao, Zhongzheng, et al.
Published: (2025)

TwinS: Revisiting Non-Stationarity in Multivariate Time Series Forecasting
by: Hu, Jiaxi, et al.
Published: (2024)

Measuring Pre-training Data Quality without Labels for Time Series Foundation Models
by: Wen, Songkang, et al.
Published: (2024)

Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts
by: Shi, Xiaoming, et al.
Published: (2024)

TimeFound: A Foundation Model for Time Series Forecasting
by: Xiao, Congxi, et al.
Published: (2025)

Are Time-Indexed Foundation Models the Future of Time Series Imputation?
by: Naour, Etienne Le, et al.
Published: (2025)