Cover Image

On the Role of Inductive Bias in Time-Series Pretraining: A Case Study in Learning Generalizable Representations for Clinical Time Series

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dey, Sharmita, Paez-Granados, Diego
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Redefining Robot Generalization Through Interactive Intelligence
by: Dey, Sharmita
Published: (2025)

United We Pretrain, Divided We Fail! Representation Learning for Time Series by Pretraining on 75 Datasets at Once
by: Kraus, Maurice, et al.
Published: (2024)

LLM Pretraining Shapes a Generalizable Manifold: Insights into Cross-Modal Transfer to Time Series
by: Roger, Alexis, et al.
Published: (2026)

Test-Time Efficient Pretrained Model Portfolios for Time Series Forecasting
by: Kayaalp, Mert, et al.
Published: (2025)

Phase-driven Domain Generalizable Learning for Nonstationary Time Series
by: Mohapatra, Payal, et al.
Published: (2024)

Generative Pretrained Hierarchical Transformer for Time Series Forecasting
by: Liu, Zhiding, et al.
Published: (2024)

Enhancing Joint Motion Prediction for Individuals with Limb Loss Through Model Reprogramming
by: Dey, Sharmita, et al.
Published: (2024)

Cross-Modal Diffusion for Biomechanical Dynamical Systems Through Local Manifold Alignment
by: Dey, Sharmita, et al.
Published: (2025)

TSLANet: Rethinking Transformers for Time Series Representation Learning
by: Eldele, Emadeldeen, et al.
Published: (2024)

Simple Contrastive Representation Learning for Time Series Forecasting
by: Zheng, Xiaochen, et al.
Published: (2023)

Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers
by: Roschmann, Simon, et al.
Published: (2025)

An Efficient and Generalizable Symbolic Regression Method for Time Series Analysis
by: Xie, Yi, et al.
Published: (2024)

Repurposing Foundation Model for Generalizable Medical Time Series Classification
by: Huang, Nan, et al.
Published: (2024)

TimeDRL: Disentangled Representation Learning for Multivariate Time-Series
by: Chang, Ching, et al.
Published: (2023)

T-Rep: Representation Learning for Time Series using Time-Embeddings
by: Fraikin, Archibald, et al.
Published: (2023)

Label-efficient Time Series Representation Learning: A Review
by: Eldele, Emadeldeen, et al.
Published: (2023)

Empowering Time Series Analysis with Large-Scale Multimodal Pretraining
by: Chen, Peng, et al.
Published: (2026)

Integrating Inductive Biases in Transformers via Distillation for Financial Time Series Forecasting
by: Den, Yu-Chen, et al.
Published: (2026)

Time Series Representation Models
by: Leppich, Robert, et al.
Published: (2024)

Universal Time-Series Representation Learning: A Survey
by: Trirat, Patara, et al.
Published: (2024)

Learning Hyperspherical Time-Frequency Representations for Time-Series Out-of-Distribution Detection
by: Lunardi, Willian T., et al.
Published: (2026)

Contrast All the Time: Learning Time Series Representation from Temporal Consistency
by: Shamba, Abdul-Kazeem, et al.
Published: (2024)

Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias
by: Das, Mohua, et al.
Published: (2026)

An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series Data
by: King, Ryan, et al.
Published: (2024)

A Systematic Evaluation of Generated Time Series and Their Effects in Self-Supervised Pretraining
by: Der, Audrey, et al.
Published: (2024)

A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning
by: Anguita, Nicolas, et al.
Published: (2026)

GTM: A General Time-series Model for Enhanced Representation Learning of Time-Series Data
by: He, Cheng, et al.
Published: (2025)

Data-Efficient Sleep Staging with Synthetic Time Series Pretraining
by: Grieger, Niklas, et al.
Published: (2024)

Learning Dynamic Representations and Policies from Multimodal Clinical Time-Series with Informative Missingness
by: Liang, Zihan, et al.
Published: (2026)

The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series Classification
by: Middlehurst, Matthew, et al.
Published: (2026)

Dataset Difficulty and the Role of Inductive Bias
by: Kwok, Devin, et al.
Published: (2024)

Capture Timing-Attention of Events in Clinical Time Series
by: Li, Jia, et al.
Published: (2026)

TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health
by: Fan, Yuang, et al.
Published: (2026)

NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretraining
by: Lin, Chenguo, et al.
Published: (2023)

FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modeling
by: Li, Zhengnan, et al.
Published: (2024)

Unsupervised Multi-modal Feature Alignment for Time Series Representation Learning
by: Liang, Chen, et al.
Published: (2023)

Representation Learning of Multivariate Time Series using Attention and Adversarial Training
by: Scharwächter, Leon, et al.
Published: (2024)

Multi-Patch Prediction: Adapting LLMs for Time Series Representation Learning
by: Bian, Yuxuan, et al.
Published: (2024)

A Shapelet-based Framework for Unsupervised Multivariate Time Series Representation Learning
by: Liang, Zhiyu, et al.
Published: (2023)

Unifying Prediction and Explanation in Time-Series Transformers via Shapley-based Pretraining
by: Cheng, Qisen, et al.
Published: (2025)