Copertina

OSF: On Pre-training and Scaling of Sleep Foundation Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Shuai, Zitao, Xu, Zongzhe, Yang, David, Wang, Wei, Yang, Yuzhe
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SleepLM: Natural-Language Intelligence for Human Sleep
di: Xu, Zongzhe, et al.
Pubblicazione: (2026)

Stanford Sleep Bench: Evaluating Polysomnography Pre-training Methods for Sleep Foundation Models
di: Kjaer, Magnus Ruud, et al.
Pubblicazione: (2025)

Scaling Laws for Pre-training Agents and World Models
di: Pearce, Tim, et al.
Pubblicazione: (2024)

Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
di: Lai, Zhengfeng, et al.
Pubblicazione: (2024)

REMIND: Rethinking Medical High-Modality Learning under Missingness--A Long-Tailed Distribution Perspective
di: Wu, Chenwei, et al.
Pubblicazione: (2026)

Measuring Pre-training Data Quality without Labels for Time Series Foundation Models
di: Wen, Songkang, et al.
Pubblicazione: (2024)

Pre-trained Language Models Improve the Few-shot Prompt Ability of Decision Transformer
di: Yang, Yu, et al.
Pubblicazione: (2024)

Specialized Foundation Models Struggle to Beat Supervised Baselines
di: Xu, Zongzhe, et al.
Pubblicazione: (2024)

Delayed Bottlenecking: Alleviating Forgetting in Pre-trained Graph Neural Networks
di: Zhao, Zhe, et al.
Pubblicazione: (2024)

QKCV Attention: Enhancing Time Series Forecasting with Static Categorical Embeddings for Both Lightweight and Pre-trained Foundation Models
di: Wang, Hao, et al.
Pubblicazione: (2025)

Mochi: Aligning Pre-training and Inference for Efficient Graph Foundation Models via Meta-Learning
di: Mattos, João, et al.
Pubblicazione: (2026)

VectorFit : Adaptive Singular & Bias Vector Fine-Tuning of Pre-trained Foundation Models
di: Hegde, Suhas G, et al.
Pubblicazione: (2025)

Scaling Wearable Foundation Models
di: Narayanswamy, Girish, et al.
Pubblicazione: (2024)

Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement
di: Wei, Yuhan, et al.
Pubblicazione: (2026)

Priming: Hybrid State Space Models From Pre-trained Transformers
di: Chattopadhyay, Aditya, et al.
Pubblicazione: (2026)

Shortcut to Nowhere: Demystifying Deep Spurious Regression
di: Xu, Guanrong, et al.
Pubblicazione: (2026)

SleepMaMi: A Universal Sleep Foundation Model for Integrating Macro- and Micro-structures
di: Park, Keondo, et al.
Pubblicazione: (2026)

Graph Generative Pre-trained Transformer
di: Chen, Xiaohui, et al.
Pubblicazione: (2025)

Diversified Scaling Inference in Time Series Foundation Models
di: Hua, Ruijin, et al.
Pubblicazione: (2026)

A Medical Data-Effective Learning Benchmark for Highly Efficient Pre-training of Foundation Models
di: Yang, Wenxuan, et al.
Pubblicazione: (2024)

Quantifying the Pre-training Dividend: Generative versus Latent Self-Supervised Learning for Time Series Foundation Models
di: Major, Noam, et al.
Pubblicazione: (2026)

This Time is Different: An Observability Perspective on Time Series Foundation Models
di: Cohen, Ben, et al.
Pubblicazione: (2025)

Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibrator
di: Luo, Beier, et al.
Pubblicazione: (2025)

Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Model
di: Niu, Peisong, et al.
Pubblicazione: (2025)

Enhanced Atrial Fibrillation Prediction in ESUS Patients with Hypergraph-based Pre-training
di: Xie, Yuzhang, et al.
Pubblicazione: (2026)

On the Power of Foundation Models
di: Yuan, Yang
Pubblicazione: (2022)

Billion-Scale Graph Foundation Models
di: Bechler-Speicher, Maya, et al.
Pubblicazione: (2026)

Task-Agnostic Pre-training and Task-Guided Fine-tuning for Versatile Diffusion Planner
di: Fan, Chenyou, et al.
Pubblicazione: (2024)

Towards Neural Scaling Laws for Time Series Foundation Models
di: Yao, Qingren, et al.
Pubblicazione: (2024)

Dynamic Hypergraph-Enhanced Prediction of Sequential Medical Visits
di: Yang, Wangying, et al.
Pubblicazione: (2024)

TrajGPT-R: Generating Urban Mobility Trajectory with Reinforcement Learning-Enhanced Generative Pre-trained Transformer
di: Wang, Jiawei, et al.
Pubblicazione: (2026)

Transfer Learning with Pre-trained Conditional Generative Models
di: Yamaguchi, Shin'ya, et al.
Pubblicazione: (2022)

Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuning
di: Zhang, Hengyuan, et al.
Pubblicazione: (2024)

Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Data
di: Garg, Anurag, et al.
Pubblicazione: (2025)

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models
di: Tang, Anke, et al.
Pubblicazione: (2024)

Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization
di: Samragh, Mohammad, et al.
Pubblicazione: (2024)

DeCoP: Enhancing Self-Supervised Time Series Representation with Dependency Controlled Pre-training
di: Wu, Yuemin, et al.
Pubblicazione: (2025)

Foundation Models for Demand Forecasting via Dual-Strategy Ensembling
di: Yang, Wei, et al.
Pubblicazione: (2025)

Multimodal 3D Genome Pre-training
di: Yang, Minghao, et al.
Pubblicazione: (2025)

UrbanFM: Scaling Urban Spatio-Temporal Foundation Models
di: Chen, Wei, et al.
Pubblicazione: (2026)