Cover Image

A Self-Supervised Paradigm for Data-Efficient Medical Foundation Model Pre-training: V-information Optimization Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Wenxuan, Zhang, Hanyu, Tan, Weimin, Sun, Yuqi, Yan, Bo
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Medical Data-Effective Learning Benchmark for Highly Efficient Pre-training of Foundation Models
by: Yang, Wenxuan, et al.
Published: (2024)

Scaling Laws for Data-Efficient Visual Transfer Learning
by: Yang, Wenxuan, et al.
Published: (2025)

Non-Uniform Class-Wise Coreset Selection for Vision Model Fine-tuning
by: Zhang, Hanyu, et al.
Published: (2025)

An Efficient Replay for Class-Incremental Learning with Pre-trained Models
by: Yin, Weimin, et al.
Published: (2024)

Domain-Adaptive Pre-training of Self-Supervised Foundation Models for Medical Image Classification in Gastrointestinal Endoscopy
by: Roth, Marcel, et al.
Published: (2024)

Self-Supervised Radio Pre-training: Toward Foundational Models for Spectrogram Learning
by: Aboulfotouh, Ahmed, et al.
Published: (2024)

Quantifying the Pre-training Dividend: Generative versus Latent Self-Supervised Learning for Time Series Foundation Models
by: Major, Noam, et al.
Published: (2026)

A Generative Framework for Self-Supervised Facial Representation Learning
by: He, Ruian, et al.
Published: (2023)

Self-Supervised Learning for Pre-training Capsule Networks: Overcoming Medical Imaging Dataset Challenges
by: El-Shimy, Heba, et al.
Published: (2025)

OSF: On Pre-training and Scaling of Sleep Foundation Models
by: Shuai, Zitao, et al.
Published: (2026)

Progressive Local Alignment for Medical Multimodal Pre-training
by: Yan, Huimin, et al.
Published: (2025)

Agentic AIs Are the Missing Paradigm for Out-of-Distribution Generalization in Foundation Models
by: Wang, Xin, et al.
Published: (2026)

Measuring Pre-training Data Quality without Labels for Time Series Foundation Models
by: Wen, Songkang, et al.
Published: (2024)

Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
by: Lai, Zhengfeng, et al.
Published: (2024)

Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement
by: Wei, Yuhan, et al.
Published: (2026)

Re-Simulation-based Self-Supervised Learning for Pre-Training Foundation Models
by: Harris, Philip, et al.
Published: (2024)

Graph Foundation Models: Bridging Language Model Paradigms and Graph Optimization
by: Liang, Yunhao, et al.
Published: (2025)

On the Asymptotics of Self-Supervised Pre-training: Two-Stage M-Estimation and Representation Symmetry
by: Tinati, Mohammad, et al.
Published: (2026)

RelPrism: A Multi-Faceted Pre-training Framework with Self-Generated Tasks for Relational Databases
by: Yang, Jinyu, et al.
Published: (2026)

Mochi: Aligning Pre-training and Inference for Efficient Graph Foundation Models via Meta-Learning
by: Mattos, João, et al.
Published: (2026)

VisionPAD: A Vision-Centric Pre-training Paradigm for Autonomous Driving
by: Zhang, Haiming, et al.
Published: (2024)

Multi-instance Learning as Downstream Task of Self-Supervised Learning-based Pre-trained Model
by: Matsuishi, Koki, et al.
Published: (2025)

Making Pre-trained Language Models Great on Tabular Prediction
by: Yan, Jiahuan, et al.
Published: (2024)

One Model for All: Universal Pre-training for EEG based Emotion Recognition across Heterogeneous Datasets and Paradigms
by: Li, Xiang, et al.
Published: (2025)

How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?
by: Purohit, Mirali, et al.
Published: (2025)

Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Models
by: Yu, Xingtong, et al.
Published: (2024)

Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising
by: Zhao, Jiahua, et al.
Published: (2026)

GP2F: Cross-Domain Graph Prompting with Adaptive Fusion of Pre-trained Graph Neural Networks
by: He, Dongxiao, et al.
Published: (2026)

Distilling Time Series Foundation Models for Efficient Forecasting
by: Li, Yuqi, et al.
Published: (2026)

DeCoP: Enhancing Self-Supervised Time Series Representation with Dependency Controlled Pre-training
by: Wu, Yuemin, et al.
Published: (2025)

SuPreME: A Supervised Pre-training Framework for Multimodal ECG Representation Learning
by: Cai, Mingsheng, et al.
Published: (2025)

RmGPT: A Foundation Model with Generative Pre-trained Transformer for Fault Diagnosis and Prognosis in Rotating Machinery
by: Wang, Yilin, et al.
Published: (2024)

TCGPN: Temporal-Correlation Graph Pre-trained Network for Stock Forecasting
by: Yan, Wenbo, et al.
Published: (2024)

TrajMamba: An Efficient and Semantic-rich Vehicle Trajectory Pre-training Model
by: Liu, Yichen, et al.
Published: (2025)

An Information-Theoretic Criterion for Efficient Data Synthesis
by: Li, Hanyu, et al.
Published: (2026)

An Efficient Self-Supervised Framework for Long-Sequence EEG Modeling
by: Hong, Jiazhen, et al.
Published: (2025)

Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transition
by: Liu, Fan, et al.
Published: (2025)

Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximization
by: Chakraborty, Deep, et al.
Published: (2024)

MIRA: Medical Time Series Foundation Model for Real-World Health Data
by: Li, Hao, et al.
Published: (2025)

NetMamba+: A Framework of Pre-trained Models for Efficient and Accurate Network Traffic Classification
by: Wang, Tongze, et al.
Published: (2026)