:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Li, Chenqi, Liu, Yu, Zhang, Shuo, Denison, Timothy, Zhu, Tingting
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2603.04478
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Survey of Few-Shot Learning for Biomedical Time Series
by: Li, Chenqi, et al.
Published: (2024)

AnchorInv: Few-Shot Class-Incremental Learning of Physiological Signals via Representation Space Guided Inversion
by: Li, Chenqi, et al.
Published: (2024)

Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
by: Lu, Cong, et al.
Published: (2024)

Standing on the Shoulders of Giants: Stabilized Knowledge Distillation for Cross--Language Code Clone Detection
by: Khajezade, Mohamad, et al.
Published: (2026)

BioX-Bridge: Model Bridging for Unsupervised Cross-Modal Knowledge Transfer across Biosignals
by: Li, Chenqi, et al.
Published: (2025)

Strong Teacher Not Needed? On Distillation in LLM Pretraining
by: Lu, Taiming, et al.
Published: (2026)

Why does Knowledge Distillation Work? Rethink its Attention and Fidelity Mechanism
by: Guo, Chenqi, et al.
Published: (2024)

DLink: Distilling Layer-wise and Dominant Knowledge from EEG Foundation Models
by: Wang, Jingyuan, et al.
Published: (2026)

Large Cognition Model: Towards Pretrained EEG Foundation Model
by: Chen, Chi-Sheng, et al.
Published: (2025)

EEG-DLite: Dataset Distillation for Efficient Large EEG Model Training
by: Tang, Yuting, et al.
Published: (2025)

Model Merging via Multi-Teacher Knowledge Distillation
by: Dalili, Seyed Arshan, et al.
Published: (2025)

PRISM: Exploring Heterogeneous Pretrained EEG Foundation Model Transfer to Clinical Differential Diagnosis
by: Lahiri, Jeet Bandhu, et al.
Published: (2026)

On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion
by: Fan, Chenghao, et al.
Published: (2024)

NeuroTTT: Bridging Pretraining-Downstream Task Misalignment in EEG Foundation Models via Test-Time Training
by: Wang, Suli, et al.
Published: (2025)

Diffusion-Guided Pretraining for Brain Graph Foundation Models
by: Wei, Xinxu, et al.
Published: (2026)

Sparse Optimization for Transfer Learning: A L0-Regularized Framework for Multi-Source Domain Adaptation
by: Gong, Chenqi, et al.
Published: (2025)

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
by: Fang, Luyang, et al.
Published: (2026)

See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition
by: Si, Chongjie, et al.
Published: (2024)

LEAF: Language-EEG Aligned Foundation Model for Brain-Computer Interfaces
by: Jiang, Muyun, et al.
Published: (2025)

Pretraining a Foundation Model for Small-Molecule Natural Products
by: Ding, Yuheng, et al.
Published: (2025)

REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects
by: Ouahidi, Yassine El, et al.
Published: (2025)

Rethinking the Intermediate Features in Adversarial Attacks: Misleading Robotic Models via Adversarial Distillation
by: Zhao, Ke, et al.
Published: (2024)

CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Model
by: Ma, Jingying, et al.
Published: (2025)

From Coefficients to Directions: Rethinking Model Merging with Directional Alignment
by: Chen, Zhikang, et al.
Published: (2025)

EEG Foundation Models: Progresses, Benchmarking, and Open Problems
by: Liu, Dingkun, et al.
Published: (2026)

Data-Efficient Symbolic Regression via Foundation Model Distillation
by: Ying, Wangyang, et al.
Published: (2025)

Self-supervised Pretraining for Decision Foundation Model: Formulation, Pipeline and Challenges
by: Liu, Xiaoqian, et al.
Published: (2023)

Towards Generation-Efficient Uncertainty Estimation in Large Language Models
by: Zhu, Mingcheng, et al.
Published: (2026)

PPG-Distill: Efficient Photoplethysmography Signals Analysis via Foundation Model Distillation
by: Ni, Juntong, et al.
Published: (2025)

Rethinking Federated Graph Foundation Models: A Graph-Language Alignment-based Approach
by: Zhu, Yinlin, et al.
Published: (2026)

Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation
by: Zhang, Hengyuan, et al.
Published: (2025)

STEP: Scientific Time-Series Encoder Pretraining via Cross-Domain Distillation
by: Zhang, Chen, et al.
Published: (2026)

NovoMolGen: Rethinking Molecular Language Model Pretraining
by: Chitsaz, Kamran, et al.
Published: (2025)

Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
by: Zhang, Peiyan, et al.
Published: (2023)

TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models
by: Ye, Rongye, et al.
Published: (2026)

Hashing-Baseline: Rethinking Hashing in the Age of Pretrained Models
by: Moummad, Ilyass, et al.
Published: (2025)

An Integrated Data Processing Framework for Pretraining Foundation Models
by: Sun, Yiding, et al.
Published: (2024)

RecBase: Generative Foundation Model Pretraining for Zero-Shot Recommendation
by: Zhou, Sashuai, et al.
Published: (2025)

Why Not Hyperparameter-Friendly Optimisation? A Monotonic Adaptive Norm Rescaling Approach For Long-Tailed Recognition
by: Zhang, Shuo, et al.
Published: (2026)

EEG-Bench: A Benchmark for EEG Foundation Models in Clinical Applications
by: Kastrati, Ard, et al.
Published: (2025)