Copertina

Right Time to Learn:Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sun, Guanglong, Yan, Hongwei, Wang, Liyuan, Li, Qian, Lei, Bo, Zhong, Yi
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning
di: Yan, Hongwei, et al.
Pubblicazione: (2026)

Domain Generalizable Continual Learning
di: Yan, Hongwei, et al.
Pubblicazione: (2025)

MePo: Meta Post-Refinement for Rehearsal-Free General Continual Learning
di: Sun, Guanglong, et al.
Pubblicazione: (2026)

Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation
di: Yan, HongWei, et al.
Pubblicazione: (2024)

Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation
di: Zhan, Yu-Liang, et al.
Pubblicazione: (2024)

Toward Student-Oriented Teacher Network Training For Knowledge Distillation
di: Dong, Chengyu, et al.
Pubblicazione: (2022)

Dual-Space Knowledge Distillation for Large Language Models
di: Zhang, Songming, et al.
Pubblicazione: (2024)

Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks
di: Zhang, Tianqing, et al.
Pubblicazione: (2025)

M2-PALE: A Framework for Explaining Multi-Agent MCTS--Minimax Hybrids via Process Mining and LLMs
di: Qian, Yiyu, et al.
Pubblicazione: (2026)

DistillGuard: Evaluating Defenses Against LLM Knowledge Distillation
di: Jiang, Bo
Pubblicazione: (2026)

Flow-based Detection of Botnets through Bio-inspired Optimisation of Machine Learning
di: Issac, Biju, et al.
Pubblicazione: (2024)

Continual Learning of Multiple Cognitive Functions with Brain-inspired Temporal Development Mechanism
di: Han, Bing, et al.
Pubblicazione: (2025)

CaRoBio: 3D Cable Routing with a Bio-inspired Gripper Fingernail
di: Zuo, Jiahui, et al.
Pubblicazione: (2025)

Right in Time: Reactive Reasoning in Regulated Traffic Spaces
di: Kohaut, Simon, et al.
Pubblicazione: (2026)

Revolutionizing Biomarker Discovery: Leveraging Generative AI for Bio-Knowledge-Embedded Continuous Space Exploration
di: Ying, Wangyang, et al.
Pubblicazione: (2024)

Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation
di: Zhang, Hanrong, et al.
Pubblicazione: (2025)

From reactive to cognitive: brain-inspired spatial intelligence for embodied agents
di: Ruan, Shouwei, et al.
Pubblicazione: (2025)

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
di: Fang, Luyang, et al.
Pubblicazione: (2026)

Simple Unsupervised Knowledge Distillation With Space Similarity
di: Singh, Aditya, et al.
Pubblicazione: (2024)

A Dual-Space Framework for General Knowledge Distillation of Large Language Models
di: Zhang, Xue, et al.
Pubblicazione: (2025)

A Brain-inspired Computational Model for Human-like Concept Learning
di: Wang, Yuwei, et al.
Pubblicazione: (2024)

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification
di: Weng, Ziqiao, et al.
Pubblicazione: (2025)

How to Backdoor the Knowledge Distillation
di: Wu, Chen, et al.
Pubblicazione: (2025)

Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data
di: Li, Juanhui, et al.
Pubblicazione: (2024)

BioGraphFusion: Graph Knowledge Embedding for Biological Completion and Reasoning
di: Lin, Yitong, et al.
Pubblicazione: (2025)

Generating Query-Relevant Document Summaries via Reinforcement Learning
di: Yadav, Nitin, et al.
Pubblicazione: (2025)

Towards Generalization of Block Attention via Automatic Segmentation and Block Distillation
di: Li, Shuaiyi, et al.
Pubblicazione: (2026)

TabKD: Tabular Knowledge Distillation through Interaction Diversity of Learned Feature Bins
di: Pereira, Shovon Niverd, et al.
Pubblicazione: (2026)

Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size
di: Hayou, Soufiane, et al.
Pubblicazione: (2025)

Bio-inspired Optimization: metaheuristic algorithms for optimization
di: Game, Pravin S, et al.
Pubblicazione: (2020)

Self-Knowledge Distillation for Learning Ambiguity
di: Park, Hancheol, et al.
Pubblicazione: (2024)

Exploring Explainable Multi-agent MCTS-minimax Hybrids in Board Game Using Process Mining
di: Qian, Yiyu, et al.
Pubblicazione: (2025)

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
di: Yang, Chuanpeng, et al.
Pubblicazione: (2024)

Towards Continual Knowledge Graph Embedding via Incremental Distillation
di: Liu, Jiajun, et al.
Pubblicazione: (2024)

Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
di: Mistretta, Marco, et al.
Pubblicazione: (2024)

Neuro-inspired automated lens design
di: Gao, Yao, et al.
Pubblicazione: (2025)

Contrastive Learning for Knowledge-Based Question Generation in Large Language Models
di: Zhang, Zhenhong, et al.
Pubblicazione: (2024)

Why Distillation can Outperform Zero-RL: The Role of Flexible Reasoning
di: Hu, Xiao, et al.
Pubblicazione: (2025)

BioELX: Cross-lingual Biomedical Entity Linking via Alias-based Retrieval and LLM Ranking
di: Wang, Yi, et al.
Pubblicazione: (2026)

Unleashing Scientific Reasoning for Bio-experimental Protocol Generation via Structured Component-based Reward Mechanism
di: Sun, Haoran, et al.
Pubblicazione: (2025)