Imagen de Portada

Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tian, Yinxi, Huang, Changwu, Tang, Ke, Yao, Xin
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Fairness of Privacy Protection: Measuring and Mitigating the Disparity of Group Privacy Risks for Differentially Private Machine Learning
por: Yang, Zhi, et al.
Publicado: (2025)

Multi-Stage Knowledge-Distilled VGAE and GAT for Robust Controller-Area-Network Intrusion Detection
por: Frenken, Robert, et al.
Publicado: (2025)

MemoryKT: An Integrative Memory-and-Forgetting Method for Knowledge Tracing
por: Lin, Mingrong, et al.
Publicado: (2025)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
por: Zhang, Xiaoxiong, et al.
Publicado: (2024)

LBLLM: Lightweight Binarization of Large Language Models via Three-Stage Distillation
por: Song, Siqing, et al.
Publicado: (2026)

Procedural Fairness in Machine Learning
por: Wang, Ziming, et al.
Publicado: (2024)

Model Merging via Multi-Teacher Knowledge Distillation
por: Dalili, Seyed Arshan, et al.
Publicado: (2025)

Distilling Multi-Scale Knowledge for Event Temporal Relation Extraction
por: Yao, Hao-Ren, et al.
Publicado: (2022)

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
por: Wang, Lingzhi, et al.
Publicado: (2025)

Multi-Label Knowledge Distillation
por: Yang, Penghui, et al.
Publicado: (2023)

Overcoming Uncertain Incompleteness for Robust Multimodal Sequential Diagnosis Prediction via Curriculum Data Erasing Guided Knowledge Distillation
por: Koo, Heejoon
Publicado: (2024)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
por: Wang, Zexin, et al.
Publicado: (2025)

CANDLE: A Cross-Modal Agentic Knowledge Distillation Framework for Interpretable Sarcopenia Diagnosis
por: Jin, Yuqi, et al.
Publicado: (2025)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
por: Wu, Lirong, et al.
Publicado: (2024)

Procedural Fairness and Its Relationship with Distributive Fairness in Machine Learning
por: Wang, Ziming, et al.
Publicado: (2025)

Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework
por: Li, Junxian, et al.
Publicado: (2024)

Knowledge Guided Encoder-Decoder Framework: Integrating Multiple Physical Models for Agricultural Ecosystem Modeling
por: Cheng, Qi, et al.
Publicado: (2025)

GiNet: Integrating Sequential and Context-Aware Learning for Battery Capacity Prediction
por: Sameer, Sara, et al.
Publicado: (2025)

Bidirectional Distillation: A Mixed-Play Framework for Multi-Agent Generalizable Behaviors
por: Feng, Lang, et al.
Publicado: (2025)

A Unified Knowledge-Distillation and Semi-Supervised Learning Framework to Improve Industrial Ads Delivery Systems
por: Eghbalzadeh, Hamid, et al.
Publicado: (2025)

Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation
por: Tian, Yijun, et al.
Publicado: (2024)

Graph Knowledge Distillation to Mixture of Experts
por: Rumiantsev, Pavel, et al.
Publicado: (2024)

Dynamic Temperature Scheduler for Knowledge Distillation
por: Islam, Sibgat Ul, et al.
Publicado: (2025)

Membership and Memorization in LLM Knowledge Distillation
por: Zhang, Ziqi, et al.
Publicado: (2025)

Decision Transformer vs. Decision Mamba: Analysing the Complexity of Sequential Decision Making in Atari Games
por: Yan, Ke
Publicado: (2024)

A Functional Perspective on Knowledge Distillation in Neural Networks
por: Mason-Williams, Israel, et al.
Publicado: (2025)

Cooperative Knowledge Distillation: A Learner Agnostic Approach
por: Livanos, Michael, et al.
Publicado: (2024)

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
por: Fang, Luyang, et al.
Publicado: (2026)

IPD: Boosting Sequential Policy with Imaginary Planning Distillation in Offline Reinforcement Learning
por: Qin, Yihao, et al.
Publicado: (2026)

MVKTrans: Multi-View Knowledge Transfer for Robust Multiomics Classification
por: Cong, Shan, et al.
Publicado: (2024)

SrSv: Integrating Sequential Rollouts with Sequential Value Estimation for Multi-agent Reinforcement Learning
por: Wan, Xu, et al.
Publicado: (2025)

Generative Sequential Notification Optimization via Multi-Objective Decision Transformers
por: Ocejo, Borja, et al.
Publicado: (2025)

A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models
por: Zhang, Hengyuan, et al.
Publicado: (2024)

FCOS: A Two-Stage Recoverable Model Pruning Framework for Automatic Modulation Recognition
por: Lu, Yao, et al.
Publicado: (2025)

OPD+: Rethinking the Advantage Design for On-Policy Distillation
por: Zhao, Hanyang, et al.
Publicado: (2026)

Knowledge Distillation Must Account for What It Loses
por: Wang, Wenshuo
Publicado: (2026)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
por: Zhang, Zhaoyang, et al.
Publicado: (2026)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
por: Liu, Jing, et al.
Publicado: (2026)

From Sparsity to Simplicity: Enabling Simpler Sequential Replacements via Sparse Attention Distillation
por: Ren, Yuxin, et al.
Publicado: (2026)

A Note on Knowledge Distillation Loss Function for Object Classification
por: Chen, Defang
Publicado: (2021)