:: Library Catalog

Imagen de Portada

Guardado en:

Detalles Bibliográficos
Autores principales:	Dong, Chengyu, Liu, Liyuan, Shang, Jingbo
Formato:	Preprint
Publicado:	2022
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	https://arxiv.org/abs/2206.06661
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Generalizing Teacher Networks for Effective Knowledge Distillation Across Student Architectures
por: Binici, Kuluhan, et al.
Publicado: (2024)

Learning a Decision Tree Algorithm with Transformers
por: Zhuang, Yufan, et al.
Publicado: (2024)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
por: Shin, Hyunjune, et al.
Publicado: (2024)

Model Merging via Multi-Teacher Knowledge Distillation
por: Dalili, Seyed Arshan, et al.
Publicado: (2025)

Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher
por: Ji, Guangda, et al.
Publicado: (2020)

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
por: Fang, Luyang, et al.
Publicado: (2026)

From Teacher to Student: Tracking Memorization Through Model Distillation
por: Singh, Simardeep
Publicado: (2025)

Teaching the Teacher: The Role of Teacher-Student Smoothness Alignment in Genetic Programming-based Symbolic Distillation
por: Dhar, Soumyadeep, et al.
Publicado: (2025)

Right Time to Learn:Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation
por: Sun, Guanglong, et al.
Publicado: (2025)

Annealing Self-Distillation Rectification Improves Adversarial Training
por: Wu, Yu-Yu, et al.
Publicado: (2023)

The Role of Teacher Calibration in Knowledge Distillation
por: Kim, Suyoung, et al.
Publicado: (2025)

Practical Insights into Knowledge Distillation for Pre-Trained Models
por: Alballa, Norah, et al.
Publicado: (2024)

Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model
por: Chen, Jinyin, et al.
Publicado: (2024)

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
por: Nair, Lakshmi
Publicado: (2024)

Group Relative Knowledge Distillation: Learning from Teacher's Relational Inductive Bias
por: Li, Chao, et al.
Publicado: (2025)

Adversarial Training via Adaptive Knowledge Amalgamation of an Ensemble of Teachers
por: Hamidi, Shayan Mohajer, et al.
Publicado: (2024)

Efficient and Robust Knowledge Distillation from A Stronger Teacher Based on Correlation Matching
por: Niu, Wenqi, et al.
Publicado: (2024)

KDRL: Post-Training Reasoning LLMs via Unified Knowledge Distillation and Reinforcement Learning
por: Xu, Hongling, et al.
Publicado: (2025)

Task-Oriented GNNs Training on Large Knowledge Graphs for Accurate and Efficient Modeling
por: Abdallah, Hussein, et al.
Publicado: (2024)

Training Plug-n-Play Knowledge Modules with Deep Context Distillation
por: Caccia, Lucas, et al.
Publicado: (2025)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
por: Parchami-Araghi, Amin, et al.
Publicado: (2024)

A Functional Perspective on Knowledge Distillation in Neural Networks
por: Mason-Williams, Israel, et al.
Publicado: (2025)

Online Adversarial Knowledge Distillation for Graph Neural Networks
por: Wang, Can, et al.
Publicado: (2021)

Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
por: Lee, Byung-Kwan, et al.
Publicado: (2025)

Teacher-Student Learning on Complexity in Intelligent Routing
por: Pi, Shu-Ting, et al.
Publicado: (2024)

FedMTFI: Feature Importance Based Optimized Multi Teacher Knowledge Distillation in Heterogeneous Federated Learning Environment
por: Shadin, Nazmus Shakib, et al.
Publicado: (2026)

YODA: Teacher-Student Progressive Learning for Language Models
por: Lu, Jianqiao, et al.
Publicado: (2024)

Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
por: Izadi, Mohammad, et al.
Publicado: (2024)

PACED: Distillation and On-Policy Self-Distillation at the Frontier of Student Competence
por: Xu, Yuanda, et al.
Publicado: (2026)

Post-Training is About States, Not Tokens: A State Distribution View of SFT, RL, and On-Policy Distillation
por: Nie, Dong
Publicado: (2026)

Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation
por: Ge, Shiming, et al.
Publicado: (2024)

Linear Projections of Teacher Embeddings for Few-Class Distillation
por: Loo, Noel, et al.
Publicado: (2024)

When Are Teacher Tokens Reliable? Position-Weighted On-Policy Self-Distillation for Reasoning
por: Liu, Xiaogeng, et al.
Publicado: (2026)

Towards Mitigating Architecture Overfitting on Distilled Datasets
por: Zhong, Xuyang, et al.
Publicado: (2023)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
por: Liu, Jing, et al.
Publicado: (2026)

Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation
por: Tian, Yijun, et al.
Publicado: (2024)

ODIA: Oriented Distillation for Inline Acceleration of LLM-based Function Calling
por: Zhang, Hanlong, et al.
Publicado: (2025)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
por: Wu, Lirong, et al.
Publicado: (2024)

Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation
por: Li, Chengyu, et al.
Publicado: (2024)

DUET: Distilled LLM Unlearning from an Efficiently Contextualized Teacher
por: Zhong, Yisheng, et al.
Publicado: (2026)