Cover Image

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shen, Chaomin, Huang, Yaomin, Zhu, Haokun, Fan, Jinsong, Zhang, Guixu
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Harmonizing knowledge Transfer in Neural Network with Unified Distillation
by: Huang, Yaomin, et al.
Published: (2024)

Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias
by: Zhang, Jianhua, et al.
Published: (2024)

Teacher-Guided Student Self-Knowledge Distillation Using Diffusion Model
by: Wang, Yu, et al.
Published: (2026)

Knowledge Distillation with Refined Logits
by: Sun, Wujie, et al.
Published: (2024)

TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation
by: Shen, Yehui, et al.
Published: (2024)

Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition
by: Yang, Chuanguang, et al.
Published: (2025)

MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolution
by: Jiang, Yuxuan, et al.
Published: (2024)

Dynamic Guidance Adversarial Distillation with Enhanced Teacher Knowledge
by: Park, Hyejin, et al.
Published: (2024)

Distilling Balanced Knowledge from a Biased Teacher
by: Kim, Seonghak
Published: (2025)

Enriching Knowledge Distillation with Cross-Modal Teacher Fusion
by: Mansourian, Amir M., et al.
Published: (2025)

Dual Teacher Knowledge Distillation with Domain Alignment for Face Anti-spoofing
by: Kong, Zhe, et al.
Published: (2024)

Lightweight Model Pre-training via Language Guided Knowledge Distillation
by: Li, Mingsheng, et al.
Published: (2024)

Multi Teacher Privileged Knowledge Distillation for Multimodal Expression Recognition
by: Aslam, Muhammad Haseeb, et al.
Published: (2024)

ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledge
by: Zhou, Zhongyi, et al.
Published: (2025)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector
by: Ma, Shuailei, et al.
Published: (2023)

When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA
by: Tuchinda, Pume, et al.
Published: (2025)

Efficient Temporal Sentence Grounding in Videos with Multi-Teacher Knowledge Distillation
by: Liang, Renjie, et al.
Published: (2023)

Balance Divergence for Knowledge Distillation
by: Qi, Yafei, et al.
Published: (2025)

Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation
by: Gu, Zejun, et al.
Published: (2024)

PRVQL: Progressive Knowledge-guided Refinement for Robust Egocentric Visual Query Localization
by: Fan, Bing, et al.
Published: (2025)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

MST-KD: Multiple Specialized Teachers Knowledge Distillation for Fair Face Recognition
by: Caldeira, Eduarda, et al.
Published: (2024)

TIE-KD: Teacher-Independent and Explainable Knowledge Distillation for Monocular Depth Estimation
by: Choi, Sangwon, et al.
Published: (2024)

Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models
by: Yu, Yu-Chu, et al.
Published: (2024)

Rethinking Centered Kernel Alignment in Knowledge Distillation
by: Zhou, Zikai, et al.
Published: (2024)

A-MESS: Anchor based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognition
by: Shen, Yaomin, et al.
Published: (2025)

Monocular Depth Estimation with Global-Aware Discretization and Local Context Modeling
by: Wu, Heng, et al.
Published: (2025)

Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation
by: Fang, Houzhang, et al.
Published: (2025)

Improving Adversarial Robustness Through Adaptive Learning-Driven Multi-Teacher Knowledge Distillation
by: Ullah, Hayat, et al.
Published: (2025)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
by: Li, Hui, et al.
Published: (2025)

Neural Collapse Inspired Knowledge Distillation
by: Zhang, Shuoxi, et al.
Published: (2024)

Domain-invariant Progressive Knowledge Distillation for UAV-based Object Detection
by: Yao, Liang, et al.
Published: (2024)

FreeKD: Knowledge Distillation via Semantic Frequency Prompt
by: Zhang, Yuan, et al.
Published: (2023)

Rethinking Knowledge in Distillation: An In-context Sample Retrieval Perspective
by: Zhu, Jinjing, et al.
Published: (2025)

Efficient Feature Fusion for UAV Object Detection
by: Wang, Xudong, et al.
Published: (2025)

Momentum Memory for Knowledge Distillation in Computational Pathology
by: Guo, Yongxin, et al.
Published: (2026)

Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10
by: Yasar, Umut Onur
Published: (2026)

Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings
by: Grashei, Christian, et al.
Published: (2025)

Frequency Attention for Knowledge Distillation
by: Pham, Cuong, et al.
Published: (2024)