Image de couverture de livre

Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Jianhua, Gao, Yi, Liu, Ruyu, Cheng, Xu, Zhang, Houxiang, Chen, Shengyong
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Adaptive Dual-Teacher Distillation with Subnetwork Rectification for Bridging Semantic Gaps in Black-Box Domain Adaptation
par: Zhang, Zhe, et autres
Publié: (2026)

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
par: Shen, Chaomin, et autres
Publié: (2024)

Teacher-Guided Student Self-Knowledge Distillation Using Diffusion Model
par: Wang, Yu, et autres
Publié: (2026)

Do Students Debias Like Teachers? On the Distillability of Bias Mitigation Methods
par: Cheng, Jiali, et autres
Publié: (2025)

Semantic Visual Simultaneous Localization and Mapping: A Survey
par: Chen, Kaiqi, et autres
Publié: (2022)

TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation
par: Shen, Yehui, et autres
Publié: (2024)

Dual Teacher Knowledge Distillation with Domain Alignment for Face Anti-spoofing
par: Kong, Zhe, et autres
Publié: (2024)

Distilling Balanced Knowledge from a Biased Teacher
par: Kim, Seonghak
Publié: (2025)

Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition
par: Yang, Chuanguang, et autres
Publié: (2025)

Dynamic Guidance Adversarial Distillation with Enhanced Teacher Knowledge
par: Park, Hyejin, et autres
Publié: (2024)

Enriching Knowledge Distillation with Cross-Modal Teacher Fusion
par: Mansourian, Amir M., et autres
Publié: (2025)

MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolution
par: Jiang, Yuxuan, et autres
Publié: (2024)

Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher
par: Guo, Yong, et autres
Publié: (2024)

Descriptor Distillation: a Teacher-Student-Regularized Framework for Learning Local Descriptors
par: Liu, Yuzhen, et autres
Publié: (2022)

Multi Teacher Privileged Knowledge Distillation for Multimodal Expression Recognition
par: Aslam, Muhammad Haseeb, et autres
Publié: (2024)

Knowledge Distillation Based on Transformed Teacher Matching
par: Zheng, Kaixiang, et autres
Publié: (2024)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
par: Li, Hui, et autres
Publié: (2025)

On-Policy Distillation with Best-of-N Teacher Rollout Selection
par: Zhang, Ke, et autres
Publié: (2026)

Efficient Temporal Sentence Grounding in Videos with Multi-Teacher Knowledge Distillation
par: Liang, Renjie, et autres
Publié: (2023)

When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA
par: Tuchinda, Pume, et autres
Publié: (2025)

SAMKD: Spatial-aware Adaptive Masking Knowledge Distillation for Object Detection
par: Zhang, Zhourui, et autres
Publié: (2025)

The Role of Teacher Calibration in Knowledge Distillation
par: Kim, Suyoung, et autres
Publié: (2025)

MST-KD: Multiple Specialized Teachers Knowledge Distillation for Fair Face Recognition
par: Caldeira, Eduarda, et autres
Publié: (2024)

TIE-KD: Teacher-Independent and Explainable Knowledge Distillation for Monocular Depth Estimation
par: Choi, Sangwon, et autres
Publié: (2024)

Multimodal Dataset Distillation via Phased Teacher Models
par: Guo, Shengbin, et autres
Publié: (2026)

Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings
par: Grashei, Christian, et autres
Publié: (2025)

Purify-then-Align: Towards Robust Human Sensing under Modality Missing with Knowledge Distillation from Noisy Multimodal Teacher
par: Weng, Pengcheng, et autres
Publié: (2026)

Powerful Teachers Matter: Text-Guided Multi-view Knowledge Distillation with Visual Prior Enhancement
par: Zhang, Xin, et autres
Publié: (2026)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
par: Shin, Hyunjune, et autres
Publié: (2024)

Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models
par: Yu, Yu-Chu, et autres
Publié: (2024)

DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection
par: Zhang, Zhourui, et autres
Publié: (2024)

Improving Adversarial Robustness Through Adaptive Learning-Driven Multi-Teacher Knowledge Distillation
par: Ullah, Hayat, et autres
Publié: (2025)

360ORB-SLAM: A Visual SLAM System for Panoramic Images with Depth Completion Network
par: Chen, Yichen, et autres
Publié: (2024)

Data-free Knowledge Distillation for Fine-grained Visual Categorization
par: Shao, Renrong, et autres
Publié: (2024)

Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation
par: Qiu, Shoumeng, et autres
Publié: (2024)

Unsupervised Anomaly Detection with an Enhanced Teacher for Student-Teacher Feature Pyramid Matching
par: Zolfaghari, Mohammad, et autres
Publié: (2025)

SCRWKV: Ultra-Compact Structure-Calibrated Vision-RWKV for Topological Crack Segmentation
par: Zhang, Hanxu, et autres
Publié: (2026)

Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10
par: Yasar, Umut Onur
Publié: (2026)

An Angular-Temporal Interaction Network for Light Field Object Tracking in Low-Light Scenes
par: Wang, Mianzhao, et autres
Publié: (2025)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
par: Parchami-Araghi, Amin, et autres
Publié: (2024)