Copertina

Knowledge Distillation Based on Transformed Teacher Matching

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zheng, Kaixiang, Yang, En-Hui
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
di: Li, Hui, et al.
Pubblicazione: (2025)

The Role of Teacher Calibration in Knowledge Distillation
di: Kim, Suyoung, et al.
Pubblicazione: (2025)

Post-hoc Selective Classification for Reliable Synthetic Image Detection
di: Zheng, Kaixiang, et al.
Pubblicazione: (2026)

SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation
di: Wu, Zhuguanyu, et al.
Pubblicazione: (2026)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
di: Son, Seungwoo, et al.
Pubblicazione: (2023)

Guiding Distribution Matching Distillation with Gradient-Based Reinforcement Learning
di: Dong, Linwei, et al.
Pubblicazione: (2026)

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
di: Fang, Pengfei, et al.
Pubblicazione: (2024)

Inverse Bridge Matching Distillation
di: Gushchin, Nikita, et al.
Pubblicazione: (2025)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
di: Parchami-Araghi, Amin, et al.
Pubblicazione: (2024)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
di: Shin, Hyunjune, et al.
Pubblicazione: (2024)

Rethinking Decoupled Knowledge Distillation: A Predictive Distribution Perspective
di: Zheng, Bowen, et al.
Pubblicazione: (2025)

Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step
di: Zhou, Mingyuan, et al.
Pubblicazione: (2024)

Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information
di: Ye, Linfeng, et al.
Pubblicazione: (2024)

Score Distillation of Flow Matching Models
di: Zhou, Mingyuan, et al.
Pubblicazione: (2025)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
di: Matsuyama, Kazuhiro, et al.
Pubblicazione: (2025)

Optimizing Few-Step Generation with Adaptive Matching Distillation
di: Bai, Lichen, et al.
Pubblicazione: (2026)

Distilled Datamodel with Reverse Gradient Matching
di: Ye, Jingwen, et al.
Pubblicazione: (2024)

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
di: Lo, Ka Man, et al.
Pubblicazione: (2024)

EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation
di: Chen, Hong Cai, et al.
Pubblicazione: (2025)

SelMatch: Effectively Scaling Up Dataset Distillation via Selection-Based Initialization and Partial Updates by Trajectory Matching
di: Lee, Yongmin, et al.
Pubblicazione: (2024)

A Unified Revisit of Temperature in Classification-Based Knowledge Distillation
di: Frank, Logan, et al.
Pubblicazione: (2026)

Continual Distillation of Teachers from Different Domains
di: Michel, Nicolas, et al.
Pubblicazione: (2026)

Distilling the Knowledge in Data Pruning
di: Ben-Baruch, Emanuel, et al.
Pubblicazione: (2024)

Normalized Matching Transformer
di: Pourhadi, Abtin, et al.
Pubblicazione: (2025)

DataDAM: Efficient Dataset Distillation with Attention Matching
di: Sajedi, Ahmad, et al.
Pubblicazione: (2023)

ReMem: Mutual Information-Aware Fine-tuning of Pretrained Vision Transformers for Effective Knowledge Distillation
di: Dong, Chengyu, et al.
Pubblicazione: (2025)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
di: Zhang, Qifan, et al.
Pubblicazione: (2024)

Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10
di: Yasar, Umut Onur
Pubblicazione: (2026)

The Coupling Within: Flow Matching via Distilled Normalizing Flows
di: Berthelot, David, et al.
Pubblicazione: (2026)

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation
di: Nath, Utkarsh, et al.
Pubblicazione: (2023)

AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
di: Tang, Zihao, et al.
Pubblicazione: (2024)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
di: Yang, Penghui, et al.
Pubblicazione: (2024)

Densely Distilling Cumulative Knowledge for Continual Learning
di: Shi, Zenglin, et al.
Pubblicazione: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
di: Sadeghi, Mohammadreza, et al.
Pubblicazione: (2024)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
di: Jang, Jaeyeon, et al.
Pubblicazione: (2024)

Improving Neural ODEs via Knowledge Distillation
di: Chu, Haoyu, et al.
Pubblicazione: (2022)

Data-Augmented Quantization-Aware Knowledge Distillation
di: Kur, Justin, et al.
Pubblicazione: (2025)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
di: Guo, Guangyu, et al.
Pubblicazione: (2021)

Enhancing Weakly-Supervised Histopathology Image Segmentation with Knowledge Distillation on MIL-Based Pseudo-Labels
di: He, Yinsheng, et al.
Pubblicazione: (2024)

GIMS: Image Matching System Based on Adaptive Graph Construction and Graph Neural Network
di: Song, Xianfeng, et al.
Pubblicazione: (2024)