Copertina

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Shin, Hyunjune, Choi, Dong-Wan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

The Role of Teacher Calibration in Knowledge Distillation
di: Kim, Suyoung, et al.
Pubblicazione: (2025)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
di: Parchami-Araghi, Amin, et al.
Pubblicazione: (2024)

PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation
di: Ranzinger, Mike, et al.
Pubblicazione: (2024)

Small Scale Data-Free Knowledge Distillation
di: Liu, He, et al.
Pubblicazione: (2024)

When Data-Free Knowledge Distillation Meets Non-Transferable Teacher: Escaping Out-of-Distribution Trap is All You Need
di: Hong, Ziming, et al.
Pubblicazione: (2025)

Heuristic-Free Multi-Teacher Learning
di: Nguyen, Huy Thong, et al.
Pubblicazione: (2024)

Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
di: Lee, Byung-Kwan, et al.
Pubblicazione: (2025)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
di: Xiang, Qianlong, et al.
Pubblicazione: (2024)

Training Self-localization Models for Unseen Unfamiliar Places via Teacher-to-Student Data-Free Knowledge Transfer
di: Tsukahara, Kenta, et al.
Pubblicazione: (2024)

Training-Free Restoration of Pruned Neural Networks
di: Lee, Keonho, et al.
Pubblicazione: (2025)

Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets
di: Iordache, Adrian, et al.
Pubblicazione: (2024)

Do Students Debias Like Teachers? On the Distillability of Bias Mitigation Methods
di: Cheng, Jiali, et al.
Pubblicazione: (2025)

Automatic Extraction of Road Networks by using Teacher-Student Adaptive Structural Deep Belief Network and Its Application to Landslide Disaster
di: Kamada, Shin, et al.
Pubblicazione: (2025)

Enhancing Object Detection with Privileged Information: A Model-Agnostic Teacher-Student Approach
di: Bartolo, Matthias, et al.
Pubblicazione: (2026)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
di: Xiang, Jinlin, et al.
Pubblicazione: (2025)

Recall-Oriented Continual Learning with Generative Adversarial Meta-Model
di: Kang, Haneol, et al.
Pubblicazione: (2024)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
di: Kim, Taeheon, et al.
Pubblicazione: (2025)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
di: Li, Yuqi, et al.
Pubblicazione: (2025)

Dynamic Temperature Knowledge Distillation
di: Wei, Yukang, et al.
Pubblicazione: (2024)

Multi-Label Knowledge Distillation
di: Yang, Penghui, et al.
Pubblicazione: (2023)

DistilDoc: Knowledge Distillation for Visually-Rich Document Applications
di: Van Landeghem, Jordy, et al.
Pubblicazione: (2024)

Toward an Artificial General Teacher: Procedural Geometry Data Generation and Visual Grounding with Vision-Language Models
di: Nguyen-Truong, Hai, et al.
Pubblicazione: (2026)

Knowledge Distillation Based on Transformed Teacher Matching
di: Zheng, Kaixiang, et al.
Pubblicazione: (2024)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
di: Li, Hui, et al.
Pubblicazione: (2025)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
di: Adhane, Gereziher, et al.
Pubblicazione: (2024)

ScaleKD: Strong Vision Transformers Could Be Excellent Teachers
di: Fan, Jiawei, et al.
Pubblicazione: (2024)

Self-Supervised Quantization-Aware Knowledge Distillation
di: Zhao, Kaiqi, et al.
Pubblicazione: (2024)

LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights
di: Castells, Thibault, et al.
Pubblicazione: (2024)

Distilling Dataset into Neural Field
di: Shin, Donghyeok, et al.
Pubblicazione: (2025)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
di: Wu, Wenyuan, et al.
Pubblicazione: (2025)

Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning
di: Hu, Zixuan, et al.
Pubblicazione: (2023)

Multi-Surrogate-Teacher Assistance for Representation Alignment in Fingerprint-based Indoor Localization
di: Nguyen, Son Minh, et al.
Pubblicazione: (2024)

VideoGuide: Improving Video Diffusion Models without Training Through a Teacher's Guide
di: Lee, Dohun, et al.
Pubblicazione: (2024)

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization
di: Kang, Seongjae, et al.
Pubblicazione: (2025)

Multi-View 3D Reconstruction using Knowledge Distillation
di: Dutt, Aditya, et al.
Pubblicazione: (2024)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
di: Lv, Jiaming, et al.
Pubblicazione: (2024)

PLD: A Choice-Theoretic List-Wise Knowledge Distillation
di: Bassam, Ejafa, et al.
Pubblicazione: (2025)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
di: Ma, Jing, et al.
Pubblicazione: (2022)

MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity
di: Choi, Kanghyun, et al.
Pubblicazione: (2024)

PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher
di: Kim, Dongjun, et al.
Pubblicazione: (2024)