Cover Image

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Parchami-Araghi, Amin, Böhle, Moritz, Rao, Sukrut, Schiele, Bernt
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Studying How to Efficiently and Effectively Guide Models with Explanations
by: Rao, Sukrut, et al.
Published: (2023)

FaCT: Faithful Concept Traces for Explaining Neural Network Decisions
by: Parchami-Araghi, Amin, et al.
Published: (2025)

Better Understanding Differences in Attribution Methods via Systematic Evaluations
by: Rao, Sukrut, et al.
Published: (2023)

CFM: Language-aligned Concept Foundation Model for Vision
by: Wittenmayer, Kai, et al.
Published: (2026)

B-cosification: Transforming Deep Neural Networks to be Inherently Interpretable
by: Arya, Shreyash, et al.
Published: (2024)

Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery
by: Rao, Sukrut, et al.
Published: (2024)

Towards Better Understanding Attribution Methods
by: Rao, Sukrut, et al.
Published: (2022)

Optimising for Interpretability: Convolutional Dynamic Alignment Networks
by: Böhle, Moritz, et al.
Published: (2021)

Adversarial Training against Location-Optimized Adversarial Patches
by: Rao, Sukrut, et al.
Published: (2020)

Pixel-level Certified Explanations via Randomized Smoothing
by: Anani, Alaa, et al.
Published: (2025)

How to Probe: Simple Yet Effective Techniques for Improving Post-hoc Explanations
by: Gairola, Siddhartha, et al.
Published: (2025)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
by: Adhane, Gereziher, et al.
Published: (2024)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
by: Shin, Hyunjune, et al.
Published: (2024)

An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning
by: Chen, Hao, et al.
Published: (2022)

TrajPRed: Trajectory Prediction with Region-based Relation Learning
by: Zhou, Chen, et al.
Published: (2024)

B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers
by: Böhle, Moritz, et al.
Published: (2023)

PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding
by: Kuzucu, Selim, et al.
Published: (2026)

What is Missing? Explaining Neurons Activated by Absent Concepts
by: Hesse, Robin, et al.
Published: (2026)

DAVE: Distribution-aware Attribution via ViT Gradient Decomposition
by: Wróbel, Adam, et al.
Published: (2026)

Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)

Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)

DistilDoc: Knowledge Distillation for Visually-Rich Document Applications
by: Van Landeghem, Jordy, et al.
Published: (2024)

Enhancing CLIP Conceptual Embedding through Knowledge Distillation
by: Kao, Kuei-Chun
Published: (2024)

PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation
by: Ranzinger, Mike, et al.
Published: (2024)

Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
by: Lee, Byung-Kwan, et al.
Published: (2025)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)

Self-Supervised Quantization-Aware Knowledge Distillation
by: Zhao, Kaiqi, et al.
Published: (2024)

Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets
by: Iordache, Adrian, et al.
Published: (2024)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
by: Xiang, Jinlin, et al.
Published: (2025)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
by: Li, Yuqi, et al.
Published: (2025)

TbExplain: A Text-based Explanation Method for Scene Classification Models with the Statistical Prediction Correction
by: Aminimehr, Amirhossein, et al.
Published: (2023)

Multi-View 3D Reconstruction using Knowledge Distillation
by: Dutt, Aditya, et al.
Published: (2024)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
by: Lv, Jiaming, et al.
Published: (2024)

PLD: A Choice-Theoretic List-Wise Knowledge Distillation
by: Bassam, Ejafa, et al.
Published: (2025)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
by: Ma, Jing, et al.
Published: (2022)

Clinical Domain Knowledge-Derived Template Improves Post Hoc AI Explanations in Pneumothorax Classification
by: Yuan, Han, et al.
Published: (2024)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
by: Xiang, Qianlong, et al.
Published: (2024)

DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
by: Huang, Haiduo, et al.
Published: (2025)