Cover Image

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lv, Jiaming, Yang, Haoyuan, Li, Peihua
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalized Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2025)

Decoupled Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2023)

Dataset Distillation via the Wasserstein Metric
by: Liu, Haoyang, et al.
Published: (2023)

Stereographic Spherical Sliced Wasserstein Distances
by: Tran, Huy, et al.
Published: (2024)

Wasserstein Distances Made Explainable: Insights Into Dataset Shifts and Transport Phenomena
by: Naumann, Philip, et al.
Published: (2025)

Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
by: Li, Yuqi, et al.
Published: (2025)

Better Estimation of the Kullback--Leibler Divergence Between Language Models
by: Amini, Afra, et al.
Published: (2025)

Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)

DistilDoc: Knowledge Distillation for Visually-Rich Document Applications
by: Van Landeghem, Jordy, et al.
Published: (2024)

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
by: Adhane, Gereziher, et al.
Published: (2024)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
by: Ma, Jing, et al.
Published: (2022)

Semi-Supervised Image Captioning Considering Wasserstein Graph Matching
by: Yang, Yang
Published: (2024)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)

Self-Supervised Quantization-Aware Knowledge Distillation
by: Zhao, Kaiqi, et al.
Published: (2024)

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation
by: Scutari, Marco
Published: (2023)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
by: Parchami-Araghi, Amin, et al.
Published: (2024)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
by: Xiang, Jinlin, et al.
Published: (2025)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

Dual-Model Weight Selection and Self-Knowledge Distillation for Medical Image Classification
by: Tsutsumi, Ayaka, et al.
Published: (2025)

Multi-View 3D Reconstruction using Knowledge Distillation
by: Dutt, Aditya, et al.
Published: (2024)

PLD: A Choice-Theoretic List-Wise Knowledge Distillation
by: Bassam, Ejafa, et al.
Published: (2025)

VDSB-GWSyn: Diffusion Schrödinger Bridge for Controllable and Anatomically Feasible Guidewire Synthesis in Coronary Angiography
by: Tang, Haoyuan, et al.
Published: (2026)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
by: Xiang, Qianlong, et al.
Published: (2024)

DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
by: Huang, Haiduo, et al.
Published: (2025)

Generative Dataset Distillation Based on Self-knowledge Distillation
by: Li, Longzhen, et al.
Published: (2025)

Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
by: Mistretta, Marco, et al.
Published: (2024)

Adaptive Knowledge Distillation for Classification of Hand Images using Explainable Vision Transformers
by: Nguyen, Thanh Thi, et al.
Published: (2024)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
by: Shin, Hyunjune, et al.
Published: (2024)

MIND: Modality-Informed Knowledge Distillation Framework for Multimodal Clinical Prediction Tasks
by: Guerra-Manzanares, Alejandro, et al.
Published: (2025)

HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting
by: Zhu, Songfeng
Published: (2026)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

KD-OCT: Efficient Knowledge Distillation for Clinical-Grade Retinal OCT Classification
by: Nourbakhsh, Erfan, et al.
Published: (2025)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
by: Wu, Taiqiang, et al.
Published: (2024)

Sliced Wasserstein with Random-Path Projecting Directions
by: Nguyen, Khai, et al.
Published: (2024)

On Flow Matching KL Divergence
by: Su, Maojiang, et al.
Published: (2025)

Hyperbolic Dataset Distillation
by: Li, Wenyuan, et al.
Published: (2025)

Distilling Knowledge for Short-to-Long Term Trajectory Prediction
by: Das, Sourav, et al.
Published: (2023)