Copertina

CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Zao, Chen, Huaming, Ning, Pei, Yang, Nan, Yuan, Dong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Decoupled Kullback-Leibler Divergence Loss
di: Cui, Jiequan, et al.
Pubblicazione: (2023)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
di: Lv, Jiaming, et al.
Pubblicazione: (2024)

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
di: Luong, Hoang-Chau, et al.
Pubblicazione: (2026)

Generalized Kullback-Leibler Divergence Loss
di: Cui, Jiequan, et al.
Pubblicazione: (2025)

Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
di: Yang, Huchen, et al.
Pubblicazione: (2026)

Better Estimation of the Kullback--Leibler Divergence Between Language Models
di: Amini, Afra, et al.
Pubblicazione: (2025)

Nearly Minimax Discrete Distribution Estimation in Kullback-Leibler Divergence with High Probability
di: van der Hoeven, Dirk, et al.
Pubblicazione: (2025)

Relaxed Triangle Inequality for Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
di: Xiao, Shiji, et al.
Pubblicazione: (2026)

Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning
di: Dorent, Reuben, et al.
Pubblicazione: (2025)

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation
di: Scutari, Marco
Pubblicazione: (2023)

The Jacobian and Hessian of the Kullback-Leibler Divergence between Multivariate Gaussian Distributions (Technical Report)
di: Maroñas, Juan
Pubblicazione: (2025)

Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence
di: Chong, Mark Chiu, et al.
Pubblicazione: (2024)

Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
di: Zenn, Johannes, et al.
Pubblicazione: (2024)

Coarse-Grained Kullback--Leibler Control of Diffusion-Based Generative AI
di: Tsuruyama, Tatsuaki
Pubblicazione: (2026)

Kullback-Leibler Barycentre of Stochastic Processes
di: Jaimungal, Sebastian, et al.
Pubblicazione: (2024)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
di: Wu, Taiqiang, et al.
Pubblicazione: (2024)

Kullback-Leibler Maillard Sampling for Multi-armed Bandits with Bounded Rewards
di: Qin, Hao, et al.
Pubblicazione: (2023)

Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
di: Lin, Wu, et al.
Pubblicazione: (2025)

Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
di: Ishida, Yuichi, et al.
Pubblicazione: (2024)

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence
di: Nkurunziza, Jean Pacifique, et al.
Pubblicazione: (2024)

Jeffrey's update rule as a minimizer of Kullback-Leibler divergence
di: Pinzón, Carlos, et al.
Pubblicazione: (2025)

Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence
di: Chazal, Clémentine, et al.
Pubblicazione: (2024)

Sharper Perturbed-Kullback-Leibler Exponential Tail Bounds for Beta and Dirichlet Distributions
di: Perrault, Pierre
Pubblicazione: (2025)

Limits to classification performance by relating Kullback-Leibler divergence to Cohen's Kappa
di: Crow, L., et al.
Pubblicazione: (2024)

ScoreFusion: Fusing Score-based Generative Models via Kullback-Leibler Barycenters
di: Liu, Hao, et al.
Pubblicazione: (2024)

Kullback-Leibler excess risk bounds for exponential weighted aggregation in Generalized linear models
di: Mai, The Tien
Pubblicazione: (2025)

Achieving adaptivity and optimality for multi-armed bandits using Exponential-Kullback Leibler Maillard Sampling
di: Qin, Hao, et al.
Pubblicazione: (2025)

A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
di: Crucinio, Francesca Romana
Pubblicazione: (2025)

Probabilistic classification from possibilistic data: computing Kullback-Leibler projection with a possibility distribution
di: Baaj, Ismaïl, et al.
Pubblicazione: (2026)

The Hellinger Bounds on the Kullback-Leibler Divergence and the Bernstein Norm
di: Kaji, Tetsuya
Pubblicazione: (2026)

Fractional Programming for Kullback-Leibler Divergence in Hypothesis Testing
di: Park, Jeongwoo, et al.
Pubblicazione: (2026)

GuardFed: A Trustworthy Federated Learning Framework Against Dual-Facet Attacks
di: Li, Yanli, et al.
Pubblicazione: (2025)

Central Limit Theorem on Symmetric Kullback-Leibler (KL) Divergence
di: Rojas, Helder, et al.
Pubblicazione: (2024)

Robust Phase Retrieval via Reverse Kullback-Leibler Divergence
di: Choudhury, Nazia Afroz, et al.
Pubblicazione: (2022)

Fast Kd-trees for the Kullback--Leibler Divergence and other Decomposable Bregman Divergences
di: Pham, Tuyen, et al.
Pubblicazione: (2025)

Statistically Adaptive Differential Protection for AC Microgrids Based on Kullback-Leibler Divergence
di: Torkashvand, Shahab Moradi, et al.
Pubblicazione: (2025)

How Is Uncertainty Propagated in Knowledge Distillation?
di: Cui, Ziyao, et al.
Pubblicazione: (2026)

A New Estimator of Kullback--Leibler Divergence via Shannon Entropy
di: Cadirci, Mehmet Siddik, et al.
Pubblicazione: (2026)

Fairpriori: Improving Biased Subgroup Discovery for Deep Neural Network Fairness
di: Zhou, Kacy, et al.
Pubblicazione: (2024)

DP-LET: An Efficient Spatio-Temporal Network Traffic Prediction Framework
di: Wang, Xintong, et al.
Pubblicazione: (2025)