Cover Image

Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dorent, Reuben, Golland, Polina, Wells III, William
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Representation Jensen-Shannon Divergence
by: Hoyos-Osorio, Jhoan K., et al.
Published: (2023)

Relaxed Triangle Inequality for Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
by: Xiao, Shiji, et al.
Published: (2026)

Black-Box Detection of LLM-Generated Text Using Generalized Jensen-Shannon Divergence
by: Chen, Shuangyi, et al.
Published: (2025)

Two tales for a geometric Jensen--Shannon divergence
by: Nielsen, Frank
Published: (2025)

A New Estimator of Kullback--Leibler Divergence via Shannon Entropy
by: Cadirci, Mehmet Siddik, et al.
Published: (2026)

Geometric Jensen-Shannon Divergence Between Gaussian Measures On Hilbert Space
by: Quang, Minh Ha, et al.
Published: (2025)

Decoupled Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2023)

Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
by: Ishida, Yuichi, et al.
Published: (2024)

A Connection Between Learning to Reject and Bhattacharyya Divergences
by: Soen, Alexander
Published: (2025)

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence
by: Nkurunziza, Jean Pacifique, et al.
Published: (2024)

Generalized Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2025)

Jensen-Shannon Divergence Message-Passing for Rich-Text Graph Representation Learning
by: Wang, Zuo, et al.
Published: (2025)

The Hellinger Bounds on the Kullback-Leibler Divergence and the Bernstein Norm
by: Kaji, Tetsuya
Published: (2026)

Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence
by: Chong, Mark Chiu, et al.
Published: (2024)

Robust Stochastic Outperformance under Kullback-Leibler Ambiguity
by: Hür, Ozan
Published: (2025)

Generalization Bounds for Quantum Learning via Rényi Divergences
by: Warsi, Naqueeb Ahmad, et al.
Published: (2025)

Better Estimation of the Kullback--Leibler Divergence Between Language Models
by: Amini, Afra, et al.
Published: (2025)

Kullback-Leibler excess risk bounds for exponential weighted aggregation in Generalized linear models
by: Mai, The Tien
Published: (2025)

ScoreFusion: Fusing Score-based Generative Models via Kullback-Leibler Barycenters
by: Liu, Hao, et al.
Published: (2024)

Bounds on the Excess Minimum Risk via Generalized Information Divergence Measures
by: Omanwar, Ananya, et al.
Published: (2025)

Nearly Minimax Discrete Distribution Estimation in Kullback-Leibler Divergence with High Probability
by: van der Hoeven, Dirk, et al.
Published: (2025)

Implicit Hypothesis Testing and Divergence Preservation in Neural Network Representations
by: Aksoy, Kadircan, et al.
Published: (2026)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
by: Lv, Jiaming, et al.
Published: (2024)

A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
by: Crucinio, Francesca Romana
Published: (2025)

A Unified Representation of Density-Power-Based Divergences Reducible to M-Estimation
by: Kobayashi, Masahiro
Published: (2025)

Robust Semi-supervised Learning via $f$-Divergence and $α$-Rényi Divergence
by: Aminian, Gholamali, et al.
Published: (2024)

Kullback-Leibler Maillard Sampling for Multi-armed Bandits with Bounded Rewards
by: Qin, Hao, et al.
Published: (2023)

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence
by: Zhang, Zao, et al.
Published: (2024)

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation
by: Scutari, Marco
Published: (2023)

A Neural Network Algorithm for KL Divergence Estimation with Quantitative Error Bounds
by: Foss, Mikil, et al.
Published: (2025)

The Jacobian and Hessian of the Kullback-Leibler Divergence between Multivariate Gaussian Distributions (Technical Report)
by: Maroñas, Juan
Published: (2025)

JEDI: The Force of Jensen-Shannon Divergence in Disentangling Diffusion Models
by: Bill, Eric Tillmann, et al.
Published: (2025)

Sharper Perturbed-Kullback-Leibler Exponential Tail Bounds for Beta and Dirichlet Distributions
by: Perrault, Pierre
Published: (2025)

Jensen-Shannon Divergence Based Novel Loss Functions for Bayesian Neural Networks
by: Thiagarajan, Ponkrshnan, et al.
Published: (2022)

Relationship between Hölder Divergence and Functional Density Power Divergence: Intersection and Generalization
by: Kobayashi, Masahiro
Published: (2025)

Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
by: Zenn, Johannes, et al.
Published: (2024)

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
by: Ouyang, Xu, et al.
Published: (2026)

Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
by: Yang, Huchen, et al.
Published: (2026)

Kullback-Leibler Barycentre of Stochastic Processes
by: Jaimungal, Sebastian, et al.
Published: (2024)