Cover Image

Nearly Minimax Discrete Distribution Estimation in Kullback-Leibler Divergence with High Probability

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	van der Hoeven, Dirk, Olkhovskaia, Julia, van Erven, Tim
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Better Estimation of the Kullback--Leibler Divergence Between Language Models
by: Amini, Afra, et al.
Published: (2025)

Decoupled Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2023)

Generalized Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2025)

Relaxed Triangle Inequality for Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
by: Xiao, Shiji, et al.
Published: (2026)

The Jacobian and Hessian of the Kullback-Leibler Divergence between Multivariate Gaussian Distributions (Technical Report)
by: Maroñas, Juan
Published: (2025)

Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence
by: Chong, Mark Chiu, et al.
Published: (2024)

Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
by: Zenn, Johannes, et al.
Published: (2024)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
by: Lv, Jiaming, et al.
Published: (2024)

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation
by: Scutari, Marco
Published: (2023)

CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence
by: Zhang, Zao, et al.
Published: (2024)

Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning
by: Dorent, Reuben, et al.
Published: (2025)

Kullback-Leibler Barycentre of Stochastic Processes
by: Jaimungal, Sebastian, et al.
Published: (2024)

Sharper Perturbed-Kullback-Leibler Exponential Tail Bounds for Beta and Dirichlet Distributions
by: Perrault, Pierre
Published: (2025)

Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
by: Yang, Huchen, et al.
Published: (2026)

Sample-efficient Learning of Concepts with Theoretical Guarantees: from Data to Concepts without Interventions
by: Fokkema, Hidde, et al.
Published: (2025)

When Lower-Order Terms Dominate: Adaptive Expert Algorithms for Heavy-Tailed Losses
by: Moulin, Antoine, et al.
Published: (2025)

Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
by: Lin, Wu, et al.
Published: (2025)

An Improved Algorithm for Adversarial Linear Contextual Bandits via Reduction
by: van Erven, Tim, et al.
Published: (2025)

Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
by: Ishida, Yuichi, et al.
Published: (2024)

The Risks of Recourse in Binary Classification
by: Fokkema, Hidde, et al.
Published: (2023)

Kullback-Leibler Maillard Sampling for Multi-armed Bandits with Bounded Rewards
by: Qin, Hao, et al.
Published: (2023)

Coarse-Grained Kullback--Leibler Control of Diffusion-Based Generative AI
by: Tsuruyama, Tatsuaki
Published: (2026)

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence
by: Nkurunziza, Jean Pacifique, et al.
Published: (2024)

Jeffrey's update rule as a minimizer of Kullback-Leibler divergence
by: Pinzón, Carlos, et al.
Published: (2025)

Beyond Bandit Feedback in Online Multiclass Classification
by: van der Hoeven, Dirk, et al.
Published: (2021)

An Online Feasible Point Method for Benign Generalized Nash Equilibrium Problems
by: Sachs, Sarah, et al.
Published: (2024)

Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence
by: Chazal, Clémentine, et al.
Published: (2024)

Limits to classification performance by relating Kullback-Leibler divergence to Cohen's Kappa
by: Crow, L., et al.
Published: (2024)

Accelerated Rates between Stochastic and Adversarial Online Convex Optimization
by: Sachs, Sarah, et al.
Published: (2023)

Kullback-Leibler excess risk bounds for exponential weighted aggregation in Generalized linear models
by: Mai, The Tien
Published: (2025)

ScoreFusion: Fusing Score-based Generative Models via Kullback-Leibler Barycenters
by: Liu, Hao, et al.
Published: (2024)

Online Newton Method for Bandit Convex Optimisation
by: Fokkema, Hidde, et al.
Published: (2024)

Probabilistic classification from possibilistic data: computing Kullback-Leibler projection with a possibility distribution
by: Baaj, Ismaïl, et al.
Published: (2026)

A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
by: Crucinio, Francesca Romana
Published: (2025)

Learning on the Edge: Online Learning with Stochastic Feedback Graphs
by: Esposito, Emmanuel, et al.
Published: (2022)

Achieving adaptivity and optimality for multi-armed bandits using Exponential-Kullback Leibler Maillard Sampling
by: Qin, Hao, et al.
Published: (2025)

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization
by: Genans, Ferdinand, et al.
Published: (2024)

High-Probability Minimax Adaptive Estimation in Besov Spaces via Online-to-Batch
by: Liautaud, Paul, et al.
Published: (2026)

Quantum Causal Discovery via Amplitude Estimation of Kullback-Leibler Divergence
by: Sodagari, Shabnam
Published: (2026)