Cover Image

Estimation of discrete distributions in relative entropy, and the deviations of the missing mass

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Mourtada, Jaouad
Format:	Preprint
Published:	2025
Subjects:	Statistics Theory Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Universal coding, intrinsic volumes, and metric complexity
by: Mourtada, Jaouad
Published: (2023)

Finite-sample performance of the maximum likelihood estimator in logistic regression
by: Chardon, Hugo, et al.
Published: (2024)

Ratio Covers of Convex Sets and Optimal Mixture Density Estimation
by: Compton, Spencer, et al.
Published: (2026)

Estimating stationary mass, frequency by frequency
by: Nakul, Milind, et al.
Published: (2025)

Overfitting has a limitation: a model-independent generalization gap bound based on Rényi entropy
by: Suzuki, Atsushi, et al.
Published: (2025)

$L^1$ Estimation: On the Optimality of Linear Estimators
by: Barnes, Leighton P., et al.
Published: (2023)

Statistical Mean Estimation with Coded Relayed Observations
by: Ling, Yan Hao, et al.
Published: (2025)

Robust Estimation Under Heterogeneous Corruption Rates
by: Chaudhuri, Syomantak, et al.
Published: (2025)

Unbiased Estimating Equation on Inverse Divergence and Its Conditions
by: Kobayashi, Masahiro, et al.
Published: (2024)

Instance-Optimal Estimation with Multiple LLM Judges on a Budget
by: Lee, Junghyun, et al.
Published: (2026)

Sequential 1-bit Mean Estimation with Near-Optimal Sample Complexity
by: Lau, Ivan, et al.
Published: (2025)

Distributed Nonparametric Estimation: from Sparse to Dense Samples per Terminal
by: Yuan, Deheng, et al.
Published: (2025)

A Unified Representation of Density-Power-Based Divergences Reducible to M-Estimation
by: Kobayashi, Masahiro
Published: (2025)

Empirical Bayes Estimation for Lasso-Type Regularizers: Analysis of Automatic Relevance Determination
by: Yoshida, Tsukasa, et al.
Published: (2025)

Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes
by: Lau, Ivan, et al.
Published: (2026)

Federated PCA and Estimation for Spiked Covariance Matrices: Optimal Rates and Efficient Algorithm
by: Li, Jingyang, et al.
Published: (2024)

Adaptive Refinement Protocols for Distributed Distribution Estimation under $\ell^p$-Losses
by: Yuan, Deheng, et al.
Published: (2024)

Fundamental limits of distributed covariance matrix estimation via a conditional strong data processing inequality
by: Rahmani, Mohammad Reza, et al.
Published: (2025)

On the Nonasymptotic Scaling Guarantee of Hyperparameter Estimation in Inhomogeneous, Weakly-Dependent Complex Network Dynamical Systems
by: Yu, Yi, et al.
Published: (2026)

Maximum entropy based testing in network models: ERGMs and constrained optimization
by: Ghosh, Subhro, et al.
Published: (2026)

A new pathway to generative artificial intelligence by minimizing the maximum entropy
by: Miotto, Mattia, et al.
Published: (2025)

Estimation of discrete distributions with high probability under $χ^2$-divergence
by: Louati, Sirine
Published: (2025)

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices
by: Cai, T. Tony, et al.
Published: (2024)

Quantum Fisher information matrices from Rényi relative entropies
by: Wilde, Mark M.
Published: (2025)

Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery
by: Kovačević, Filip, et al.
Published: (2025)

Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing
by: Zhang, Yihan, et al.
Published: (2023)

Just Wing It: Near-Optimal Estimation of Missing Mass in a Markovian Sequence
by: Pananjady, Ashwin, et al.
Published: (2024)

Optimal Estimation in Orthogonally Invariant Generalized Linear Models: Spectral Initialization and Approximate Message Passing
by: Zhang, Yihan, et al.
Published: (2026)

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation
by: Tohme, Tony, et al.
Published: (2023)

A non-asymptotic distributional theory of approximate message passing for sparse and robust regression
by: Li, Gen, et al.
Published: (2024)

Information-Geometric Decomposition of Generalization Error in Unsupervised Learning
by: Kim, Gilhan
Published: (2026)

Online Clustering of Data Sequences with Bandit Information
by: Chandran, G Dhinesh, et al.
Published: (2025)

Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models
by: Chen, Haohua, et al.
Published: (2025)

On Robust Hypothesis Testing with respect to the Hellinger Distance
by: Modak, Eeshan, et al.
Published: (2025)

Distribution free M-estimation
by: Areces, Felipe, et al.
Published: (2025)

Asymptotic Theory of Eigenvectors for Latent Embeddings with Generalized Laplacian Matrices
by: Fan, Jianqing, et al.
Published: (2025)

On Instability of Minimax Optimal Optimism-Based Bandit Algorithms
by: Praharaj, Samya, et al.
Published: (2025)

Optimal Anytime-Valid Tests for Composite Nulls
by: Shekhar, Shubhanshu
Published: (2025)

Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
by: Li, Gen, et al.
Published: (2025)

Avoiding the Price of Adaptivity: Inference in Linear Contextual Bandits via Stability
by: Praharaj, Samya, et al.
Published: (2025)