Cover Image

Information-theoretic Limits of Learning and Estimation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gamal, Abbas El, Raginsky, Maxim
Format:	Preprint
Published:	2026
Subjects:	Information Theory Machine Learning Statistics Theory 60, 62, 68 G.3
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Information Theory and Statistical Learning
by: Gamal, Abbas El
Published: (2026)

On the Convergence of the ELBO to Entropy Sums
by: Lücke, Jörg, et al.
Published: (2022)

Generative Models with ELBOs Converging to Entropy Sums
by: Warnken, Jan, et al.
Published: (2024)

Improving Numerical Stability of Normalized Mutual Information Estimator on High Dimensions
by: Tuononen, Marko, et al.
Published: (2024)

Model Monitoring: A General Framework with an Application to Non-life Insurance Pricing
by: Brauer, Alexej, et al.
Published: (2025)

Model-free filtering in high dimensions via projection and score-based diffusions
by: Christensen, Sören, et al.
Published: (2025)

Realizable Bayes-Consistency for General Metric Losses
by: Cohen, Dan Tsir, et al.
Published: (2026)

Estimating the size of a set using cascading exclusion
by: Chatterjee, Sourav, et al.
Published: (2025)

Learning stochastic multiscale models through normalizing flows
by: Saha, Anan, et al.
Published: (2026)

The Minimax Risk in Testing Uniformity over Large Alphabets under Missing-Ball Alternatives
by: Kipnis, Alon
Published: (2023)

Stochastic gradient descent in high dimensions for multi-spiked tensor PCA
by: Arous, Gérard Ben, et al.
Published: (2024)

Statistical-Computational Trade-offs for Recursive Adaptive Partitioning Estimators
by: Tan, Yan Shuo, et al.
Published: (2024)

Spatio-temporal probabilistic forecast using MMAF-guided learning
by: Bardi, Leonardo, et al.
Published: (2026)

Efficient and Minimax Optimal In-context Nonparametric Regression with Transformers
by: Ching, Michelle, et al.
Published: (2026)

Optimal In-context Adaptivity and Distributional Robustness of Transformers
by: Ma, Tianyi, et al.
Published: (2025)

Langevin dynamics for high-dimensional optimization: the case of multi-spiked tensor PCA
by: Arous, Gérard Ben, et al.
Published: (2024)

Sparse joint shift in multinomial classification
by: Tasche, Dirk
Published: (2023)

Optimal Federated Learning for Functional Mean Estimation under Heterogeneous Privacy Constraints
by: Cai, Tony, et al.
Published: (2024)

Quantitative Error Bounds for Scaling Limits of Stochastic Iterative Algorithms
by: Wang, Xiaoyu, et al.
Published: (2025)

Statistical learning does not always entail knowledge
by: Díaz-Pachón, Daniel Andrés, et al.
Published: (2024)

Comparing Scale Parameter Estimators for Gaussian Process Interpolation with the Brownian Motion Prior: Leave-One-Out Cross Validation and Maximum Likelihood
by: Naslidnyk, Masha, et al.
Published: (2023)

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning
by: Borkar, Vivek, et al.
Published: (2021)

A Wasserstein perspective of Vanilla GANs
by: Kunkel, Lea, et al.
Published: (2024)

On the minimax optimality of Flow Matching through the connection to kernel density estimation
by: Kunkel, Lea, et al.
Published: (2025)

A PAC-Bayes oracle inequality for sparse neural networks
by: Steffen, Maximilian F., et al.
Published: (2022)

Distribution estimation via Flow Matching with Lipschitz guarantees
by: Kunkel, Lea
Published: (2025)

Kernel $ε$-Greedy for Multi-Armed Bandits with Covariates
by: Arya, Sakshi, et al.
Published: (2023)

Differentially Private Synthetic Data with Private Density Estimation
by: Bojkovic, Nikolija, et al.
Published: (2024)

Finding a dense submatrix of a random matrix. Sharp bounds for online algorithms
by: Bhamidi, Shankar, et al.
Published: (2025)

On the Statistical Optimality of Optimal Decision Trees
by: Xu, Zineng, et al.
Published: (2026)

Understanding the Effect of GCN Convolutions in Regression Tasks
by: Chen, Juntong, et al.
Published: (2024)

Sharp Convergence Rates of Empirical Unbalanced Optimal Transport for Spatio-Temporal Point Processes
by: Struleva, Marina, et al.
Published: (2025)

The Bernstein-von Mises theorem and efficiency for semiparametric inference in multivariate Hawkes processes
by: Duverger, Mael, et al.
Published: (2026)

Multivariate Spatio-Temporal Neural Hawkes Processes
by: Chukwuemeka, Christopher, et al.
Published: (2026)

Calibration Bands for Mean Estimates within the Exponential Dispersion Family
by: Delong, Łukasz, et al.
Published: (2025)

Optimal minimax rate of learning nonlocal interaction kernels
by: Wang, Xiong, et al.
Published: (2023)

From Tail Universality to Bernstein-von Mises: A Unified Statistical Theory of Semi-Implicit Variational Inference
by: Plummer, Sean
Published: (2025)

Universal Shuffle Asymptotics, Part II: Non-Gaussian Limits for Shuffle Privacy -- Poisson, Skellam, and Compound-Poisson Regimes
by: Shvets, Alex
Published: (2026)

Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingales
by: Steinwart, Ingo
Published: (2024)

Moment Expansions of the Energy Distance
by: Langmore, Ian
Published: (2025)