Cover Image

Empirical Risk Minimization with Relative Entropy Regularization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Perlaza, Samir M., Bisson, Gaetan, Esnaola, Iñaki, Jean-Marie, Alain, Rini, Stefano
Format:	Preprint
Published:	2022
Subjects:	Statistics Theory Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Proofs for Folklore Theorems on the Radon-Nikodym Derivative
by: Bermudez, Yaiza, et al.
Published: (2025)

Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization
by: Daunas, Francisco, et al.
Published: (2024)

Variations on the Expectation due to Changes in the Probability Measure
by: Perlaza, Samir M., et al.
Published: (2025)

Equivalence of the Empirical Risk Minimization to Regularization on the Family of f-Divergences
by: Daunas, Francisco, et al.
Published: (2024)

Decentralized Machine Learning with Centralized Performance Guarantees via Gibbs Algorithms
by: Bermudez, Yaiza, et al.
Published: (2026)

A Dual Optimization View to Empirical Risk Minimization with f-Divergence Regularization
by: Daunas, Francisco, et al.
Published: (2025)

Empirical Risk Minimization with $f$-Divergence Regularization
by: Daunas, Francisco, et al.
Published: (2026)

Empirical Bayes Estimation for Lasso-Type Regularizers: Analysis of Automatic Relevance Determination
by: Yoshida, Tsukasa, et al.
Published: (2025)

The Generalization Error of Supervised Machine Learning Algorithms
by: Perlaza, Samir M., et al.
Published: (2024)

Decoupled Entropy Minimization
by: Ma, Jing, et al.
Published: (2025)

$L_2$-Regularized Empirical Risk Minimization Guarantees Small Smooth Calibration Error
by: Fujisawa, Masahiro, et al.
Published: (2025)

Breaking the Finite-Sample Barrier in Entropy Coupling
by: Asoodeh, Shahab, et al.
Published: (2026)

Leveraging Noisy Observations in Zero-Sum Games
by: Athanasakos, Emmanouil M, et al.
Published: (2024)

On the Variance, Admissibility, and Stability of Empirical Risk Minimization
by: Kur, Gil, et al.
Published: (2023)

A Researcher's Guide to Empirical Risk Minimization
by: van der Laan, Lars
Published: (2026)

Optimal Excess Risk Bounds for Empirical Risk Minimization on $p$-Norm Linear Regression
by: Hanchi, Ayoub El, et al.
Published: (2023)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
by: Ioushua, Shahar Stein, et al.
Published: (2023)

Statistical-Computational Trade-offs in Tensor PCA and Related Problems via Communication Complexity
by: Dudeja, Rishabh, et al.
Published: (2022)

Neural Entropy
by: Premkumar, Akhil
Published: (2024)

Differentially Private Two-Stage Empirical Risk Minimization with Applications to Individualized Treatment Rule
by: Lee, Joowon, et al.
Published: (2026)

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation
by: Tohme, Tony, et al.
Published: (2023)

Coupled Entropy: A Goldilocks Generalization for Complex Systems
by: Nelson, Kenric P.
Published: (2025)

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability
by: Zhao, Qingyue, et al.
Published: (2026)

Functional Properties of the Focal-Entropy
by: Shah, Jaimin, et al.
Published: (2026)

Generalizability of Neural Networks Minimizing Empirical Risk Based on Expressive Ability
by: Yu, Lijia, et al.
Published: (2025)

Quantum Neural Estimation of Entropies
by: Goldfeld, Ziv, et al.
Published: (2023)

Information-Geometric Decomposition of Generalization Error in Unsupervised Learning
by: Kim, Gilhan
Published: (2026)

Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality
by: Wibisono, Andre
Published: (2025)

Variational Representations of Annealing Paths: Bregman Information under Monotonic Embedding
by: Brekelmans, Rob, et al.
Published: (2022)

Precise Asymptotics for Spectral Methods in Mixed Generalized Linear Models
by: Zhang, Yihan, et al.
Published: (2022)

Fine-Grained Uncertainty Quantification via Collisions
by: Friedbaum, Jesse, et al.
Published: (2024)

Efficient Sampling with Discrete Diffusion Models: Sharp and Adaptive Guarantees
by: Dmitriev, Daniil, et al.
Published: (2026)

Online Clustering of Data Sequences with Bandit Information
by: Chandran, G Dhinesh, et al.
Published: (2025)

Efficient Unbiased Sparsification
by: Barnes, Leighton, et al.
Published: (2024)

Sample efficient inductive matrix completion with noise and inexact side information
by: Yang, Yuepeng, et al.
Published: (2026)

Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptions
by: Zhang, Kaihong, et al.
Published: (2024)

Top-$K$ ranking with a monotone adversary
by: Yang, Yuepeng, et al.
Published: (2024)

Characterizing Dependence of Samples along the Langevin Dynamics and Algorithms via Contraction of $Φ$-Mutual Information
by: Liang, Jiaming, et al.
Published: (2024)

Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models
by: Chen, Haohua, et al.
Published: (2025)

Decoupled Descent: Exact Test Error Tracking Via Approximate Message Passing
by: Lovig, Max
Published: (2026)