Cover Image

Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Daunas, Francisco, Esnaola, Iñaki, Perlaza, Samir M., Poor, H. Vincent
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Equivalence of the Empirical Risk Minimization to Regularization on the Family of f-Divergences
by: Daunas, Francisco, et al.
Published: (2024)

Empirical Risk Minimization with $f$-Divergence Regularization
by: Daunas, Francisco, et al.
Published: (2026)

Empirical Risk Minimization with Relative Entropy Regularization
by: Perlaza, Samir M., et al.
Published: (2022)

A Dual Optimization View to Empirical Risk Minimization with f-Divergence Regularization
by: Daunas, Francisco, et al.
Published: (2025)

Decentralized Machine Learning with Centralized Performance Guarantees via Gibbs Algorithms
by: Bermudez, Yaiza, et al.
Published: (2026)

Generalization Error of $f$-Divergence Stabilized Algorithms via Duality
by: Daunas, Francisco, et al.
Published: (2025)

Proofs for Folklore Theorems on the Radon-Nikodym Derivative
by: Bermudez, Yaiza, et al.
Published: (2025)

The Generalization Error of Supervised Machine Learning Algorithms
by: Perlaza, Samir M., et al.
Published: (2024)

Variations on the Expectation due to Changes in the Probability Measure
by: Perlaza, Samir M., et al.
Published: (2025)

Leveraging Noisy Observations in Zero-Sum Games
by: Athanasakos, Emmanouil M, et al.
Published: (2024)

Fast Computation of Optimal Transport via Entropy-Regularized Extragradient Methods
by: Li, Gen, et al.
Published: (2023)

Simultaneous Information and Energy Transmission with Short Packets and Finite Constellations
by: Zuhra, Sadaf ul, et al.
Published: (2024)

An Elementary Approach to Scheduling in Generative Diffusion Models
by: Sun, Qiang, et al.
Published: (2026)

A Memory-Based Reinforcement Learning Approach to Integrated Sensing and Communication
by: Nikbakht, Homa, et al.
Published: (2024)

$L^1$ Estimation: On the Optimality of Linear Estimators
by: Barnes, Leighton P., et al.
Published: (2023)

Submodularity of Mutual Information for Multivariate Gaussian Sources with Additive Noise
by: Crowley, George, et al.
Published: (2024)

Adversarial Water-Filling: Theory, Algorithms and Foundation Model
by: Tong, Xindi, et al.
Published: (2026)

Generalization and Robustness of the Tilted Empirical Risk
by: Aminian, Gholamali, et al.
Published: (2024)

Collaborative Inference over Wireless Channels with Feature Differential Privacy
by: Seif, Mohamed, et al.
Published: (2024)

Adversary-Aware Private Inference over Wireless Channels
by: Seif, Mohamed, et al.
Published: (2025)

Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning
by: Barnes, L. P., et al.
Published: (2022)

Differentially Private Spectral Graph Clustering: Balancing Privacy, Accuracy, and Efficiency
by: Koskela, Antti, et al.
Published: (2025)

Accelerating Relative Entropy Coding with Space Partitioning
by: He, Jiajun, et al.
Published: (2024)

Best Arm Identification with Minimal Regret
by: Yang, Junwen, et al.
Published: (2024)

Indexed Minimum Empirical Divergence-Based Algorithms for Linear Bandits
by: Bian, Jie, et al.
Published: (2024)

Empirical Bayes Estimation for Lasso-Type Regularizers: Analysis of Automatic Relevance Determination
by: Yoshida, Tsukasa, et al.
Published: (2025)

Decoupled Entropy Minimization
by: Ma, Jing, et al.
Published: (2025)

Neuromorphic Wireless Split Computing with Multi-Level Spikes
by: Wu, Dengyu, et al.
Published: (2024)

Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons
by: Wu, Dengyu, et al.
Published: (2025)

Fundamental Properties of Causal Entropy and Information Gain
by: Simoes, Francisco N. F. Q., et al.
Published: (2024)

Asymptotically Optimal Change Detection for Unnormalized Pre- and Post-Change Distributions
by: Adibi, Arman, et al.
Published: (2024)

Digital versus Analog Transmissions for Federated Learning over Wireless Networks
by: Yao, Jiacheng, et al.
Published: (2024)

Causal Entropy and Information Gain for Measuring Causal Control
by: Simoes, Francisco Nunes Ferreira Quialheiro, et al.
Published: (2023)

Adaptive Federated Learning Over the Air
by: Wang, Chenhao, et al.
Published: (2024)

Minimum Entropy Coupling with Bottleneck
by: Ebrahimi, M. Reza, et al.
Published: (2024)

$L_2$-Regularized Empirical Risk Minimization Guarantees Small Smooth Calibration Error
by: Fujisawa, Masahiro, et al.
Published: (2025)

On the Benefits of Free Exploration for Regret Minimization in Multi-Armed Bandits
by: Hou, Yunlong, et al.
Published: (2026)

Rethinking Resource Management in Edge Learning: A Joint Pre-training and Fine-tuning Design Paradigm
by: Lyu, Zhonghao, et al.
Published: (2024)

Decentralized Federated Learning Over Imperfect Communication Channels
by: Li, Weicai, et al.
Published: (2024)

Minimal Communication-Cost Statistical Learning
by: Sefidgaran, Milad, et al.
Published: (2024)