Cover Image

Generalization Bounds: Perspectives from Information Theory and PAC-Bayes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hellström, Fredrik, Durisi, Giuseppe, Guedj, Benjamin, Raginsky, Maxim
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence Information Theory Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Comparing Comparators in Generalization Bounds
by: Hellström, Fredrik, et al.
Published: (2023)

Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound
by: Adams, Reuben, et al.
Published: (2022)

Generalization and Informativeness of Conformal Prediction
by: Zecchin, Matteo, et al.
Published: (2024)

Information-theoretic Limits of Learning and Estimation
by: Gamal, Abbas El, et al.
Published: (2026)

Generalization and Informativeness of Weighted Conformal Risk Control Under Covariate Shift
by: Zecchin, Matteo, et al.
Published: (2025)

Change of measure through the Legendre transform
by: Picard-Weibel, Antoine, et al.
Published: (2022)

Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit
by: Zhang, Bohan, et al.
Published: (2025)

A unified recipe for deriving (time-uniform) PAC-Bayes bounds
by: Chugg, Ben, et al.
Published: (2023)

Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds
by: Guo, Yang, et al.
Published: (2025)

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation
by: Tohme, Tony, et al.
Published: (2023)

Universal time-series forecasting with mixture predictors
by: Ryabko, Daniil
Published: (2020)

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability
by: Zhao, Qingyue, et al.
Published: (2026)

On the Exponential Convergence for Offline RLHF with Pairwise Comparisons
by: Chen, Zhirui, et al.
Published: (2024)

Decision Making in Changing Environments: Robustness, Query-Based Learning, and Differential Privacy
by: Chen, Fan, et al.
Published: (2025)

Prior-dependent analysis of posterior sampling reinforcement learning with function approximation
by: Li, Yingru, et al.
Published: (2024)

Fixed-Budget Differentially Private Best Arm Identification
by: Chen, Zhirui, et al.
Published: (2024)

A note on the impossibility of conditional PAC-efficient reasoning in large language models
by: Zeng, Hao
Published: (2025)

On the Separability of Information in Diffusion Models
by: Premkumar, Akhil
Published: (2025)

A Theory of the Mechanics of Information: Generalization Through Measurement of Uncertainty (Learning is Measuring)
by: Hazard, Christopher J., et al.
Published: (2025)

Unified Algorithms for RL with Decision-Estimation Coefficients: PAC, Reward-Free, Preference-Based Learning, and Beyond
by: Chen, Fan, et al.
Published: (2022)

PAC-Chernoff Bounds: Understanding Generalization in the Interpolation Regime
by: Masegosa, Andrés R., et al.
Published: (2023)

Random Multiplexing
by: Liu, Lei, et al.
Published: (2025)

Analyzing Shapley Additive Explanations to Understand Anomaly Detection Algorithm Behaviors and Their Complementarity
by: Levy, Jordan, et al.
Published: (2026)

Entropy, concentration, and learning: a statistical mechanics primer
by: Balsubramani, Akshay
Published: (2024)

Asymptotic Theory of Eigenvectors for Latent Embeddings with Generalized Laplacian Matrices
by: Fan, Jianqing, et al.
Published: (2025)

Rapidly Varying Completely Random Measures for Modeling Extremely Sparse Networks
by: Kilian, Valentin, et al.
Published: (2025)

User-friendly introduction to PAC-Bayes bounds
by: Alquier, Pierre
Published: (2021)

Path Regularization: A Near-Complete and Optimal Nonasymptotic Generalization Theory for Multilayer Neural Networks and Double Descent Phenomenon
by: Yu, Hao
Published: (2025)

Information-Geometric Decomposition of Generalization Error in Unsupervised Learning
by: Kim, Gilhan
Published: (2026)

Minimax Optimal Variance-Aware Regret Bounds for Multinomial Logistic MDPs
by: Boudart, Pierre, et al.
Published: (2026)

Maximizing the Potential of Synthetic Data: Insights from Random Matrix Theory
by: Firdoussi, Aymane El, et al.
Published: (2024)

Guaranteed Recovery of Unambiguous Clusters
by: Mazooji, Kayvon, et al.
Published: (2025)

Deep Ensembles for Epistemic Uncertainty: A Frequentist Perspective
by: Jain, Anchit, et al.
Published: (2025)

Empirical Bayes Estimation for Lasso-Type Regularizers: Analysis of Automatic Relevance Determination
by: Yoshida, Tsukasa, et al.
Published: (2025)

Low-Dimensional Adaptation of Rectified Flow: A Diffusion and Stochastic Localization Perspective
by: Roy, Saptarshi, et al.
Published: (2026)

Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptions
by: Zhang, Kaihong, et al.
Published: (2024)

A Computational Theory for Efficient Mini Agent Evaluation with Causal Guarantees
by: Yan, Hedong
Published: (2025)

Fairness Overfitting in Machine Learning: An Information-Theoretic Perspective
by: Laakom, Firas, et al.
Published: (2025)

O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions
by: Li, Gen, et al.
Published: (2024)

Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnability
by: Chen, Fan, et al.
Published: (2024)