Imagen de Portada

Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Yanxiao, Fan, Yijun, Gündüz, Deniz
Formato:	Preprint
Publicado:	2026
Materias:	Information Theory Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Tighter CMI-Based Generalization Bounds via Stochastic Projection and Quantization
por: Sefidgaran, Milad, et al.
Publicado: (2025)

Remote Action Generation: Remote Control with Minimal Communication
por: Kobus, Szymon, et al.
Publicado: (2026)

Friendly Attacks to Improve Channel Coding Reliability
por: Kurmukova, Anastasiia, et al.
Publicado: (2024)

Adversarial Jamming for Autoencoder Distribution Matching
por: El-Geresy, Waleed, et al.
Publicado: (2025)

Vicious Classifiers: Assessing Inference-time Data Reconstruction Risk in Edge Computing
por: Malekzadeh, Mohammad, et al.
Publicado: (2022)

On the Generalization Error of Differentially Private Algorithms via Typicality
por: Liu, Yanxiao, et al.
Publicado: (2026)

Information-Theoretic Generalization Bounds for Deep Neural Networks
por: He, Haiyun, et al.
Publicado: (2024)

The Rate-Distortion-Perception Trade-off: The Role of Private Randomness
por: Hamdi, Yassine, et al.
Publicado: (2024)

Bounds on the Excess Minimum Risk via Generalized Information Divergence Measures
por: Omanwar, Ananya, et al.
Publicado: (2025)

Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning
por: Barnes, L. P., et al.
Publicado: (2022)

Energy-Constrained Information Storage on Memristive Devices in the Presence of Resistive Drift
por: El-Geresy, Waleed, et al.
Publicado: (2024)

Information-Theoretic Measures on Lattices for High-Order Interactions
por: Liu, Zhaolu, et al.
Publicado: (2024)

Generalization Bounds via Conditional $f$-Information
por: Wang, Ziqiao, et al.
Publicado: (2024)

Maximal-Capacity Discrete Memoryless Channel Identification
por: Egger, Maximilian, et al.
Publicado: (2024)

Information-Theoretic Minimax Regret Bounds for Reinforcement Learning based on Duality
por: Bongole, Raghav, et al.
Publicado: (2024)

New Bounds on Quantum Sample Complexity of Measurement Classes
por: Heidari, Mohsen, et al.
Publicado: (2024)

Multi-hop Deep Joint Source-Channel Coding with Deep Hash Distillation for Semantically Aligned Image Recovery
por: Bergström, Didrik, et al.
Publicado: (2025)

Distributed Deep Joint Source-Channel Coding with Decoder-Only Side Information
por: Yilmaz, Selim F., et al.
Publicado: (2023)

Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designs
por: Gündüz, Deniz, et al.
Publicado: (2024)

Private Collaborative Edge Inference via Over-the-Air Computation
por: Yilmaz, Selim F., et al.
Publicado: (2024)

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition
por: Clauw, Kenzo, et al.
Publicado: (2024)

Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection
por: Beck, Nathan, et al.
Publicado: (2024)

On the Generalization of Knowledge Distillation: An Information-Theoretic View
por: Li, Bingying, et al.
Publicado: (2026)

On the Generalization for Transfer Learning: An Information-Theoretic Analysis
por: Wu, Xuetong, et al.
Publicado: (2022)

Generalized Talagrand Inequality for Sinkhorn Distance using Entropy Power Inequality
por: Wang, Shuchan, et al.
Publicado: (2021)

An Information-Theoretic Framework for Out-of-Distribution Generalization with Applications to Stochastic Gradient Langevin Dynamics
por: Liu, Wenliang, et al.
Publicado: (2024)

Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
por: Wang, Ziqiao, et al.
Publicado: (2022)

Learning to Interfere in Non-Orthogonal Multiple-Access Joint Source-Channel Coding
por: Yilmaz, Selim F., et al.
Publicado: (2025)

Fast Rate Information-theoretic Bounds on Generalization Errors
por: Wu, Xuetong, et al.
Publicado: (2023)

Information-Theoretic Generative Clustering of Documents
por: Du, Xin, et al.
Publicado: (2024)

Information-Theoretic Discrete Diffusion
por: Jeon, Moongyu, et al.
Publicado: (2025)

Learning Algorithm Generalization Error Bounds via Auxiliary Distributions
por: Aminian, Gholamali, et al.
Publicado: (2022)

Data-dependent Generalization Bounds via Variable-Size Compressibility
por: Sefidgaran, Milad, et al.
Publicado: (2023)

On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspective
por: Dong, Zhiyi, et al.
Publicado: (2025)

Information Theoretic Perspective on Representation Learning
por: Pereg, Deborah, et al.
Publicado: (2026)

Information-Theoretic Proofs for Diffusion Sampling
por: Reeves, Galen, et al.
Publicado: (2025)

An Information Theoretic Perspective on Conformal Prediction
por: Correia, Alvaro H. C., et al.
Publicado: (2024)

An Information-Theoretic Analysis of Temporal GNNs
por: Farzaneh, Amirmohammad
Publicado: (2024)

An Information-Theoretic Analysis of In-Context Learning
por: Jeon, Hong Jun, et al.
Publicado: (2024)

Probing the Information Theoretical Roots of Spatial Dependence Measures
por: Wang, Zhangyu, et al.
Publicado: (2024)