Cover Image

Generalization in Federated Learning: A Conditional Mutual Information Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Ziqiao, Long, Cheng, Mao, Yongyi
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalization Bounds via Conditional $f$-Information
by: Wang, Ziqiao, et al.
Published: (2024)

Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
by: Wang, Ziqiao, et al.
Published: (2022)

Distributional Information Embedding: A Framework for Multi-bit Watermarking
by: He, Haiyun, et al.
Published: (2025)

Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approach
by: He, Haiyun, et al.
Published: (2024)

On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspective
by: Dong, Zhiyi, et al.
Published: (2025)

Estimating Conditional Mutual Information for Dynamic Feature Selection
by: Gadgil, Soham, et al.
Published: (2023)

Structure Learning via Mutual Information
by: Nixon, Jeremy
Published: (2024)

Transformers Provably Learn Directed Acyclic Graphs via Kernel-Guided Mutual Information
by: Cheng, Yuan, et al.
Published: (2025)

Providing Differential Privacy for Federated Learning Over Wireless: A Cross-layer Framework
by: Mao, Jiayu, et al.
Published: (2024)

On $f$-Divergence Principled Domain Adaptation: An Improved Framework
by: Wang, Ziqiao, et al.
Published: (2024)

Mutual Information Multinomial Estimation
by: Chen, Yanzhi, et al.
Published: (2024)

A Hierarchical Sampling Framework for bounding the Generalization Error of Federated Learning
by: Filatrella, Dario, et al.
Published: (2026)

A Neural Difference-of-Entropies Estimator for Mutual Information
by: Ni, Haoran, et al.
Published: (2025)

VBO-MI: A Fully Gradient-Based Bayesian Optimization Framework Using Variational Mutual Information Estimation
by: Mirkarimi, Farhad
Published: (2026)

Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning
by: Barnes, L. P., et al.
Published: (2022)

Mutual Information Estimation via Normalizing Flows
by: Butakov, Ivan, et al.
Published: (2024)

On the Properties and Estimation of Pointwise Mutual Information Profiles
by: Czyż, Paweł, et al.
Published: (2023)

Personalized Over-the-Air Federated Learning with Personalized Reconfigurable Intelligent Surfaces
by: Mao, Jiayu, et al.
Published: (2024)

MIST: Mutual Information Estimation Via Supervised Training
by: Gritsai, German, et al.
Published: (2025)

Contrastive Predictive Coding Done Right for Mutual Information Estimation
by: Ryu, J. Jon, et al.
Published: (2025)

MIFair: A Mutual-Information Framework for Intersectionality and Multiclass Fairness
by: Monnier, Jeanne, et al.
Published: (2026)

End-to-End Learning of Geometrical Shaping Maximizing Generalized Mutual Information
by: Gümüs, Kadir, et al.
Published: (2019)

Shapley-Based Data Valuation with Mutual Information: A Key to Modified K-Nearest Neighbors
by: Vahedifar, Mohammad Ali, et al.
Published: (2023)

Estimating Mutual Information between Time Series and Temporal Event Sequences Across Diverse Analysis Tasks
by: Hu, Haoji, et al.
Published: (2026)

Load Balancing in Federated Learning
by: Javani, Alireza, et al.
Published: (2024)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

Characterizing Dependence of Samples along the Langevin Dynamics and Algorithms via Contraction of $Φ$-Mutual Information
by: Liang, Jiaming, et al.
Published: (2024)

Fast Mutual Information Computation for Large Binary Datasets
by: Falcao, Andre O.
Published: (2024)

Dual-Mind World Models: A General Framework for Learning in Dynamic Wireless Networks
by: Wang, Lingyi, et al.
Published: (2025)

An Information-Theoretic Framework for Out-of-Distribution Generalization with Applications to Stochastic Gradient Langevin Dynamics
by: Liu, Wenliang, et al.
Published: (2024)

A Generalized Information Bottleneck Theory of Deep Learning
by: Westphal, Charles, et al.
Published: (2025)

Normalized Conditional Mutual Information Surrogate Loss for Deep Neural Classifiers
by: Ye, Linfeng, et al.
Published: (2026)

Mutual Information Estimation via $f$-Divergence and Data Derangements
by: Letizia, Nunzio A., et al.
Published: (2023)

Information-Theoretic Framework for Understanding Modern Machine-Learning
by: Feder, Meir, et al.
Published: (2025)

Balancing Client Participation in Federated Learning Using AoI
by: Javani, Alireza, et al.
Published: (2025)

On the Generalization for Transfer Learning: An Information-Theoretic Analysis
by: Wu, Xuetong, et al.
Published: (2022)

Advocating for the Silent: Enhancing Federated Generalization for Non-Participating Clients
by: Wu, Zheshun, et al.
Published: (2023)

Decoupled Subgraph Federated Learning
by: Aliakbari, Javad, et al.
Published: (2024)

Lessons from Generalization Error Analysis of Federated Learning: You May Communicate Less Often!
by: Sefidgaran, Milad, et al.
Published: (2023)

A Hierarchical Federated Learning Approach for the Internet of Things
by: Azimi-Abarghouyi, Seyed Mohammad, et al.
Published: (2024)