Cover Image

Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Khalesi, Ali, Salehi, Mohammad Reza Deylam
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Expert Routing for Communication-Efficient MoE via Finite Expert Banks
by: Salehi, Mohammad Reza Deylam, et al.
Published: (2026)

Sparse In-Network Learning via Shortest-Path Backpropagation and Finite-Rate Gating
by: Salehi, Mohammad Reza Deylam
Published: (2026)

Typical Solutions of Multi-User Linearly-Decomposable Distributed Computing
by: Khalesi, Ali, et al.
Published: (2025)

Distributed Compression for Computation and Bounds on the Optimal Rate
by: Salehi, Mohammad Reza Deylam, et al.
Published: (2025)

The Rate-Distortion-Perception Trade-off: The Role of Private Randomness
by: Hamdi, Yassine, et al.
Published: (2024)

Non-Linear Function Computation Broadcast
by: Salehi, Mohammad Reza Deylam, et al.
Published: (2025)

Multi-Server Multi-Function Distributed Computation
by: Malak, Derya, et al.
Published: (2024)

Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimization
by: Salgia, Sudeep, et al.
Published: (2025)

General Multi-User Distributed Computing: A Learning-Theoretic RKHS Framework for Generic Nonlinear Target Functions with Topology-Aware Risk Analysis
by: Khalesi, Ali
Published: (2025)

Rate-Distortion Signatures of Generalization and Information Trade-offs
by: Caglar, Leyla Roksan, et al.
Published: (2026)

Statistical-Computational Trade-offs in Tensor PCA and Related Problems via Communication Complexity
by: Dudeja, Rishabh, et al.
Published: (2022)

Fundamental limits of distributed covariance matrix estimation via a conditional strong data processing inequality
by: Rahmani, Mohammad Reza, et al.
Published: (2025)

Wireless Broadcast Gossip for Decentralized Drone Swarms: Success Probability, Contraction, and Optimal Aloha
by: Khalesi, Ali
Published: (2026)

Trade-offs in Data Memorization via Strong Data Processing Inequalities
by: Feldman, Vitaly, et al.
Published: (2025)

Learning-Augmented Perfectly Secure Collaborative Matrix Multiplication
by: He, Zixuan, et al.
Published: (2026)

Agentic AI-Based Joint Computing and Networking via Mixture of Experts and Large Language Models
by: Reifert, Robert-Jeron, et al.
Published: (2026)

WDMoE: Wireless Distributed Large Language Models with Mixture of Experts
by: Xue, Nan, et al.
Published: (2024)

Expectation Maximization (EM) Converges for General Agnostic Mixtures
by: Ghosh, Avishek
Published: (2026)

A Mixture of Experts Vision Transformer for High-Fidelity Surface Code Decoding
by: Nguyen, Hoang Viet, et al.
Published: (2026)

Beyond Trade-offs: A Unified Framework for Privacy, Robustness, and Communication Efficiency in Federated Learning
by: Xia, Yue, et al.
Published: (2025)

PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources
by: Park, Bumsu, et al.
Published: (2026)

Densification Converses for Walker Constellations With Explicit Constants and Reuse Scaling Laws
by: Khalesi, Ali, et al.
Published: (2026)

Tessellated Distributed Computing
by: Khalesi, Ali, et al.
Published: (2024)

Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors
by: Sefidgaran, Milad, et al.
Published: (2025)

Fast Rate Information-theoretic Bounds on Generalization Errors
by: Wu, Xuetong, et al.
Published: (2023)

A Deep Latent Factor Graph Clustering with Fairness-Utility Trade-off Perspective
by: Ghodsi, Siamak, et al.
Published: (2025)

Game of Coding With an Unknown Adversary
by: Akbarinodehi, Hanzaleh, et al.
Published: (2025)

Matching Rates and Optimal Allocation for Federated Probe-Logit Distillation under Heterogeneous Bandwidth Budgets
by: Dubey, Prasanjit, et al.
Published: (2026)

Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off
by: Madhabhavi, Bhavani A, et al.
Published: (2024)

Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decomposition
by: Hamman, Faisal, et al.
Published: (2023)

Shapley-Based Data Valuation with Mutual Information: A Key to Modified K-Nearest Neighbors
by: Vahedifar, Mohammad Ali, et al.
Published: (2023)

Fundamental Limits of Decentralized Self-Regulating Random Walks
by: Khalesi, Ali, et al.
Published: (2026)

Hyper-Minrank: A Unified Hypergraph Characterization of Multi-Sender Index Coding
by: Khalesi, Ali, et al.
Published: (2025)

Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior
by: Sefidgaran, Milad, et al.
Published: (2025)

Pragmatic Goal-Oriented Communications under Semantic-Effectiveness Channel Errors
by: Hüttebräucker, Tomás, et al.
Published: (2024)

Order Optimal Regret Bounds for Sharpe Ratio Optimization under Thompson Sampling
by: Shah, Mohammad Taha, et al.
Published: (2025)

Game of Coding: Sybil Resistant Decentralized Machine Learning with Minimal Trust Assumption
by: Nodehi, Hanzaleh Akbari, et al.
Published: (2024)

Does Privacy Always Harm Fairness? Data-Dependent Trade-offs via Chernoff Information Neural Estimation
by: Nichani, Arjun, et al.
Published: (2026)

Convergence Rates for Softmax Gating Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2025)

A Constrained BA Algorithm for Rate-Distortion and Distortion-Rate Functions
by: Chen, Lingyi, et al.
Published: (2023)