Copertina

Mixture-of-Experts for Distributed Edge Computing with Channel-Aware Gating Function

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Song, Qiuchen, Jing, Shusen, Zhang, Shuai, Zhang, Songyang, Huang, Chuan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Efficient Federated Learning of Networked Mixture-of-Experts for Mobile Edge Computing
di: Gao, Song, et al.
Pubblicazione: (2025)

FLEX-MoE: Federated Mixture-of-Experts with Load-balanced Expert Assignment for Edge Computing
di: Zhang, Boyang, et al.
Pubblicazione: (2025)

FedSC: Provable Federated Self-supervised Learning with Spectral Contrastive Objective over Non-i.i.d. Data
di: Jing, Shusen, et al.
Pubblicazione: (2024)

Theory of Mixture-of-Experts for Mobile Edge Computing
di: Li, Hongbo, et al.
Pubblicazione: (2024)

On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions
di: Nguyen, Huy, et al.
Pubblicazione: (2024)

Optimizing Distributed Deployment of Mixture-of-Experts Model Inference in Serverless Computing
di: Liu, Mengfan, et al.
Pubblicazione: (2025)

Rethinking Multinomial Logistic Mixture of Experts with Sigmoid Gating Function
di: Pham, Tuan Minh, et al.
Pubblicazione: (2026)

Efficient Training of Large-Scale AI Models Through Federated Mixture-of-Experts: A System-Level Approach
di: Chen, Xiaobing, et al.
Pubblicazione: (2025)

Fate: Fast Edge Inference of Mixture-of-Experts Models via Cross-Layer Gate
di: Fang, Zhiyuan, et al.
Pubblicazione: (2025)

Gate the Filter, Not the Message: Node-Channel Mixtures for Pre-Propagation GNNs
di: Yue, Zichao, et al.
Pubblicazione: (2026)

Convergence Rates for Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2025)

Gaussian Process-Gated Hierarchical Mixtures of Experts
di: Liu, Yuhao, et al.
Pubblicazione: (2023)

SlimCaching: Edge Caching of Mixture-of-Experts for Distributed Inference
di: Chen, Qian, et al.
Pubblicazione: (2025)

Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping
di: Jiang, Chenyu, et al.
Pubblicazione: (2024)

GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models
di: Zheng, Chen, et al.
Pubblicazione: (2025)

On Least Square Estimation in Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2024)

Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2024)

Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention
di: Akbarian, Pedram, et al.
Pubblicazione: (2024)

Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts
di: Dwivedi, Chaitanya, et al.
Pubblicazione: (2026)

Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2023)

A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2023)

FT-MoE: Sustainable-learning Mixture of Experts for Fault-Tolerant Computing
di: Xiao, Wenjing, et al.
Pubblicazione: (2025)

A Statistical Theory of Gated Attention through the Lens of Hierarchical Mixture of Experts
di: Nguyen, Viet, et al.
Pubblicazione: (2026)

Mixture of Experts in Large Language Models
di: Zhang, Danyang, et al.
Pubblicazione: (2025)

Facet-Aware Multi-Head Mixture-of-Experts Model for Sequential Recommendation
di: Liu, Mingrui, et al.
Pubblicazione: (2024)

A Gated Residual Kolmogorov-Arnold Networks for Mixtures of Experts
di: Inzirillo, Hugo, et al.
Pubblicazione: (2024)

C3RL: Rethinking the Combination of Channel-independence and Channel-mixing from Representation Learning
di: Ma, Shusen, et al.
Pubblicazione: (2025)

FLUX: Geometry-Aware Longitudinal Flow Matching with Mixture of Experts
di: Caro, Josue Ortega, et al.
Pubblicazione: (2026)

Task-Aware Mixture-of-Experts for Time Series Analysis
di: Wu, Xingjian, et al.
Pubblicazione: (2025)

Channel-Adaptive Edge AI: Maximizing Inference Throughput by Adapting Computational Complexity to Channel States
di: Zhang, Jierui, et al.
Pubblicazione: (2026)

GateTS: Versatile and Efficient Forecasting via Attention-Inspired routed Mixture-of-Experts
di: Yemets, Kyrylo, et al.
Pubblicazione: (2025)

MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
di: Chen, Xiaodong, et al.
Pubblicazione: (2025)

RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
di: Sun, Mengyang, et al.
Pubblicazione: (2026)

Klotski: Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline
di: Fang, Zhiyuan, et al.
Pubblicazione: (2025)

On Bayesian Softmax-Gated Mixture-of-Experts Models
di: Bariletto, Nicola, et al.
Pubblicazione: (2026)

MC#: Mixture Compressor for Mixture-of-Experts Large Models
di: Huang, Wei, et al.
Pubblicazione: (2025)

Mixture Compressor for Mixture-of-Experts LLMs Gains More
di: Huang, Wei, et al.
Pubblicazione: (2024)

Similarity-Aware Mixture-of-Experts for Data-Efficient Continual Learning
di: Mclaughlin, Connor, et al.
Pubblicazione: (2026)

Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs
di: Khalesi, Ali, et al.
Pubblicazione: (2026)

Theoretical Analysis of Contrastive Learning under Imbalanced Data: From Training Dynamics to a Pruning Solution
di: Liao, Haixu, et al.
Pubblicazione: (2026)