Guardado en:
| Autores principales: | Zhang, Ze Yu, Ding, Bolin, Low, Bryan Kian Hsiang |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2506.02965 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
PWC-MoE: Privacy-Aware Wireless Collaborative Mixture of Experts
por: Su, Yang, et al.
Publicado: (2025)
por: Su, Yang, et al.
Publicado: (2025)
Self-Interested Agents in Collaborative Machine Learning: An Incentivized Adaptive Data-Centric Framework
por: Vijayan, Nithia, et al.
Publicado: (2024)
por: Vijayan, Nithia, et al.
Publicado: (2024)
MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
por: Chen, Xiaodong, et al.
Publicado: (2025)
por: Chen, Xiaodong, et al.
Publicado: (2025)
Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
por: Li, Lujun, et al.
Publicado: (2025)
por: Li, Lujun, et al.
Publicado: (2025)
Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient
por: Ludziejewski, Jan, et al.
Publicado: (2025)
por: Ludziejewski, Jan, et al.
Publicado: (2025)
Horseshoe Mixtures-of-Experts (HS-MoE)
por: Polson, Nick, et al.
Publicado: (2026)
por: Polson, Nick, et al.
Publicado: (2026)
LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
por: Liu, Xinyi, et al.
Publicado: (2026)
por: Liu, Xinyi, et al.
Publicado: (2026)
DUET: Optimizing Training Data Mixtures via Feedback from Unseen Evaluation Tasks
por: Chen, Zhiliang, et al.
Publicado: (2025)
por: Chen, Zhiliang, et al.
Publicado: (2025)
Decentralized Sum-of-Nonconvex Optimization
por: Liu, Zhuanghua, et al.
Publicado: (2024)
por: Liu, Zhuanghua, et al.
Publicado: (2024)
eMoE: Task-aware Memory Efficient Mixture-of-Experts-Based (MoE) Model Inference
por: Tairin, Suraiya, et al.
Publicado: (2025)
por: Tairin, Suraiya, et al.
Publicado: (2025)
Understanding the Relationship between Prompts and Response Uncertainty in Large Language Models
por: Zhang, Ze Yu, et al.
Publicado: (2024)
por: Zhang, Ze Yu, et al.
Publicado: (2024)
TreeGrad-Ranker: Feature Ranking via $O(L)$-Time Gradients for Decision Trees
por: Li, Weida, et al.
Publicado: (2026)
por: Li, Weida, et al.
Publicado: (2026)
Provably Adaptive Linear Approximation for the Shapley Value and Beyond
por: Li, Weida, et al.
Publicado: (2026)
por: Li, Weida, et al.
Publicado: (2026)
MoE-DisCo:Low Economy Cost Training Mixture-of-Experts Models
por: Ye, Xin, et al.
Publicado: (2026)
por: Ye, Xin, et al.
Publicado: (2026)
CP-MoE: Consistency-Preserving Mixture-of-Experts for Continual Learning
por: Liu, Yang, et al.
Publicado: (2026)
por: Liu, Yang, et al.
Publicado: (2026)
Robustifying and Boosting Training-Free Neural Architecture Search
por: He, Zhenfeng, et al.
Publicado: (2024)
por: He, Zhenfeng, et al.
Publicado: (2024)
$\infty$-MoE: Generalizing Mixture of Experts to Infinite Experts
por: Takashiro, Shota, et al.
Publicado: (2026)
por: Takashiro, Shota, et al.
Publicado: (2026)
Fine-tuning Language Models with Generative Adversarial Reward Modelling
por: Yu, Zhang Ze, et al.
Publicado: (2023)
por: Yu, Zhang Ze, et al.
Publicado: (2023)
Mixture of Experts (MoE): A Big Data Perspective
por: Gan, Wensheng, et al.
Publicado: (2025)
por: Gan, Wensheng, et al.
Publicado: (2025)
Understanding Domain Generalization: A Noise Robustness Perspective
por: Qiao, Rui, et al.
Publicado: (2024)
por: Qiao, Rui, et al.
Publicado: (2024)
MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
por: Jin, Peng, et al.
Publicado: (2024)
por: Jin, Peng, et al.
Publicado: (2024)
Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference
por: Liu, Baihui, et al.
Publicado: (2026)
por: Liu, Baihui, et al.
Publicado: (2026)
DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
por: Aghdam, Maryam Akhavan, et al.
Publicado: (2024)
por: Aghdam, Maryam Akhavan, et al.
Publicado: (2024)
FLEX-MoE: Federated Mixture-of-Experts with Load-balanced Expert Assignment for Edge Computing
por: Zhang, Boyang, et al.
Publicado: (2025)
por: Zhang, Boyang, et al.
Publicado: (2025)
MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
por: Jin, Chao, et al.
Publicado: (2025)
por: Jin, Chao, et al.
Publicado: (2025)
SDG-MoE: Signed Debate Graph Mixture-of-Experts
por: Kulibaba, Stepan, et al.
Publicado: (2026)
por: Kulibaba, Stepan, et al.
Publicado: (2026)
INO-SGD: Addressing Utility Imbalance under Individualized Differential Privacy
por: Tian, Xiao, et al.
Publicado: (2026)
por: Tian, Xiao, et al.
Publicado: (2026)
TRACE: TRansformer-based Attribution using Contrastive Embeddings in LLMs
por: Wang, Cheng, et al.
Publicado: (2024)
por: Wang, Cheng, et al.
Publicado: (2024)
Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
por: Gu, Naibin, et al.
Publicado: (2025)
por: Gu, Naibin, et al.
Publicado: (2025)
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
por: Pióro, Maciej, et al.
Publicado: (2024)
por: Pióro, Maciej, et al.
Publicado: (2024)
Paid with Models: Optimal Contract Design for Collaborative Machine Learning
por: Wang, Bingchen, et al.
Publicado: (2024)
por: Wang, Bingchen, et al.
Publicado: (2024)
VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting
por: Chen, Hao, et al.
Publicado: (2024)
por: Chen, Hao, et al.
Publicado: (2024)
SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts
por: Muzio, Alexandre, et al.
Publicado: (2024)
por: Muzio, Alexandre, et al.
Publicado: (2024)
Occult: Optimizing Collaborative Communication across Experts for Accelerated Parallel MoE Training and Inference
por: Luo, Shuqing, et al.
Publicado: (2025)
por: Luo, Shuqing, et al.
Publicado: (2025)
Global-to-Local Support Spectrums for Language Model Explainability
por: Agussurja, Lucas, et al.
Publicado: (2024)
por: Agussurja, Lucas, et al.
Publicado: (2024)
Incremental Quasi-Newton Methods with Faster Superlinear Convergence Rates
por: Liu, Zhuanghua, et al.
Publicado: (2024)
por: Liu, Zhuanghua, et al.
Publicado: (2024)
Exploiting the Experts: Unauthorized Compression in MoE-LLMs
por: Neogi, Pinaki Prasad Guha, et al.
Publicado: (2025)
por: Neogi, Pinaki Prasad Guha, et al.
Publicado: (2025)
MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cache
por: Xue, Leyang, et al.
Publicado: (2024)
por: Xue, Leyang, et al.
Publicado: (2024)
X-MoE: Enabling Scalable Training for Emerging Mixture-of-Experts Architectures on HPC Platforms
por: Yuan, Yueming, et al.
Publicado: (2025)
por: Yuan, Yueming, et al.
Publicado: (2025)
Anchor-MoE: A Mean-Anchored Mixture of Experts For Probabilistic Regression
por: Su, Baozhuo, et al.
Publicado: (2025)
por: Su, Baozhuo, et al.
Publicado: (2025)
Ejemplares similares
-
PWC-MoE: Privacy-Aware Wireless Collaborative Mixture of Experts
por: Su, Yang, et al.
Publicado: (2025) -
Self-Interested Agents in Collaborative Machine Learning: An Incentivized Adaptive Data-Centric Framework
por: Vijayan, Nithia, et al.
Publicado: (2024) -
MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
por: Chen, Xiaodong, et al.
Publicado: (2025) -
Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
por: Li, Lujun, et al.
Publicado: (2025) -
Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient
por: Ludziejewski, Jan, et al.
Publicado: (2025)