Image de couverture de livre

AdapMoE: Adaptive Sensitivity-based Expert Gating and Management for Efficient MoE Inference

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhong, Shuzhang, Liang, Ling, Wang, Yuan, Wang, Runsheng, Huang, Ru, Li, Meng
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference
par: Zhong, Shuzhang, et autres
Publié: (2025)

MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cache
par: Xue, Leyang, et autres
Publié: (2024)

MergeMoE: Efficient Compression of MoE Models via Expert Output Merging
par: Miao, Ruijie, et autres
Publié: (2025)

LExI: Layer-Adaptive Active Experts for Efficient MoE Model Inference
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

DyMoE: Dynamic Expert Orchestration with Mixed-Precision Quantization for Efficient MoE Inference on Edge
par: Huang, Yuegui, et autres
Publié: (2026)

MoE-Compression: How the Compression Error of Experts Affects the Inference Accuracy of MoE Model?
par: Ma, Songkai, et autres
Publié: (2025)

MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
par: Chen, Xiaodong, et autres
Publié: (2025)

Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference
par: Liu, Baihui, et autres
Publié: (2026)

Expert Divergence Learning for MoE-based Language Models
par: Li, Jiaang, et autres
Publié: (2026)

Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
par: Gu, Naibin, et autres
Publié: (2025)

Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse
par: Fu, Zizhuo, et autres
Publié: (2026)

PreMoE: Proactive Inference for Efficient Mixture-of-Experts
par: Pei, Zehua, et autres
Publié: (2025)

FluxMoE: Decoupling Expert Residency for High-Performance MoE Serving
par: Liu, Qingxiu, et autres
Publié: (2026)

LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
par: Liu, Xinyi, et autres
Publié: (2026)

Fast MoE Inference via Predictive Prefetching and Expert Replication
par: Jyothish, Ankit, et autres
Publié: (2026)

eMoE: Task-aware Memory Efficient Mixture-of-Experts-Based (MoE) Model Inference
par: Tairin, Suraiya, et autres
Publié: (2025)

MoE-Spec: Expert Budgeting for Efficient Speculative Decoding
par: McDanel, Bradley, et autres
Publié: (2026)

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators
par: Huang, Beichen, et autres
Publié: (2025)

Accelerating MoE Model Inference with Expert Sharding
par: Balmau, Oana, et autres
Publié: (2025)

Horseshoe Mixtures-of-Experts (HS-MoE)
par: Polson, Nick, et autres
Publié: (2026)

CoX-MoE: Coalesced Expert Execution for High-Throughput MoE Inference with AMX-Enabled CPU-GPU Co-Execution
par: Son, Muyoung, et autres
Publié: (2026)

Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
par: Li, Lujun, et autres
Publié: (2025)

MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
par: Jin, Peng, et autres
Publié: (2024)

SD-MoE: Spectral Decomposition for Effective Expert Specialization
par: Huang, Ruijun, et autres
Publié: (2026)

MoE-Prism: Disentangling Monolithic Experts for Elastic MoE Services via Model-System Co-Designs
par: Xia, Xinfeng, et autres
Publié: (2025)

MoE-GPS: Guidlines for Prediction Strategy for Dynamic Expert Duplication in MoE Load Balancing
par: Ma, Haiyue, et autres
Publié: (2025)

SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Models
par: Wu, Juntong, et autres
Publié: (2026)

DA-MoE: Addressing Depth-Sensitivity in Graph-Level Analysis through Mixture of Experts
par: Yao, Zelin, et autres
Publié: (2024)

FloE: On-the-Fly MoE Inference on Memory-constrained GPU
par: Zhou, Yuxin, et autres
Publié: (2025)

HD-MoE: Hybrid and Dynamic Parallelism for Mixture-of-Expert LLMs with 3D Near-Memory Processing
par: Huang, Haochen, et autres
Publié: (2025)

Expert Routing for Communication-Efficient MoE via Finite Expert Banks
par: Salehi, Mohammad Reza Deylam, et autres
Publié: (2026)

MoE Lens -- An Expert Is All You Need
par: Chaudhari, Marmik, et autres
Publié: (2026)

MoE Pathfinder: Trajectory-driven Expert Pruning
par: Yang, Xican, et autres
Publié: (2025)

EvoESAP: Non-Uniform Expert Pruning for Sparse MoE
par: Liu, Zongfang, et autres
Publié: (2026)

Synergistic Intra- and Cross-Layer Regularization Losses for MoE Expert Specialization
par: Hu, Rizhen, et autres
Publié: (2026)

Faster, Smaller, and Smarter: Task-Aware Expert Merging for Online MoE Inference
par: Han, Ziyi, et autres
Publié: (2025)

ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
par: Zhong, Shuzhang, et autres
Publié: (2024)

MoE-SpAc: Efficient MoE Inference Based on Speculative Activation Utility in Heterogeneous Edge Scenarios
par: Li, Shuhuai, et autres
Publié: (2026)

A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
par: Xu, Junzhou, et autres
Publié: (2025)

SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation
par: Li, Zichong, et autres
Publié: (2025)