Image de couverture de livre

MoE Routing Testbed: Studying Expert Specialization and Routing Behavior at Small Scale

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Falke, Tobias, Anastassacos, Nicolas, Tan, Samson, Meas, Chankrisna Richy, Prakash, Chandana Satya, Sekhar, Nitesh, Bari, M Saiful, Kompella, Krishna, Elsayed, Gamaleldin F.
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

The Myth of Expert Specialization in MoEs: Why Routing Reflects Geometry, Not Necessarily Domain Expertise
par: Wang, Xi, et autres
Publié: (2026)

Polysemantic Experts, Monosemantic Paths: Routing as Control in MoEs
par: Ye, Charles, et autres
Publié: (2026)

Expert Routing for Communication-Efficient MoE via Finite Expert Banks
par: Salehi, Mohammad Reza Deylam, et autres
Publié: (2026)

Guiding the Experts: Semantic Priors for Efficient and Focused MoE Routing
par: Min, Chengxi, et autres
Publié: (2025)

BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE
par: Wu, Juntong, et autres
Publié: (2026)

Awakening Dormant Experts:Counterfactual Routing to Mitigate MoE Hallucinations
par: Hu, Wentao, et autres
Publié: (2026)

Harder Tasks Need More Experts: Dynamic Routing in MoE Models
par: Huang, Quzhe, et autres
Publié: (2024)

RouteScan: A Non-Intrusive Approach to Auditing MoE LLMs Safety via Expert Routing Telemetry
par: Lv, Bo, et autres
Publié: (2026)

LAR-MoE: Latent-Aligned Routing for Mixture of Experts in Robotic Imitation Learning
par: Rodriguez, Ariel, et autres
Publié: (2026)

Routing Matters in MoE: Scaling Diffusion Transformers with Explicit Routing Guidance
par: Wei, Yujie, et autres
Publié: (2025)

Advancing Expert Specialization for Better MoE
par: Guo, Hongcan, et autres
Publié: (2025)

Expert-Token Resonance MoE: Bidirectional Routing with Efficiency Affinity-Driven Active Selection
par: Li, Jing, et autres
Publié: (2024)

Cross-Platform Fused MoE Dispatch in Triton: Portable Expert Routing Without CUDA
par: Mitra, Subhadip
Publié: (2026)

MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
par: Manzoni, Andrea
Publié: (2026)

CARL-MoE: Communication-Aware Adaptive Routing with Load-Balanced Expert Parallelism for Efficient Mixture-of-Experts Training
par: Jin, Haopeng
Publié: (2026)

GRACE-MoE: Grouping and Replication with Locality-Aware Routing for Efficient Distributed MoE Inference
par: Han, Yu, et autres
Publié: (2025)

BrainStack: Neuro-MoE with Functionally Guided Expert Routing for EEG-Based Language Decoding
par: Zhao, Ziyi, et autres
Publié: (2026)

Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Experts
par: Hua, Yongxiang, et autres
Publié: (2025)

SD-MoE: Spectral Decomposition for Effective Expert Specialization
par: Huang, Ruijun, et autres
Publié: (2026)

MoE-nD: Per-Layer Mixture-of-Experts Routing for Multi-Axis KV Cache Compression
par: Sun, Libo, et autres
Publié: (2026)

Stable-MoE: Lyapunov-based Token Routing for Distributed Mixture-of-Experts Training over Edge Networks
par: Shi, Long, et autres
Publié: (2025)

MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing
par: Zhou, Hao, et autres
Publié: (2024)

Statistic-Augmented, Decoupled MoE Routing and Aggregating in Autonomous Driving
par: Kou, Wei-Bin, et autres
Publié: (2025)

Grouter: Decoupling Routing from Representation for Accelerated MoE Training
par: Xu, Yuqi, et autres
Publié: (2026)

Ada-K Routing: Boosting the Efficiency of MoE-based LLMs
par: Yue, Tongtian, et autres
Publié: (2024)

D$^{2}$MoE: Dual Routing and Dynamic Scheduling for Efficient On-Device MoE-based LLM Serving
par: Wang, Haodong, et autres
Publié: (2025)

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning
par: Yadav, Prateek, et autres
Publié: (2024)

CoGR-MoE: Concept-Guided Expert Routing with Consistent Selection and Flexible Reasoning for Visual Question Answering
par: Zeng, Xiyin, et autres
Publié: (2026)

Effective MoE-based LLM Compression by Exploiting Heterogeneous Inter-Group Experts Routing Frequency and Information Density
par: Mi, Zhendong, et autres
Publié: (2026)

BLR-MoE: Boosted Language-Routing Mixture of Experts for Domain-Robust Multilingual E2E ASR
par: Ma, Guodong, et autres
Publié: (2025)

Dirichlet-Prior Shaping: Guiding Expert Specialization in Upcycled MoEs
par: Mirvakhabova, Leyla, et autres
Publié: (2025)

Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures
par: Delibasoglu, Ibrahim
Publié: (2026)

ShardMemo: Masked MoE Routing for Sharded Agentic LLM Memory
par: Zhao, Yang, et autres
Publié: (2026)

CRAM: Centroid-Routing and Adaptive MoE for Multimodal Continual Instruction Tuning
par: Tang, Jun-Tao, et autres
Publié: (2026)

Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert Parallelism Design
par: Zhang, Mohan, et autres
Publié: (2025)

LightCurve MoE: A Dynamic Sparse Routing Mixture-of-Experts Architecture for Efficient Stellar Light Curve Classification
par: Wang, Cunshi, et autres
Publié: (2023)

Synergistic Intra- and Cross-Layer Regularization Losses for MoE Expert Specialization
par: Hu, Rizhen, et autres
Publié: (2026)

SMoES: Soft Modality-Guided Expert Specialization in MoE-VLMs
par: Bo, Zi-Hao, et autres
Publié: (2026)

Learning to Route Among Specialized Experts for Zero-Shot Generalization
par: Muqeeth, Mohammed, et autres
Publié: (2024)

Safety-Oriented Routing Analysis of Mixtral MoE Under Benign and Harmful Prompts
par: Siddiky, Md Nurul Absar
Publié: (2026)