Copertina

Opportunistic Expert Activation: Batch-Aware Expert Routing for Faster Decode Without Retraining

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Oncescu, Costin-Andrei, Wu, Qingyang, Chung, Wai Tong, Wu, Robert, Gopal, Bryan, Wang, Junxiong, Dao, Tri, Athiwaratkun, Ben
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
di: Meterez, Alexandru, et al.
Pubblicazione: (2025)

Beat the long tail: Distribution-Aware Speculative Decoding for RL Training
di: Shao, Zelei, et al.
Pubblicazione: (2025)

The Recurrent Transformer: Greater Effective Depth and Efficient Decoding
di: Oncescu, Costin-Andrei, et al.
Pubblicazione: (2026)

Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond
di: Oncescu, Costin-Andrei, et al.
Pubblicazione: (2024)

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
di: Xu, Zhiyuan, et al.
Pubblicazione: (2026)

Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs
di: Zhou, Yixiao, et al.
Pubblicazione: (2025)

A Simplified Analysis of SGD for Linear Regression with Weight Averaging
di: Meterez, Alexandru, et al.
Pubblicazione: (2025)

XShare: Collaborative in-Batch Expert Sharing for Faster MoE Inference
di: Vankov, Daniil, et al.
Pubblicazione: (2026)

SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Models
di: Wu, Juntong, et al.
Pubblicazione: (2026)

Feature emergence via margin maximization: case studies in algebraic tasks
di: Morwani, Depen, et al.
Pubblicazione: (2023)

Introspective Diffusion Language Models
di: Yu, Yifan, et al.
Pubblicazione: (2026)

Klotski: Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline
di: Fang, Zhiyuan, et al.
Pubblicazione: (2025)

Routing Experts: Learning to Route Dynamic Experts in Multi-modal Large Language Models
di: Wu, Qiong, et al.
Pubblicazione: (2024)

BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE
di: Wu, Juntong, et al.
Pubblicazione: (2026)

CARE-Edit: Condition-Aware Routing of Experts for Contextual Image Editing
di: Wang, Yucheng, et al.
Pubblicazione: (2026)

Opportunistic Routing in Wireless Communications via Learnable State-Augmented Policies
di: Das, Sourajit, et al.
Pubblicazione: (2025)

Quality-of-Service Aware LLM Routing for Edge Computing with Multiple Experts
di: Yang, Jin, et al.
Pubblicazione: (2025)

Speculative Speculative Decoding
di: Kumar, Tanishq, et al.
Pubblicazione: (2026)

When RL Meets Adaptive Speculative Training: A Unified Training-Serving System
di: Wang, Junxiong, et al.
Pubblicazione: (2026)

CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention
di: Zhou, Zhongzhu, et al.
Pubblicazione: (2026)

Hardware-Efficient Attention for Fast Decoding
di: Zadouri, Ted, et al.
Pubblicazione: (2025)

Expert Routing with Synthetic Data for Continual Learning
di: Byun, Yewon, et al.
Pubblicazione: (2024)

An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing
di: Chai, Ziwei, et al.
Pubblicazione: (2024)

Data Diversification Methods In Alignment Enhance Math Performance In LLMs
di: Dokmeci, Berkan, et al.
Pubblicazione: (2025)

SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving
di: Jia, Jinda, et al.
Pubblicazione: (2026)

Search Your Block Floating Point Scales!
di: Gupta, Tanmaey, et al.
Pubblicazione: (2026)

CryptoMoE: Privacy-Preserving and Scalable Mixture of Experts Inference via Balanced Expert Routing
di: Zhou, Yifan, et al.
Pubblicazione: (2025)

MoxE: Mixture of xLSTM Experts with Entropy-Aware Routing for Efficient Language Modeling
di: Thiombiano, Abdoul Majid O., et al.
Pubblicazione: (2025)

The Mamba in the Llama: Distilling and Accelerating Hybrid Models
di: Wang, Junxiong, et al.
Pubblicazione: (2024)

RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
di: Liang, Jiacheng, et al.
Pubblicazione: (2026)

Soft Task-Aware Routing of Experts for Equivariant Representation Learning
di: Jeon, Jaebyeong, et al.
Pubblicazione: (2025)

Squeeze Evolve: Unified Multi-Model Orchestration for Verifier-Free Evolution
di: Maheswaran, Monishwaran, et al.
Pubblicazione: (2026)

Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference
di: Liu, Baihui, et al.
Pubblicazione: (2026)

BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Experts
di: Wang, Qingyue, et al.
Pubblicazione: (2025)

Geometric Routing Enables Causal Expert Control in Mixture of Experts
di: Ternovtsii, Ivan, et al.
Pubblicazione: (2026)

Routing-Free Mixture-of-Experts
di: Liu, Yilun, et al.
Pubblicazione: (2026)

Multilingual Routing in Mixture-of-Experts
di: Bandarkar, Lucas, et al.
Pubblicazione: (2025)

Route Experts by Sequence, not by Token
di: Wen, Tiansheng, et al.
Pubblicazione: (2025)

Faster, Smaller, and Smarter: Task-Aware Expert Merging for Online MoE Inference
di: Han, Ziyi, et al.
Pubblicazione: (2025)

Cross-Platform Fused MoE Dispatch in Triton: Portable Expert Routing Without CUDA
di: Mitra, Subhadip
Pubblicazione: (2026)