Imagen de Portada

Neural Inhibition Improves Dynamic Routing and Mixture of Experts

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zou, Will Y., Zhang, Jennifer Y.
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
por: Xu, Zhiyuan, et al.
Publicado: (2026)

Multilingual Routing in Mixture-of-Experts
por: Bandarkar, Lucas, et al.
Publicado: (2025)

Routing-Free Mixture-of-Experts
por: Liu, Yilun, et al.
Publicado: (2026)

Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Experts
por: Miao, Changhao, et al.
Publicado: (2026)

MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts
por: Zhou, Jianan, et al.
Publicado: (2024)

ProbMoE: Differentiable Probabilistic Routing for Mixture-of-Experts
por: Zhao, Heng, et al.
Publicado: (2026)

Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models
por: Liang, Jingcong, et al.
Publicado: (2025)

Soft-to-Hard Routing in Sparse Mixture-of-Experts Models
por: Rastegar, Reza
Publicado: (2026)

Routing Mamba: Scaling State Space Models with Mixture-of-Experts Projection
por: Zhan, Zheng, et al.
Publicado: (2025)

PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
por: Liu, Yilun, et al.
Publicado: (2024)

Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference
por: Chu, Kexin, et al.
Publicado: (2025)

Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structures
por: Nguyen-Nhat, Minh-Khoi, et al.
Publicado: (2025)

Sparse Models, Sparse Safety: Unsafe Routes in Mixture-of-Experts LLMs
por: Jiang, Yukun, et al.
Publicado: (2026)

Probing Semantic Routing in Large Mixture-of-Expert Models
por: Olson, Matthew Lyle, et al.
Publicado: (2025)

L2R: Low-Rank and Lipschitz-Controlled Routing for Mixture-of-Experts
por: Yang, Minghao, et al.
Publicado: (2026)

Variational Routing: A Scalable Bayesian Framework for Calibrated Mixture-of-Experts Transformers
por: Li, Albus Yizhuo, et al.
Publicado: (2026)

Geometric Mixture-of-Experts with Curvature-Guided Adaptive Routing for Graph Representation Learning
por: Cao, Haifang, et al.
Publicado: (2026)

Dense Backpropagation Improves Training for Sparse Mixture-of-Experts
por: Panda, Ashwinee, et al.
Publicado: (2025)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
por: Liu, Yilun, et al.
Publicado: (2025)

RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
por: Liang, Jiacheng, et al.
Publicado: (2026)

DynaMoE: Dynamic Token-Level Expert Activation with Layer-Wise Adaptive Capacity for Mixture-of-Experts Neural Networks
por: Gülmez, Gökdeniz
Publicado: (2026)

Optimal Expert-Attention Allocation in Mixture-of-Experts: A Scalable Law for Dynamic Model Design
por: Li, Junzhuo, et al.
Publicado: (2026)

Dynamic Adaptive Shared Experts with Grouped Multi-Head Attention Mixture of Experts
por: Li, Cheng, et al.
Publicado: (2025)

Dynamic Mixture of Experts Against Severe Distribution Shifts
por: Kim, Donghu
Publicado: (2025)

MC#: Mixture Compressor for Mixture-of-Experts Large Models
por: Huang, Wei, et al.
Publicado: (2025)

Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDP
por: Pan, Yuxin, et al.
Publicado: (2025)

Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Experts
por: Hua, Yongxiang, et al.
Publicado: (2025)

Mixture of Raytraced Experts
por: Perin, Andrea, et al.
Publicado: (2025)

Mixture of Experts in a Mixture of RL settings
por: Willi, Timon, et al.
Publicado: (2024)

Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting
por: Ghaffari, Amirhossein, et al.
Publicado: (2026)

Speculating Experts Accelerates Inference for Mixture-of-Experts
por: Madan, Vivan, et al.
Publicado: (2026)

Mixture of Experts in Large Language Models
por: Zhang, Danyang, et al.
Publicado: (2025)

Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
por: Guo, Yongxin, et al.
Publicado: (2024)

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
por: Xie, Zhitian, et al.
Publicado: (2024)

Efficiently Editing Mixture-of-Experts Models with Compressed Experts
por: He, Yifei, et al.
Publicado: (2025)

Sparsity and Superposition in Mixture of Experts
por: Chaudhari, Marmik, et al.
Publicado: (2025)

Mixture of Diverse Size Experts
por: Sun, Manxi, et al.
Publicado: (2024)

Mixture of Concept Bottleneck Experts
por: De Santis, Francesco, et al.
Publicado: (2026)

Mixture of A Million Experts
por: He, Xu Owen
Publicado: (2024)

Expert Race: A Flexible Routing Strategy for Scaling Diffusion Transformer with Mixture of Experts
por: Yuan, Yike, et al.
Publicado: (2025)