Copertina

An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chai, Ziwei, Wang, Guoyin, Su, Jing, Zhang, Tianjie, Huang, Xuanwen, Wang, Xuwu, Xu, Jingjing, Yuan, Jianbo, Yang, Hongxia, Wu, Fei, Yang, Yang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Route Experts by Sequence, not by Token
di: Wen, Tiansheng, et al.
Pubblicazione: (2025)

Generalizing GNNs with Tokenized Mixture of Experts
di: Guo, Xiaoguang, et al.
Pubblicazione: (2026)

MoETuner: Optimized Mixture of Expert Serving with Balanced Expert Placement and Token Routing
di: Go, Seokjin, et al.
Pubblicazione: (2025)

Improving Routing in Sparse Mixture of Experts with Graph of Tokens
di: Nguyen, Tam, et al.
Pubblicazione: (2025)

Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning
di: Zhao, Ziyu, et al.
Pubblicazione: (2024)

AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models
di: Zeng, Zihao, et al.
Pubblicazione: (2024)

2Xplat: Two Experts Are Better Than One Generalist
di: Jeong, Hwasik, et al.
Pubblicazione: (2026)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
di: Zhao, Ziyu, et al.
Pubblicazione: (2025)

ExpertFlow: Efficient Mixture-of-Experts Inference via Predictive Expert Caching and Token Scheduling
di: He, Xin, et al.
Pubblicazione: (2024)

One Request, Multiple Experts: LLM Orchestrates Domain Specific Models via Adaptive Task Routing
di: Yang, Xu, et al.
Pubblicazione: (2025)

InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks
di: Hu, Xueyu, et al.
Pubblicazione: (2024)

Multilingual Routing in Mixture-of-Experts
di: Bandarkar, Lucas, et al.
Pubblicazione: (2025)

Expert-Token Resonance MoE: Bidirectional Routing with Efficiency Affinity-Driven Active Selection
di: Li, Jing, et al.
Pubblicazione: (2024)

Sparse Models, Sparse Safety: Unsafe Routes in Mixture-of-Experts LLMs
di: Jiang, Yukun, et al.
Pubblicazione: (2026)

Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model
di: Yang, Longrong, et al.
Pubblicazione: (2024)

Understanding Multilingualism in Mixture-of-Experts LLMs: Routing Mechanism, Expert Specialization, and Layerwise Steering
di: Chen, Yuxin, et al.
Pubblicazione: (2026)

Union of Experts: Adapting Hierarchical Routing to Equivalently Decomposed Transformer
di: Yang, Yujiao, et al.
Pubblicazione: (2025)

MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts
di: Su, Zhenpeng, et al.
Pubblicazione: (2024)

DiagLink: A Dual-User Diagnostic Assistance System by Synergizing Experts with LLMs and Knowledge Graphs
di: Zhou, Zihan, et al.
Pubblicazione: (2026)

SEUF: Is Unlearning One Expert Enough for Mixture-of-Experts LLMs?
di: Zhuang, Haomin, et al.
Pubblicazione: (2024)

ALTER: All-in-One Layer Pruning and Temporal Expert Routing for Efficient Diffusion Generation
di: Yang, Xiaomeng, et al.
Pubblicazione: (2025)

Expert Race: A Flexible Routing Strategy for Scaling Diffusion Transformer with Mixture of Experts
di: Yuan, Yike, et al.
Pubblicazione: (2025)

A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow Prediction
di: Wang, Guangyu, et al.
Pubblicazione: (2024)

BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Experts
di: Wang, Qingyue, et al.
Pubblicazione: (2025)

Quality-of-Service Aware LLM Routing for Edge Computing with Multiple Experts
di: Yang, Jin, et al.
Pubblicazione: (2025)

Misrouter: Exploiting Routing Mechanisms for Input-Only Attacks on Mixture-of-Experts LLMs
di: Fei, Zekun, et al.
Pubblicazione: (2026)

Data Driven Automatic Electrical Machine Preliminary Design with Artificial Intelligence Expert Guidance
di: Wang, Yiwei, et al.
Pubblicazione: (2024)

Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs
di: Bai, Jun, et al.
Pubblicazione: (2025)

Chimera: Improving Generalist Model with Domain-Specific Experts
di: Peng, Tianshuo, et al.
Pubblicazione: (2024)

Can GNN be Good Adapter for LLMs?
di: Huang, Xuanwen, et al.
Pubblicazione: (2024)

A Creative Agent is Worth a 64-Token Template
di: Shi, Ruixiao, et al.
Pubblicazione: (2026)

Dynamic Experts Search: Enhancing Reasoning in Mixture-of-Experts LLMs at Test Time
di: Han, Yixuan, et al.
Pubblicazione: (2025)

Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs
di: Zhou, Yixiao, et al.
Pubblicazione: (2025)

Expert-Guided Extinction of Toxic Tokens for Debiased Generation
di: Sun, Xueyao, et al.
Pubblicazione: (2024)

Mixture of Nested Experts: Adaptive Processing of Visual Tokens
di: Jain, Gagan, et al.
Pubblicazione: (2024)

ExpertSteer: Intervening in LLMs through Expert Knowledge
di: Wang, Weixuan, et al.
Pubblicazione: (2025)

MambaFormer: Token-Level Guided Routing Mixture-of-Experts for Accurate and Efficient Clinical Assistance
di: Khan, Hamad, et al.
Pubblicazione: (2026)

Stable-MoE: Lyapunov-based Token Routing for Distributed Mixture-of-Experts Training over Edge Networks
di: Shi, Long, et al.
Pubblicazione: (2025)

A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understanding
di: Lu, Jinghui, et al.
Pubblicazione: (2024)

Access Sets Matter: Budgeting Expert Reads for Scalable Weight-Space Model Merging
di: Wang, Yuanyi, et al.
Pubblicazione: (2026)