R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts
Fuente:
arXiv
Guardado en:
| Autores principales: | Li, Zhongyang, Li, Ziyue, Zhou, Tianyi |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Routing Manifold Alignment Improves Generalization of Mixture-of-Experts LLMs
por: Li, Zhongyang, et al.
Publicado: (2025)
por: Li, Zhongyang, et al.
Publicado: (2025)
C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing
por: Li, Zhongyang, et al.
Publicado: (2025)
por: Li, Zhongyang, et al.
Publicado: (2025)
Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free
por: Li, Ziyue, et al.
Publicado: (2024)
por: Li, Ziyue, et al.
Publicado: (2024)
Skip a Layer or Loop it? Test-Time Depth Adaptation of Pretrained LLMs
por: Li, Ziyue, et al.
Publicado: (2025)
por: Li, Ziyue, et al.
Publicado: (2025)
L2R: Low-Rank and Lipschitz-Controlled Routing for Mixture-of-Experts
por: Yang, Minghao, et al.
Publicado: (2026)
por: Yang, Minghao, et al.
Publicado: (2026)
Grokking in LLM Pretraining? Monitor Memorization-to-Generalization without Test
por: Li, Ziyue, et al.
Publicado: (2025)
por: Li, Ziyue, et al.
Publicado: (2025)
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
por: Wang, Ziteng, et al.
Publicado: (2024)
por: Wang, Ziteng, et al.
Publicado: (2024)
Maximum Score Routing For Mixture-of-Experts
por: Dong, Bowen, et al.
Publicado: (2025)
por: Dong, Bowen, et al.
Publicado: (2025)
Multilingual Routing in Mixture-of-Experts
por: Bandarkar, Lucas, et al.
Publicado: (2025)
por: Bandarkar, Lucas, et al.
Publicado: (2025)
Routing-Free Mixture-of-Experts
por: Liu, Yilun, et al.
Publicado: (2026)
por: Liu, Yilun, et al.
Publicado: (2026)
EEG-Based Multimodal Learning via Hyperbolic Mixture-of-Curvature Experts
por: Zhou, Runhe, et al.
Publicado: (2026)
por: Zhou, Runhe, et al.
Publicado: (2026)
Mixture of Message Passing Experts with Routing Entropy Regularization for Node Classification
por: Chen, Xuanze, et al.
Publicado: (2025)
por: Chen, Xuanze, et al.
Publicado: (2025)
LeMoLE: LLM-Enhanced Mixture of Linear Experts for Time Series Forecasting
por: Zhang, Lingzheng, et al.
Publicado: (2024)
por: Zhang, Lingzheng, et al.
Publicado: (2024)
MoEEdit: Efficient and Routing-Stable Knowledge Editing for Mixture-of-Experts LLMs
por: Gu, Yupu, et al.
Publicado: (2026)
por: Gu, Yupu, et al.
Publicado: (2026)
RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
por: Xu, Zhiyuan, et al.
Publicado: (2026)
por: Xu, Zhiyuan, et al.
Publicado: (2026)
Selective Sinkhorn Routing for Improved Sparse Mixture of Experts
por: Nguyen, Duc Anh, et al.
Publicado: (2025)
por: Nguyen, Duc Anh, et al.
Publicado: (2025)
Improving Routing in Sparse Mixture of Experts with Graph of Tokens
por: Nguyen, Tam, et al.
Publicado: (2025)
por: Nguyen, Tam, et al.
Publicado: (2025)
Adaptive Inverted-Index Routing for Granular Mixtures-of-Experts
por: Kladny, Klaus-Rudolf, et al.
Publicado: (2026)
por: Kladny, Klaus-Rudolf, et al.
Publicado: (2026)
Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models
por: Liang, Jingcong, et al.
Publicado: (2025)
por: Liang, Jingcong, et al.
Publicado: (2025)
Separation and Collaboration: Two-Level Routing Grouped Mixture-of-Experts for Multi-Domain Continual Learning
por: Zhou, Jialu, et al.
Publicado: (2025)
por: Zhou, Jialu, et al.
Publicado: (2025)
Stable Routing for Mixture-of-Experts in Class-Incremental Learning
por: Guo, Zirui, et al.
Publicado: (2026)
por: Guo, Zirui, et al.
Publicado: (2026)
TiMi: Empower Time Series Transformers with Multimodal Mixture of Experts
por: Lin, Jiafeng, et al.
Publicado: (2026)
por: Lin, Jiafeng, et al.
Publicado: (2026)
Exact Recovery of Community Detection in dependent Gaussian Mixture Models
por: Li, Zhongyang, et al.
Publicado: (2022)
por: Li, Zhongyang, et al.
Publicado: (2022)
Variational Routing: A Scalable Bayesian Framework for Calibrated Mixture-of-Experts Transformers
por: Li, Albus Yizhuo, et al.
Publicado: (2026)
por: Li, Albus Yizhuo, et al.
Publicado: (2026)
EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts
por: Cheng, Anzhe, et al.
Publicado: (2026)
por: Cheng, Anzhe, et al.
Publicado: (2026)
Grassmannian Mixture-of-Experts: Concentration-Controlled Routing on Subspace Manifolds
por: Shihab, Ibne Farabi, et al.
Publicado: (2026)
por: Shihab, Ibne Farabi, et al.
Publicado: (2026)
MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts
por: Zhou, Jianan, et al.
Publicado: (2024)
por: Zhou, Jianan, et al.
Publicado: (2024)
Mixture Experts with Test-Time Self-Supervised Aggregation for Tabular Imbalanced Regression
por: Wang, Yung-Chien, et al.
Publicado: (2025)
por: Wang, Yung-Chien, et al.
Publicado: (2025)
Geometric Mixture-of-Experts with Curvature-Guided Adaptive Routing for Graph Representation Learning
por: Cao, Haifang, et al.
Publicado: (2026)
por: Cao, Haifang, et al.
Publicado: (2026)
Neural Inhibition Improves Dynamic Routing and Mixture of Experts
por: Zou, Will Y., et al.
Publicado: (2025)
por: Zou, Will Y., et al.
Publicado: (2025)
Task-Aware Mixture-of-Experts for Time Series Analysis
por: Wu, Xingjian, et al.
Publicado: (2025)
por: Wu, Xingjian, et al.
Publicado: (2025)
Dynamic Experts Search: Enhancing Reasoning in Mixture-of-Experts LLMs at Test Time
por: Han, Yixuan, et al.
Publicado: (2025)
por: Han, Yixuan, et al.
Publicado: (2025)
Guided by the Experts: Provable Feature Learning Dynamic of Soft-Routed Mixture-of-Experts
por: Liao, Fangshuo, et al.
Publicado: (2025)
por: Liao, Fangshuo, et al.
Publicado: (2025)
When Are Experts Misrouted? Counterfactual Routing Analysis in Mixture-of-Experts Language Models
por: Yoon, Youngsik, et al.
Publicado: (2026)
por: Yoon, Youngsik, et al.
Publicado: (2026)
LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
por: Liu, Xinyi, et al.
Publicado: (2026)
por: Liu, Xinyi, et al.
Publicado: (2026)
Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Experts
por: Hua, Yongxiang, et al.
Publicado: (2025)
por: Hua, Yongxiang, et al.
Publicado: (2025)
Sparse Models, Sparse Safety: Unsafe Routes in Mixture-of-Experts LLMs
por: Jiang, Yukun, et al.
Publicado: (2026)
por: Jiang, Yukun, et al.
Publicado: (2026)
Soft-to-Hard Routing in Sparse Mixture-of-Experts Models
por: Rastegar, Reza
Publicado: (2026)
por: Rastegar, Reza
Publicado: (2026)
ProbMoE: Differentiable Probabilistic Routing for Mixture-of-Experts
por: Zhao, Heng, et al.
Publicado: (2026)
por: Zhao, Heng, et al.
Publicado: (2026)
Wavelet Mixture of Experts for Time Series Forecasting
por: Zhou, Zheng, et al.
Publicado: (2025)
por: Zhou, Zheng, et al.
Publicado: (2025)
Ejemplares similares
-
Routing Manifold Alignment Improves Generalization of Mixture-of-Experts LLMs
por: Li, Zhongyang, et al.
Publicado: (2025) -
C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing
por: Li, Zhongyang, et al.
Publicado: (2025) -
Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free
por: Li, Ziyue, et al.
Publicado: (2024) -
Skip a Layer or Loop it? Test-Time Depth Adaptation of Pretrained LLMs
por: Li, Ziyue, et al.
Publicado: (2025) -
L2R: Low-Rank and Lipschitz-Controlled Routing for Mixture-of-Experts
por: Yang, Minghao, et al.
Publicado: (2026)