Imagen de Portada

MoTE: Mixture of Task-specific Experts for Pre-Trained ModelBased Class-incremental Learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Linjie, Wu, Zhenyu, Ji, Yang
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Beyond instruction-conditioning, MoTE: Mixture of Task Experts for Multi-task Embedding Models
por: Romero, Miguel, et al.
Publicado: (2025)

MoTE: Mixture of Ternary Experts for Memory-efficient Large Multimodal Models
por: Wang, Hongyu, et al.
Publicado: (2025)

Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
por: Li, Linjie, et al.
Publicado: (2026)

Mixture of insighTful Experts (MoTE): The Synergy of Thought Chains and Expert Mixtures in Self-Alignment
por: Liu, Zhili, et al.
Publicado: (2024)

Mixture of Noise for Pre-Trained Model-Based Class-Incremental Learning
por: Jiang, Kai, et al.
Publicado: (2025)

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning
por: Zhang, Dacao, et al.
Publicado: (2025)

INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning
por: Wang, Zhiyuan, et al.
Publicado: (2024)

Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models
por: Belenki, Lior, et al.
Publicado: (2025)

PreMoE: Proactive Inference for Efficient Mixture-of-Experts
por: Pei, Zehua, et al.
Publicado: (2025)

DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
por: Aghdam, Maryam Akhavan, et al.
Publicado: (2024)

Chain-of-Experts: Unlocking the Communication Power of Mixture-of-Experts Models
por: Wang, Zihan, et al.
Publicado: (2025)

L-MoE: End-to-End Training of a Lightweight Mixture of Low-Rank Adaptation Experts
por: Ji, Shihao, et al.
Publicado: (2025)

Task-Aware Mixture-of-Experts for Time Series Analysis
por: Wu, Xingjian, et al.
Publicado: (2025)

eMoE: Task-aware Memory Efficient Mixture-of-Experts-Based (MoE) Model Inference
por: Tairin, Suraiya, et al.
Publicado: (2025)

PTMs-TSCIL Pre-Trained Models Based Class-Incremental Learning
por: Wu, Yuanlong, et al.
Publicado: (2025)

HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
por: Wu, Yongji, et al.
Publicado: (2025)

Mixture-of-Experts Operator Transformer for Large-Scale PDE Pre-Training
por: Wang, Hong, et al.
Publicado: (2025)

MoEMeta: Mixture-of-Experts Meta Learning for Few-Shot Relational Learning
por: Wu, Han, et al.
Publicado: (2025)

Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
por: Yang, Minghao, et al.
Publicado: (2025)

Symphony-MoE: Harmonizing Disparate Pre-trained Models into a Coherent Mixture-of-Experts
por: Wang, Qi, et al.
Publicado: (2025)

MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
por: Chen, Xiaodong, et al.
Publicado: (2025)

LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
por: Liu, Xinyi, et al.
Publicado: (2026)

MoE-DisCo:Low Economy Cost Training Mixture-of-Experts Models
por: Ye, Xin, et al.
Publicado: (2026)

Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Experts
por: Hua, Yongxiang, et al.
Publicado: (2025)

Dual Prototypes for Adaptive Pre-Trained Model in Class-Incremental Learning
por: Xu, Zhiming, et al.
Publicado: (2024)

DirMoE: Dirichlet-routed Mixture of Experts
por: Vahidi, Amirhossein, et al.
Publicado: (2026)

Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts
por: Hendawy, Ahmed, et al.
Publicado: (2023)

MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts
por: Lin, Xi Victoria, et al.
Publicado: (2024)

Horseshoe Mixtures-of-Experts (HS-MoE)
por: Polson, Nick, et al.
Publicado: (2026)

MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting
por: Yoon, Hyekyung, et al.
Publicado: (2026)

MoBiE: Efficient Inference of Mixture of Binary Experts under Post-Training Quantization
por: Zhao, Zhixiong, et al.
Publicado: (2026)

MoNTA: Accelerating Mixture-of-Experts Training with Network-Traffc-Aware Parallel Optimization
por: Guo, Jingming, et al.
Publicado: (2024)

Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
por: Gu, Naibin, et al.
Publicado: (2025)

QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts
por: Li, Pingzhi, et al.
Publicado: (2024)

MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
por: Liu, Zehua, et al.
Publicado: (2025)

MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
por: Jin, Peng, et al.
Publicado: (2024)

BigMac: A Communication-Efficient Mixture-of-Experts Model Structure for Fast Training and Inference
por: Jin, Zewen, et al.
Publicado: (2025)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
por: Zhao, Ziyu, et al.
Publicado: (2025)

MoC-System: Efficient Fault Tolerance for Sparse Mixture-of-Experts Model Training
por: Cai, Weilin, et al.
Publicado: (2024)

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
por: Xie, Zhitian, et al.
Publicado: (2024)