Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models

Documenti analoghi

• FedCCRL: Federated Domain Generalization with Cross-Client Representation Learning
  di: Wang, Xinpeng, et al.
  Pubblicazione: (2024)
• SAME: Stabilized Mixture-of-Experts for Multimodal Continual Instruction Tuning
  di: Xie, Zhen-Hao, et al.
  Pubblicazione: (2026)
• A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
  di: Sun, Mengyang, et al.
  Pubblicazione: (2025)
• PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
  di: Liu, Yilun, et al.
  Pubblicazione: (2024)
• MELINOE: Fine-Tuning Enables Memory-Efficient Inference for Mixture-of-Experts Models
  di: Raje, Arian, et al.
  Pubblicazione: (2026)