T-REX: Mixture-of-Rank-One-Experts with Semantic-aware Intuition for Multi-task Large Language Model Finetuning

Ähnliche Einträge

• FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models
  von: Zhao, Zhongyu, et al.
  Veröffentlicht: (2024)
• PAT: Pruning-Aware Tuning for Large Language Models
  von: Liu, Yijiang, et al.
  Veröffentlicht: (2024)
• BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models
  von: He, Liulu, et al.
  Veröffentlicht: (2025)
• Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation
  von: Zhang, Rongyu, et al.
  Veröffentlicht: (2024)
• VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness
  von: Zhang, Rongyu, et al.
  Veröffentlicht: (2024)