T-REX: Mixture-of-Rank-One-Experts with Semantic-aware Intuition for Multi-task Large Language Model Finetuning

Documenti analoghi

• FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models
  di: Zhao, Zhongyu, et al.
  Pubblicazione: (2024)
• PAT: Pruning-Aware Tuning for Large Language Models
  di: Liu, Yijiang, et al.
  Pubblicazione: (2024)
• BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models
  di: He, Liulu, et al.
  Pubblicazione: (2025)
• Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation
  di: Zhang, Rongyu, et al.
  Pubblicazione: (2024)
• VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness
  di: Zhang, Rongyu, et al.
  Pubblicazione: (2024)