Mixture-of-Subspaces in Low-Rank Adaptation

Documenti analoghi

• Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2023)
• LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  di: Yang, Yifan, et al.
  Pubblicazione: (2024)
• LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
  di: Yang, Runming, et al.
  Pubblicazione: (2024)
• Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation
  di: Wang, Dianyun, et al.
  Pubblicazione: (2025)
• MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
  di: Tang, Chuanyu, et al.
  Pubblicazione: (2024)