LoRA-Switch: Boosting the Efficiency of Dynamic LLM Adapters via System-Algorithm Co-design

Documenti analoghi

• Empower Vision Applications with LoRA LMM
  di: Mi, Liang, et al.
  Pubblicazione: (2024)
• SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget
  di: Kong, Rui, et al.
  Pubblicazione: (2023)
• S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  di: Sheng, Ying, et al.
  Pubblicazione: (2023)
• AdaFuse: Accelerating Dynamic Adapter Inference via Token-Level Pre-Gating and Fused Kernel Optimization
  di: Li, Qiyang, et al.
  Pubblicazione: (2026)
• mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
  di: Ye, Zhengmao, et al.
  Pubblicazione: (2023)