Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning

Documenti analoghi

• MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
  di: Manzoni, Andrea
  Pubblicazione: (2026)
• A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
  di: Xu, Junzhou, et al.
  Pubblicazione: (2025)
• TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
  di: Kunwar, Pradip, et al.
  Pubblicazione: (2025)
• Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
  di: Wang, Lei, et al.
  Pubblicazione: (2025)
• FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
  di: Li, Rukuo, et al.
  Pubblicazione: (2025)