SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models

Documenti analoghi

• Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  di: Lu, Xudong, et al.
  Pubblicazione: (2024)
• LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
  di: Zhang, Renrui, et al.
  Pubblicazione: (2023)
• BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
  di: Xu, Peng, et al.
  Pubblicazione: (2024)
• TerDiT: Ternary Diffusion Models with Transformers
  di: Lu, Xudong, et al.
  Pubblicazione: (2024)
• Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
  di: Wang, Tuowei, et al.
  Pubblicazione: (2025)