Structural Pruning of Pre-trained Language Models via Neural Architecture Search

Documenti analoghi

• Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  di: Xia, Mengzhou, et al.
  Pubblicazione: (2023)
• Enhancing One-shot Pruned Pre-trained Language Models through Sparse-Dense-Sparse Mechanism
  di: Li, Guanchen, et al.
  Pubblicazione: (2024)
• Design Principle Transfer in Neural Architecture Search via Large Language Models
  di: Zhou, Xun, et al.
  Pubblicazione: (2024)
• Model Merging in Pre-training of Large Language Models
  di: Li, Yunshui, et al.
  Pubblicazione: (2025)
• Hyperparameter Optimization in Machine Learning
  di: Franceschi, Luca, et al.
  Pubblicazione: (2024)