Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Documenti analoghi

• Unlocking Continual Learning Abilities in Language Models
  di: Du, Wenyu, et al.
  Pubblicazione: (2024)
• A Closer Look into Mixture-of-Experts in Large Language Models
  di: Lo, Ka Man, et al.
  Pubblicazione: (2024)
• Cut Your Losses! Learning to Prune Paths Early for Efficient Parallel Reasoning
  di: Bi, Jiaxi, et al.
  Pubblicazione: (2026)
• Efficient Continual Pre-training by Mitigating the Stability Gap
  di: Guo, Yiduo, et al.
  Pubblicazione: (2024)
• A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP)
  di: Tu, Weijie, et al.
  Pubblicazione: (2024)