Large Vocabulary Size Improves Large Language Models

Documenti analoghi

• Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capability
  di: Ri, Ryokan, et al.
  Pubblicazione: (2024)
• Natural Fingerprints of Large Language Models
  di: Suzuki, Teppei, et al.
  Pubblicazione: (2025)
• Spike No More: Stabilizing the Pre-training of Large Language Models
  di: Takase, Sho, et al.
  Pubblicazione: (2023)
• Efficient Construction of Model Family through Progressive Training Using Model Expansion
  di: Yano, Kazuki, et al.
  Pubblicazione: (2025)
• Scaling Laws for Upcycling Mixture-of-Experts Language Models
  di: Liew, Seng Pei, et al.
  Pubblicazione: (2025)