Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining

Documenti analoghi

• Predictable Scale: Part II, Farseer: A Refined Scaling Law in Large Language Models
  di: Li, Houyi, et al.
  Pubblicazione: (2025)
• The Data Efficiency Frontier of Financial Foundation Models: Scaling Laws from Continued Pretraining
  di: Ponnock, Jesse
  Pubblicazione: (2025)
• Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design
  di: Alabdulmohsin, Ibrahim, et al.
  Pubblicazione: (2023)
• Scaling Laws for State Dynamics in Large Language Models
  di: Li, Jacob X, et al.
  Pubblicazione: (2025)
• Heaven & Hell II: Scale Laws and Robustness in One-Step Heaven-Hell Consensus
  di: Aghanya, Nnamdi Daniel, et al.
  Pubblicazione: (2025)