Scaling Exponents Across Parameterizations and Optimizers

Documenti analoghi

• Training LLMs over Neurally Compressed Text
  di: Lester, Brian, et al.
  Pubblicazione: (2024)
• The boundary of neural network trainability is fractal
  di: Sohl-Dickstein, Jascha
  Pubblicazione: (2024)
• General-Purpose In-Context Learning by Meta-Learning Transformers
  di: Kirsch, Louis, et al.
  Pubblicazione: (2022)
• The Hot Mess of AI: How Does Misalignment Scale With Model Intelligence and Task Complexity?
  di: Hägele, Alexander, et al.
  Pubblicazione: (2026)
• 4+3 Phases of Compute-Optimal Neural Scaling Laws
  di: Paquette, Elliot, et al.
  Pubblicazione: (2024)