Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data

Documenti analoghi

• Understanding Transformers via N-gram Statistics
  di: Nguyen, Timothy
  Pubblicazione: (2024)
• Unifying Learning Dynamics and Generalization in Transformers Scaling Law
  di: Yang, Chiwun
  Pubblicazione: (2025)
• Relative-Based Scaling Law for Neural Language Models
  di: Yue, Baoqing, et al.
  Pubblicazione: (2025)
• Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws
  di: Kamigaito, Hidetaka, et al.
  Pubblicazione: (2025)
• Dynamic Universal Approximation Theory: The Basic Theory for Transformer-based Large Language Models
  di: Wang, Wei, et al.
  Pubblicazione: (2024)