How Reinforcement Learning After Next-Token Prediction Facilitates Learning

Documenti analoghi

• Auto-Regressive Next-Token Predictors are Universal Learners
  di: Malach, Eran
  Pubblicazione: (2023)
• The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains
  di: Edelman, Benjamin L., et al.
  Pubblicazione: (2024)
• Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks
  di: Tsilivis, Nikolaos, et al.
  Pubblicazione: (2024)
• The Price of Implicit Bias in Adversarially Robust Generalization
  di: Tsilivis, Nikolaos, et al.
  Pubblicazione: (2024)
• On the Robustness of Neural Collapse and the Neural Collapse of Robustness
  di: Su, Jingtong, et al.
  Pubblicazione: (2023)