Non-asymptotic Convergence of Training Transformers for Next-token Prediction

Documenti analoghi

• How Transformers Learn Regular Language Recognition: A Theoretical Study on Training Dynamics and Implicit Bias
  di: Huang, Ruiquan, et al.
  Pubblicazione: (2025)
• Robust Offline Reinforcement Learning for Non-Markovian Decision Processes
  di: Huang, Ruiquan, et al.
  Pubblicazione: (2024)
• Provably Efficient UCB-type Algorithms For Learning Predictive State Representations
  di: Huang, Ruiquan, et al.
  Pubblicazione: (2023)
• Breaking the Computational Barrier: Provably Efficient Actor-Critic for Low-Rank MDPs
  di: Huang, Ruiquan, et al.
  Pubblicazione: (2026)
• Physics in Next-token Prediction
  di: An, Hongjun, et al.
  Pubblicazione: (2024)