How do Transformers perform In-Context Autoregressive Learning?

Ejemplares similares

• Towards Understanding the Universality of Transformers for Next-Token Prediction
  por: Sander, Michael E., et al.
  Publicado: (2024)
• Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape
  por: Kim, Juno, et al.
  Publicado: (2024)
• Autoregressive Language Models are Secretly Energy-Based Models: Insights into the Lookahead Capabilities of Next-Token Prediction
  por: Blondel, Mathieu, et al.
  Publicado: (2025)
• Joint Learning of Energy-based Models and their Partition Function
  por: Sander, Michael E., et al.
  Publicado: (2025)
• In-Context Learning Is Provably Bayesian Inference: A Generalization Theory for Meta-Learning
  por: Wakayama, Tomoya, et al.
  Publicado: (2025)