Towards Understanding How Transformers Learn In-context Through a Representation Learning Lens

Documenti analoghi

• Revisiting Transformers through the Lens of Low Entropy and Dynamic Sparsity
  di: Ren, Ruifeng, et al.
  Pubblicazione: (2025)
• Understanding In-Context Learning of Linear Models in Transformers Through an Adversarial Lens
  di: Anwar, Usman, et al.
  Pubblicazione: (2024)
• Transformers as Intrinsic Optimizers: Forward Inference through the Energy Principle
  di: Ren, Ruifeng, et al.
  Pubblicazione: (2025)
• Toward Understanding In-context vs. In-weight Learning
  di: Chan, Bryan, et al.
  Pubblicazione: (2024)
• Understanding Learning Dynamics Through Structured Representations
  di: Nikooroo, Saleh, et al.
  Pubblicazione: (2025)