Documenti analoghi

• How Do Nonlinear Transformers Learn and Generalize in In-Context Learning?
  di: Li, Hongkang, et al.
  Pubblicazione: (2024)
• Training Nonlinear Transformers for Chain-of-Thought Inference: A Theoretical Generalization Analysis
  di: Li, Hongkang, et al.
  Pubblicazione: (2024)
• A Theoretical Analysis of Mamba's Training Dynamics: Filtering Relevant Features for Generalization in State Space Models
  di: Shandirasegaran, Mugunthan, et al.
  Pubblicazione: (2026)
• What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding
  di: Li, Hongkang, et al.
  Pubblicazione: (2024)
• Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis
  di: Li, Hongkang, et al.
  Pubblicazione: (2024)