How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?

Documenti analoghi

• How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression
  di: Chen, Xingwu, et al.
  Pubblicazione: (2024)
• Improved Scaling Laws in Linear Regression via Data Reuse
  di: Lin, Licong, et al.
  Pubblicazione: (2025)
• In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization
  di: Zhang, Ruiqi, et al.
  Pubblicazione: (2024)
• Fixed Design Analysis of Regularization-Based Continual Learning
  di: Li, Haoran, et al.
  Pubblicazione: (2023)
• Towards Theoretical Understanding of Transformer Test-Time Computing: Investigation on In-Context Linear Regression
  di: Chen, Xingwu, et al.
  Pubblicazione: (2025)