Task Generalization With AutoRegressive Compositional Structure: Can Learning From $D$ Tasks Generalize to $D^{T}$ Tasks?

Documenti analoghi

• Context-Scaling versus Task-Scaling in In-Context Learning
  di: Abedsoltan, Amirhesam, et al.
  Pubblicazione: (2024)
• From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency
  di: Wen, Kaiyue, et al.
  Pubblicazione: (2024)
• On the Nystrom Approximation for Preconditioning in Kernel Machines
  di: Abedsoltan, Amirhesam, et al.
  Pubblicazione: (2023)
• Fast training of large kernel models with delayed projections
  di: Abedsoltan, Amirhesam, et al.
  Pubblicazione: (2024)
• Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting
  di: Mallinar, Neil, et al.
  Pubblicazione: (2022)