A Framework for Quantifying How Pre-Training and Context Benefit In-Context Learning

Documenti analoghi

• Aligning Frozen LLMs by Reinforcement Learning: An Iterative Reweight-then-Optimize Approach
  di: Zhang, Xinnan, et al.
  Pubblicazione: (2025)
• Generative Pre-Trained Transformer for Symbolic Regression Base In-Context Reinforcement Learning
  di: Li, Yanjie, et al.
  Pubblicazione: (2024)
• Memory-Efficient LLM Pretraining via Minimalist Optimizer Design
  di: Glentis, Athanasios, et al.
  Pubblicazione: (2025)
• Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs
  di: Song, Woomin, et al.
  Pubblicazione: (2024)
• How Transformers Learn In-Context Recall Tasks? Optimality, Training Dynamics and Generalization
  di: Nguyen, Quan, et al.
  Pubblicazione: (2025)