On the Emergence of Induction Heads for In-Context Learning

Documenti analoghi

• Probing for Arithmetic Errors in Language Models
  di: Sun, Yucheng, et al.
  Pubblicazione: (2025)
• Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformers
  di: Musat, Tiberiu
  Pubblicazione: (2024)
• Dense SAE Latents Are Features, Not Bugs
  di: Sun, Xiaoqing, et al.
  Pubblicazione: (2025)
• Confidence Regulation Neurons in Language Models
  di: Stolfo, Alessandro, et al.
  Pubblicazione: (2024)
• Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners?
  di: Opedal, Andreas, et al.
  Pubblicazione: (2024)