Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient

Documenti analoghi

• The Local Learning Coefficient: A Singularity-Aware Complexity Measure
  di: Lau, Edmund, et al.
  Pubblicazione: (2023)
• Compressibility Measures Complexity: Minimum Description Length Meets Singular Learning Theory
  di: Urdshals, Einar, et al.
  Pubblicazione: (2025)
• Loss Landscape Degeneracy and Stagewise Development in Transformers
  di: Hoogland, Jesse, et al.
  Pubblicazione: (2024)
• The Loss Kernel: A Geometric Probe for Deep Learning Interpretability
  di: Adam, Maxwell, et al.
  Pubblicazione: (2025)
• Structural Inference: Interpreting Small Language Models with Susceptibilities
  di: Baker, Garrett, et al.
  Pubblicazione: (2025)