Probing Geometry of Next Token Prediction Using Cumulant Expansion of the Softmax Entropy

Documenti analoghi

• Berezinskii--Kosterlitz--Thouless transition in a context-sensitive random language model
  di: Toji, Yuma, et al.
  Pubblicazione: (2024)
• Phase transition on a context-sensitive random language model with short range interactions
  di: Toji, Yuma, et al.
  Pubblicazione: (2026)
• The Information Geometry of Softmax: Probing and Steering
  di: Park, Kiho, et al.
  Pubblicazione: (2026)
• Phase Transitions in the Output Distribution of Large Language Models
  di: Arnold, Julian, et al.
  Pubblicazione: (2024)
• The Geometry of Tokens in Internal Representations of Large Language Models
  di: Viswanathan, Karthik, et al.
  Pubblicazione: (2025)