Can Transformers Learn $n$-gram Language Models?

Documenti analoghi

• Transformers Can Represent $n$-gram Language Models
  di: Svete, Anej, et al.
  Pubblicazione: (2024)
• What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages
  di: Borenstein, Nadav, et al.
  Pubblicazione: (2024)
• The Role of $n$-gram Smoothing in the Age of Neural Networks
  di: Malagutti, Luca, et al.
  Pubblicazione: (2024)
• On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
  di: Nowak, Franz, et al.
  Pubblicazione: (2024)
• On the Representational Capacity of Recurrent Neural Language Models
  di: Nowak, Franz, et al.
  Pubblicazione: (2023)