Deep networks learn to parse uniform-depth context-free languages from local statistics

Documenti analoghi

• Towards a theory of how the structure of language is acquired by deep neural networks
  di: Cagnetta, Francesco, et al.
  Pubblicazione: (2024)
• Learning curves theory for hierarchically compositional data with power-law distributed features
  di: Cagnetta, Francesco, et al.
  Pubblicazione: (2025)
• Scaling Laws and Representation Learning in Simple Hierarchical Languages: Transformers vs. Convolutional Architectures
  di: Cagnetta, Francesco, et al.
  Pubblicazione: (2025)
• Symmetry in language statistics shapes the geometry of model representations
  di: Karkada, Dhruva, et al.
  Pubblicazione: (2026)
• How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Model
  di: Tomasini, Umberto, et al.
  Pubblicazione: (2024)