Imagen de Portada

Lower Bounds on the Expressivity of Recurrent Neural Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Svete, Anej, Nowak, Franz, Sahabdeen, Anisha Mohamed, Cotterell, Ryan
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Representational Capacity of Recurrent Neural Language Models
por: Nowak, Franz, et al.
Publicado: (2023)

On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
por: Nowak, Franz, et al.
Publicado: (2024)

Transformers Can Represent $n$-gram Language Models
por: Svete, Anej, et al.
Publicado: (2024)

An Algebraic View of the Expressivity of Recurrent Language Models
por: Nowak, Franz, et al.
Publicado: (2026)

Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don't
por: Svete, Anej, et al.
Publicado: (2026)

An $\mathbf{L^*}$ Algorithm for Deterministic Weighted Regular Languages
por: Pasti, Clemente, et al.
Publicado: (2024)

Gumbel Counterfactual Generation From Language Models
por: Ravfogel, Shauli, et al.
Publicado: (2024)

On Efficiently Representing Regular Languages as RNNs
por: Svete, Anej, et al.
Publicado: (2024)

What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages
por: Borenstein, Nadav, et al.
Publicado: (2024)

Formal Aspects of Language Modeling
por: Cotterell, Ryan, et al.
Publicado: (2023)

Can Transformers Learn $n$-gram Language Models?
por: Svete, Anej, et al.
Publicado: (2024)

Unique Hard Attention: A Tale of Two Sides
por: Jerad, Selim, et al.
Publicado: (2025)

Information Locality as an Inductive Bias for Neural Language Models
por: Someya, Taiga, et al.
Publicado: (2025)

Training Neural Networks as Recognizers of Formal Languages
por: Butoi, Alexandra, et al.
Publicado: (2024)

The Role of $n$-gram Smoothing in the Age of Neural Networks
por: Malagutti, Luca, et al.
Publicado: (2024)

A Geometric Notion of Causal Probing
por: Guerner, Clément, et al.
Publicado: (2023)

Context-Free Recognition with Transformers
por: Jerad, Selim, et al.
Publicado: (2026)

On the Reasoning Abilities of Masked Diffusion Language Models
por: Svete, Anej, et al.
Publicado: (2025)

A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors
por: Tan, Naaman, et al.
Publicado: (2024)

Characterizing the Expressivity of Fixed-Precision Transformer Language Models
por: Li, Jiaoda, et al.
Publicado: (2025)

Probability Distributions Computed by Autoregressive Transformers
por: Yang, Andy, et al.
Publicado: (2025)

Characterizing the Expressivity of Local Attention in Transformers
por: Li, Jiaoda, et al.
Publicado: (2026)

A Fast Algorithm for Computing Prefix Probabilities
por: Nowak, Franz, et al.
Publicado: (2023)

On Affine Homotopy between Language Encoders
por: Chan, Robin SM, et al.
Publicado: (2024)

A Distributional Perspective on Word Learning in Neural Language Models
por: Ficarra, Filippo, et al.
Publicado: (2025)

Investigating Critical Period Effects in Language Acquisition through Neural Language Models
por: Constantinescu, Ionut, et al.
Publicado: (2024)

Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse
por: Tsipidi, Eleftheria, et al.
Publicado: (2024)

Cross-lingual, Character-Level Neural Morphological Tagging
por: Cotterell, Ryan, et al.
Publicado: (2017)

A Simple Joint Model for Improved Contextual Neural Lemmatization
por: Malaviya, Chaitanya, et al.
Publicado: (2019)

Low-Resource Named Entity Recognition with Cross-Lingual, Character-Level Neural Conditional Random Fields
por: Cotterell, Ryan, et al.
Publicado: (2024)

Bearing Syntactic Fruit with Stack-Augmented Neural Networks
por: DuSell, Brian, et al.
Publicado: (2025)

Efficiently Computing Susceptibility to Context in Language Models
por: Liu, Tianyu, et al.
Publicado: (2024)

Towards Explainability in Legal Outcome Prediction Models
por: Valvoda, Josef, et al.
Publicado: (2024)

On The Expressivity of Recurrent Neural Cascades
por: Knorozova, Nadezda Alexandrovna, et al.
Publicado: (2023)

The Harmonic Structure of Information Contours
por: Tsipidi, Eleftheria, et al.
Publicado: (2025)

Exact Hard Monotonic Attention for Character-Level Transduction
por: Wu, Shijie, et al.
Publicado: (2019)

Better Estimation of the Kullback--Leibler Divergence Between Language Models
por: Amini, Afra, et al.
Publicado: (2025)

Transducing Language Models
por: Snæbjarnarson, Vésteinn, et al.
Publicado: (2026)

What Do Language Models Learn in Context? The Structured Task Hypothesis
por: Li, Jiaoda, et al.
Publicado: (2024)

On the Expressivity of Recurrent Neural Cascades with Identity
por: Knorozova, Nadezda Alexandrovna, et al.
Publicado: (2024)