Imagen de Portada

The Grammar of Transformers: A Systematic Review of Interpretability Research on Syntactic Knowledge in Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Graichen, Nora, de-Dios-Flores, Iria, Boleda, Gemma
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Not a nuisance but a useful heuristic: Outlier dimensions favor frequent tokens in language models
por: Macocco, Iuri, et al.
Publicado: (2025)

A Systematic Study of Compositional Syntactic Transformer Language Models
por: Zhao, Yida, et al.
Publicado: (2025)

Using Grammar Masking to Ensure Syntactic Validity in LLM-based Modeling Tasks
por: Netz, Lukas, et al.
Publicado: (2024)

Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale
por: Hu, Xiang, et al.
Publicado: (2024)

Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models
por: Zhao, Yida, et al.
Publicado: (2024)

Tracing Computation Density in LLMs
por: Kervadec, Corentin, et al.
Publicado: (2026)

LLMs as a synthesis between symbolic and distributed approaches to language
por: Boleda, Gemma
Publicado: (2025)

Truth Knows No Language: Evaluating Truthfulness Beyond English
por: Figueras, Blanca Calvo, et al.
Publicado: (2025)

Syntactic Evolution in Language Usage
por: Kumar, Surbhit
Publicado: (2025)

Evaluating Semantic and Syntactic Understanding in Large Language Models for Payroll Systems
por: Maclean, Hendrika, et al.
Publicado: (2026)

Syntactic Control of Language Models by Posterior Inference
por: Xefteri, Vicky, et al.
Publicado: (2025)

Does Transformer Interpretability Transfer to RNNs?
por: Paulo, Gonçalo, et al.
Publicado: (2024)

A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models
por: Rai, Daking, et al.
Publicado: (2024)

Augmented Vision-Language Models: A Systematic Review
por: Davis, Anthony C, et al.
Publicado: (2025)

Why do objects have many names? A study on word informativeness in language use and lexical systems
por: Gualdoni, Eleonora, et al.
Publicado: (2024)

Syntactic Language Change in English and German: Metrics, Parsers, and Convergences
por: Chen, Yanran, et al.
Publicado: (2024)

Disjoint Processing Mechanisms of Hierarchical and Linear Grammars in Large Language Models
por: Sankaranarayanan, Aruna, et al.
Publicado: (2025)

SignAttention: On the Interpretability of Transformer Models for Sign Language Translation
por: Bianco, Pedro Alejandro Dal, et al.
Publicado: (2024)

Leveraging Grammar Induction for Language Understanding and Generation
por: Kai, Jushi, et al.
Publicado: (2024)

S$^4$C: Speculative Sampling with Syntactic and Semantic Coherence for Efficient Inference of Large Language Models
por: He, Tao, et al.
Publicado: (2025)

KELPS: A Framework for Verified Multi-Language Autoformalization via Semantic-Syntactic Alignment
por: Zhang, Jiyao, et al.
Publicado: (2025)

Achieving Peak Performance for Large Language Models: A Systematic Review
por: Rostam, Zhyar Rzgar K, et al.
Publicado: (2024)

Eliciting Latent Knowledge from Quirky Language Models
por: Mallen, Alex, et al.
Publicado: (2023)

Large Language Model for Mental Health: A Systematic Review
por: Guo, Zhijun, et al.
Publicado: (2024)

Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review
por: McGiff, Josh, et al.
Publicado: (2025)

Bias in Large Language Models Across Clinical Applications: A Systematic Review
por: Suenghataiphorn, Thanathip, et al.
Publicado: (2025)

A Monosemantic Attribution Framework for Stable Interpretability in Clinical Neuroscience Transformer-Based Language Models
por: Mamalakis, Michail, et al.
Publicado: (2026)

Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo
por: Loula, João, et al.
Publicado: (2025)

Interpretable Emergent Language Using Inter-Agent Transformers
por: Bhardwaj, Mannan
Publicado: (2025)

LengClaro2023: A Dataset of Administrative Texts in Spanish with Plain Language adaptations
por: Agüera-Marco, Belén, et al.
Publicado: (2025)

Inconsistent Tokenizations Cause Language Models to be Perplexed by Japanese Grammar
por: Gambardella, Andrew, et al.
Publicado: (2025)

Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review
por: Abbasli, Toghrul, et al.
Publicado: (2025)

A Linguistics-Aware LLM Watermarking via Syntactic Predictability
por: Park, Shinwoo, et al.
Publicado: (2025)

Grammar-Forced Translation of Natural Language to Temporal Logic using LLMs
por: English, William, et al.
Publicado: (2025)

Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyond
por: Li, Qiyuan, et al.
Publicado: (2025)

From Text to Transformation: A Comprehensive Review of Large Language Models' Versatility
por: Kaur, Pravneet, et al.
Publicado: (2024)

Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency
por: Shi, Yuchen, et al.
Publicado: (2024)

Sparse or Dense? A Mechanistic Estimation of Computation Density in Transformer-based LLMs
por: Kervadec, Corentin, et al.
Publicado: (2026)

The Dual-Stream Transformer: Channelized Architecture for Interpretable Language Modeling
por: Kerce, J. Clayton, et al.
Publicado: (2026)

Mechanistic Understanding of Language Models in Syntactic Code Completion
por: Miller, Samuel, et al.
Publicado: (2025)