Cover Image

Probing Syntax in Large Language Models: Successes and Remaining Challenges

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Diego-Simón, Pablo J., Chemla, Emmanuel, King, Jean-Rémi, Lakretz, Yair
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Polar probe linearly decodes semantic structures from LLMs
by: Diego-Simón, Pablo J., et al.
Published: (2026)

A polar coordinate system represents syntax in large language models
by: Diego-Simón, Pablo, et al.
Published: (2024)

Emergence of Phonemic, Syntactic, and Semantic Representations in Artificial Neural Networks
by: Orhan, Pierre, et al.
Published: (2026)

Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations
by: Jalouzot, Louis, et al.
Published: (2024)

What Makes Two Language Models Think Alike?
by: Salle, Jeanne, et al.
Published: (2024)

A Neural Model for Word Repetition
by: Dager, Daniel, et al.
Published: (2025)

Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models
by: Bianchi, Bruno, et al.
Published: (2024)

Meta-Learning Neural Mechanisms rather than Bayesian Priors
by: Goodale, Michael, et al.
Published: (2025)

Large Language Models as Proxies for Theories of Human Linguistic Cognition
by: Ziv, Imry, et al.
Published: (2025)

MapFormer: Self-Supervised Learning of Cognitive Maps with Input-Dependent Positional Embeddings
by: Rambaud, Victor, et al.
Published: (2025)

No Such Thing as a General Learner: Language models and their dual optimization
by: Chemla, Emmanuel, et al.
Published: (2024)

Biasless Language Models Learn Unnaturally: How LLMs Fail to Distinguish the Possible from the Impossible
by: Ziv, Imry, et al.
Published: (2025)

Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach
by: Poli, Maxime, et al.
Published: (2024)

Bridging the Empirical-Theoretical Gap in Neural Network Formal Language Learning Using Minimum Description Length
by: Lan, Nur, et al.
Published: (2024)

fastabx: A library for efficient computation of ABX discriminability
by: Poli, Maxime, et al.
Published: (2025)

Optimizing fMRI Data Acquisition for Decoding Natural Speech with Limited Participants
by: Jalouzot, Louis, et al.
Published: (2025)

The Impact of Syntactic and Semantic Proximity on Machine Translation with Back-Translation
by: Guerin, Nicolas, et al.
Published: (2024)

Syntax Without Semantics: Teaching Large Language Models to Code in an Unseen Language
by: Kumar, Vinayshekhar Bannihatti, et al.
Published: (2026)

Morphology and Syntax of the Tamil Language
by: Sarveswaran, Kengatharaiyer
Published: (2024)

Sneaking Syntax into Transformer Language Models with Tree Regularization
by: Nandi, Ananjan, et al.
Published: (2024)

How Syntax Specialization Emerges in Language Models
by: Duan, Xufeng, et al.
Published: (2025)

Topology of Syntax Networks across Languages
by: Soria-Postigo, Juan, et al.
Published: (2025)

Universal Syntactic Structures: Modeling Syntax for Various Natural Languages
by: Kim, Min K., et al.
Published: (2023)

Child-Directed Language Does Not Consistently Boost Syntax Learning in Language Models
by: Padovani, Francesca, et al.
Published: (2025)

Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics
by: Zhang, Yuhan, et al.
Published: (2023)

Large Language Models and the Rationalist Empiricist Debate
by: King, David
Published: (2024)

Lexical Tone is Hard to Quantize: Probing Discrete Speech Units in Mandarin and Yorùbá
by: Osakuade, Opeyemi, et al.
Published: (2026)

Syntax-Guided Diffusion Language Models with User-Integrated Personalization
by: Zhang, Ruqian, et al.
Published: (2025)

Mechanisms vs. Outcomes: Probing for Syntax Fails to Explain Performance on Targeted Syntactic Evaluations
by: Agarwal, Ananth, et al.
Published: (2025)

Code-Switching and Syntax: A Large-Scale Experiment
by: Sterner, Igor, et al.
Published: (2025)

A Minimum Description Length Approach to Regularization in Neural Networks
by: Abudy, Matan, et al.
Published: (2025)

Probing Ethical Framework Representations in Large Language Models: Structure, Entanglement, and Methodological Challenges
by: Xu, Weilun, et al.
Published: (2026)

$\mathcal{S}^2$IT: Stepwise Syntax Integration Tuning for Large Language Models in Aspect Sentiment Quad Prediction
by: Chen, Bingfeng, et al.
Published: (2026)

Unraveling Syntax: How Language Models Learn Context-Free Grammars
by: Schulz, Laura Ying, et al.
Published: (2025)

On Eliciting Syntax from Language Models via Hashing
by: Wang, Yiran, et al.
Published: (2024)

Probing Cultural Signals in Large Language Models through Author Profiling
by: Lafargue, Valentin, et al.
Published: (2026)

Probing then Editing Response Personality of Large Language Models
by: Ju, Tianjie, et al.
Published: (2025)

Useful Evaluation: Syntax and Semantics (Technical Report)
by: Barenbaum, Pablo, et al.
Published: (2024)

Probing the Subtle Ideological Manipulation of Large Language Models
by: Paschalides, Demetris, et al.
Published: (2025)

Generative Linguistics, Large Language Models, and the Social Nature of Scientific Success
by: Hao, Sophie
Published: (2025)