Exploring Gaps in the APS: Direct Minimal Pair Analysis in LLM Syntactic Assessments
Fuente:
arXiv
Saved in:
| Main Authors: | Pistotti, Timothy, Brown, Jason, Witbrock, Michael |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Evaluating The Impact of Stimulus Quality in Investigations of LLM Language Performance
by: Pistotti, Timothy, et al.
Published: (2025)
by: Pistotti, Timothy, et al.
Published: (2025)
Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language Models
by: Bao, Qiming, et al.
Published: (2023)
by: Bao, Qiming, et al.
Published: (2023)
RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimization
by: Bao, Qiming, et al.
Published: (2026)
by: Bao, Qiming, et al.
Published: (2026)
Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning
by: Bao, Qiming, et al.
Published: (2023)
by: Bao, Qiming, et al.
Published: (2023)
A Linguistically Motivated Analysis of Intonational Phrasing in Text-to-Speech Systems: Revealing Gaps in Syntactic Sensitivity
by: Pouw, Charlotte, et al.
Published: (2025)
by: Pouw, Charlotte, et al.
Published: (2025)
A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese
by: Liu, Yikang, et al.
Published: (2024)
by: Liu, Yikang, et al.
Published: (2024)
Bridging the Reasoning Gap: Small LLMs Can Plan with Generalised Strategies
by: Borro, Andrey, et al.
Published: (2025)
by: Borro, Andrey, et al.
Published: (2025)
Tree Transformers are an Ineffective Model of Syntactic Constituency
by: Ginn, Michael
Published: (2024)
by: Ginn, Michael
Published: (2024)
Consistency Analysis of Sentiment Predictions using Syntactic & Semantic Context Assessment Summarization (SSAS)
by: Daruwalla, Sharookh, et al.
Published: (2026)
by: Daruwalla, Sharookh, et al.
Published: (2026)
Mapping Semantic & Syntactic Relationships with Geometric Rotation
by: Freenor, Michael, et al.
Published: (2025)
by: Freenor, Michael, et al.
Published: (2025)
Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairs
by: Karabüklü, Serpil, et al.
Published: (2026)
by: Karabüklü, Serpil, et al.
Published: (2026)
Conflict-Aware Fusion: Mitigating Logic Inertia in Large Language Models via Structured Cognitive Priors
by: Bao, Qiming, et al.
Published: (2025)
by: Bao, Qiming, et al.
Published: (2025)
Semantic Graphs for Syntactic Simplification: A Revisit from the Age of LLM
by: Yao, Peiran, et al.
Published: (2024)
by: Yao, Peiran, et al.
Published: (2024)
Fine-Grained Analysis of Shared Syntactic Mechanisms in Language Models
by: Kumon, Ryoma, et al.
Published: (2026)
by: Kumon, Ryoma, et al.
Published: (2026)
A Linguistics-Aware LLM Watermarking via Syntactic Predictability
by: Park, Shinwoo, et al.
Published: (2025)
by: Park, Shinwoo, et al.
Published: (2025)
Using Large Language Models for the Interpretation of Building Regulations
by: Fuchs, Stefan, et al.
Published: (2024)
by: Fuchs, Stefan, et al.
Published: (2024)
Minimal Pair-Based Evaluation of Code-Switching
by: Sterner, Igor, et al.
Published: (2025)
by: Sterner, Igor, et al.
Published: (2025)
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
by: Roy, Subhro, et al.
Published: (2022)
by: Roy, Subhro, et al.
Published: (2022)
Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions
by: Plaza-del-Arco, Flor Miriam, et al.
Published: (2024)
by: Plaza-del-Arco, Flor Miriam, et al.
Published: (2024)
Same Meaning, Different Scores: Lexical and Syntactic Sensitivity in LLM Evaluation
by: Kostić, Bogdan, et al.
Published: (2026)
by: Kostić, Bogdan, et al.
Published: (2026)
XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairs
by: He, Linyang, et al.
Published: (2025)
by: He, Linyang, et al.
Published: (2025)
Psychology-Driven Enhancement of Humour Translation
by: Su, Yuchen, et al.
Published: (2025)
by: Su, Yuchen, et al.
Published: (2025)
Investigating Syntactic Biases in Multilingual Transformers with RC Attachment Ambiguities in Italian and English
by: Kamerath, Michael, et al.
Published: (2025)
by: Kamerath, Michael, et al.
Published: (2025)
Unveiling LLMs' Metaphorical Understanding: Exploring Conceptual Irrelevance, Context Leveraging and Syntactic Influence
by: Ye, Fengying, et al.
Published: (2025)
by: Ye, Fengying, et al.
Published: (2025)
RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
by: Taktasheva, Ekaterina, et al.
Published: (2024)
by: Taktasheva, Ekaterina, et al.
Published: (2024)
$K$-MSHC: Unmasking Minimally Sufficient Head Circuits in Large Language Models with Experiments on Syntactic Classification Tasks
by: Chowdhary, Pratim, et al.
Published: (2025)
by: Chowdhary, Pratim, et al.
Published: (2025)
Syntactically-guided Information Maintenance in Sentence Comprehension
by: Isono, Shinnosuke, et al.
Published: (2026)
by: Isono, Shinnosuke, et al.
Published: (2026)
Grammar Assistance Using Syntactic Structures (GAUSS)
by: Zamaraeva, Olga, et al.
Published: (2024)
by: Zamaraeva, Olga, et al.
Published: (2024)
Detection and Measurement of Syntactic Templates in Generated Text
by: Shaib, Chantal, et al.
Published: (2024)
by: Shaib, Chantal, et al.
Published: (2024)
Menzerath-Altmann Law for Syntactic Structures in Ukrainian
by: Buk, Solomija, et al.
Published: (2007)
by: Buk, Solomija, et al.
Published: (2007)
Syntactic Evolution in Language Usage
by: Kumar, Surbhit
Published: (2025)
by: Kumar, Surbhit
Published: (2025)
Graph Neural Network Framework for Sentiment Analysis Using Syntactic Feature
by: Wu, Linxiao, et al.
Published: (2024)
by: Wu, Linxiao, et al.
Published: (2024)
Discriminating Form and Meaning in Multilingual Models with Minimal-Pair ABX Tasks
by: de Seyssel, Maureen, et al.
Published: (2025)
by: de Seyssel, Maureen, et al.
Published: (2025)
TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairs
by: Başar, Ezgi, et al.
Published: (2025)
by: Başar, Ezgi, et al.
Published: (2025)
Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models
by: Zhou, Xinyu, et al.
Published: (2024)
by: Zhou, Xinyu, et al.
Published: (2024)
Large Language Models Enhanced by Plug and Play Syntactic Knowledge for Aspect-based Sentiment Analysis
by: Tian, Yuanhe, et al.
Published: (2025)
by: Tian, Yuanhe, et al.
Published: (2025)
Triple GNNs: Introducing Syntactic and Semantic Information for Conversational Aspect-Based Quadruple Sentiment Analysis
by: Li, Binbin, et al.
Published: (2024)
by: Li, Binbin, et al.
Published: (2024)
Towards Human Cognition: Visual Context Guides Syntactic Priming in Fusion-Encoded Models
by: Xiao, Bushi, et al.
Published: (2025)
by: Xiao, Bushi, et al.
Published: (2025)
A Joint Multitask Model for Morpho-Syntactic Parsing
by: Inostroza, Demian, et al.
Published: (2025)
by: Inostroza, Demian, et al.
Published: (2025)
A Systematic Comparison of Syntactic Representations of Dependency Parsing
by: Wisniewski, Guillaume, et al.
Published: (2025)
by: Wisniewski, Guillaume, et al.
Published: (2025)
Similar Items
-
Evaluating The Impact of Stimulus Quality in Investigations of LLM Language Performance
by: Pistotti, Timothy, et al.
Published: (2025) -
Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language Models
by: Bao, Qiming, et al.
Published: (2023) -
RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimization
by: Bao, Qiming, et al.
Published: (2026) -
Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning
by: Bao, Qiming, et al.
Published: (2023) -
A Linguistically Motivated Analysis of Intonational Phrasing in Text-to-Speech Systems: Revealing Gaps in Syntactic Sensitivity
by: Pouw, Charlotte, et al.
Published: (2025)