Copertina

Blackbird Language Matrices: A Framework to Investigate the Linguistic Competence of Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Merlo, Paola, Jiang, Chunyang, Samo, Giuseppe, Nastase, Vivi
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Exploring Italian sentence embeddings properties through multi-tasking
di: Nastase, Vivi, et al.
Pubblicazione: (2024)

Exploring syntactic information in sentence embeddings through multilingual subject-verb agreement
di: Nastase, Vivi, et al.
Pubblicazione: (2024)

Tracking linguistic information in transformer-based sentence embeddings through targeted sparsification
di: Nastase, Vivi, et al.
Pubblicazione: (2024)

Are there identifiable structural parts in the sentence embedding whole?
di: Nastase, Vivi, et al.
Pubblicazione: (2024)

Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply
di: Nastase, Vivi, et al.
Pubblicazione: (2025)

Datasets for Verb Alternations across Languages: BLM Templates and Data Augmentation Strategies
di: Samo, Giuseppe, et al.
Pubblicazione: (2026)

Modelling the Morphology of Verbal Paradigms: A Case Study in the Tokenization of Turkish and Hebrew
di: Samo, Giuseppe, et al.
Pubblicazione: (2026)

Comparing Natural and Synthetic Structured Data: A Study of the Passive Verb Alternation in French and Italian
di: Samo, Giuseppe, et al.
Pubblicazione: (2026)

Analogical Structure, Minimal Contextual Cues and Contrastive Distractors: Input Design for Sample-Efficient Linguistic Rule Induction
di: Jiang, Chunyang, et al.
Pubblicazione: (2025)

Holmes: A Benchmark to Assess the Linguistic Competence of Language Models
di: Waldis, Andreas, et al.
Pubblicazione: (2024)

Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks
di: Yamaguchi, Atsuki, et al.
Pubblicazione: (2026)

UrBLiMP: A Benchmark for Evaluating the Linguistic Competence of Large Language Models in Urdu
di: Adeeba, Farah, et al.
Pubblicazione: (2025)

Competence-Based Analysis of Language Models
di: Davies, Adam, et al.
Pubblicazione: (2023)

Heterogeneity in Formal Linguistic Competence of Language Models: Is Data the Real Bottleneck?
di: Renduchintala, H S V N S Kowndinya, et al.
Pubblicazione: (2026)

Investigating Large Language Models' Linguistic Abilities for Text Preprocessing
di: Braga, Marco, et al.
Pubblicazione: (2025)

Towards Fundamental Language Models: Does Linguistic Competence Scale with Model Size?
di: Collado-Montañez, Jaime, et al.
Pubblicazione: (2025)

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models
di: Zhou, Xinyu, et al.
Pubblicazione: (2024)

Linguistic Intelligence in Large Language Models for Telecommunications
di: Ahmed, Tasnim, et al.
Pubblicazione: (2024)

Unveiling Linguistic Regions in Large Language Models
di: Zhang, Zhihao, et al.
Pubblicazione: (2024)

Benchmarking Linguistic Diversity of Large Language Models
di: Guo, Yanzhu, et al.
Pubblicazione: (2024)

Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling
di: Prange, Jakob, et al.
Pubblicazione: (2021)

Pragmatic Competence Evaluation of Large Language Models for the Korean Language
di: Park, Dojun, et al.
Pubblicazione: (2024)

Are Language Models Agnostic to Linguistically Grounded Perturbations? A Case Study of Indic Languages
di: Ghosh, Poulami, et al.
Pubblicazione: (2024)

MorphPiece : A Linguistic Tokenizer for Large Language Models
di: Jabbar, Haris
Pubblicazione: (2023)

Traces of Social Competence in Large Language Models
di: Kouwenhoven, Tom, et al.
Pubblicazione: (2026)

Evaluating the Deductive Competence of Large Language Models
di: Seals, Spencer M., et al.
Pubblicazione: (2023)

Measuring Temporal Linguistic Emergence in Diffusion Language Models
di: Lu, Harry
Pubblicazione: (2026)

Pretraining Language Models for Diachronic Linguistic Change Discovery
di: Fittschen, Elisabeth, et al.
Pubblicazione: (2025)

Multi-Objective Linguistic Control of Large Language Models
di: Nguyen, Dang, et al.
Pubblicazione: (2024)

Importance Weighting Can Help Large Language Models Self-Improve
di: Jiang, Chunyang, et al.
Pubblicazione: (2024)

A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese
di: Liu, Yikang, et al.
Pubblicazione: (2024)

Benchmarking Motivational Interviewing Competence of Large Language Models
di: Jha, Aishwariya, et al.
Pubblicazione: (2026)

Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptions
di: Zhang, Kexun, et al.
Pubblicazione: (2024)

Inductive Linguistic Reasoning with Large Language Models
di: Ramji, Raghav, et al.
Pubblicazione: (2024)

Linguistic Structure Induction from Language Models
di: Momen, Omar
Pubblicazione: (2024)

Linguistic Profiling of a Neural Language Model
di: Miaschi, Alessio, et al.
Pubblicazione: (2020)

Extrinsic Evaluation of Cultural Competence in Large Language Models
di: Bhatt, Shaily, et al.
Pubblicazione: (2024)

Do Language Models Encode Knowledge of Linguistic Constraint Violations?
di: Hardy, et al.
Pubblicazione: (2026)

The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Models
di: Sourati, Zhivar, et al.
Pubblicazione: (2025)

How Linguistics Learned to Stop Worrying and Love the Language Models
di: Futrell, Richard, et al.
Pubblicazione: (2025)