Cover Image

Minimal Pair-Based Evaluation of Code-Switching

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sterner, Igor, Teufel, Simone
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Code-Switching and Syntax: A Large-Scale Experiment
by: Sterner, Igor, et al.
Published: (2025)

Can Language Models Rival Mathematics Students? Evaluating Mathematical Reasoning through Textual Manipulation and Human Experiments
by: Nikolaiev, Andrii, et al.
Published: (2024)

Contrastive Learning with Narrative Twins for Modeling Story Salience
by: Sterner, Igor, et al.
Published: (2026)

A Comprehensive Evaluation of Semantic Relation Knowledge of Pretrained Language Models and Humans
by: Cao, Zhihan, et al.
Published: (2024)

Few-Shot VQA with Frozen LLMs: A Tale of Two Approaches
by: Sterner, Igor, et al.
Published: (2024)

Misalignment of Semantic Relation Knowledge between WordNet and Human Intuition
by: Cao, Zhihan, et al.
Published: (2024)

Lost in the Mix: Evaluating LLM Understanding of Code-Switched Text
by: Mohamed, Amr, et al.
Published: (2025)

CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Models
by: Oba, Miyu, et al.
Published: (2026)

Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation
by: Frohmann, Markus, et al.
Published: (2024)

ChainNet: Structured Metaphor and Metonymy in WordNet
by: Maudslay, Rowan Hall, et al.
Published: (2024)

Can Code-Switched Texts Activate a Knowledge Switch in LLMs? A Case Study on English-Korean Code-Switching
by: Kim, Seoyeon, et al.
Published: (2024)

Evaluating Large Language Models on Multiword Expressions in Multilingual and Code-Switched Contexts
by: De Leon, Frances Laureano, et al.
Published: (2025)

XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairs
by: He, Linyang, et al.
Published: (2025)

Can LLMs capture stable human-generated sentence entropy measures?
by: Pivel-Villanueva, Estrella, et al.
Published: (2026)

RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
by: Taktasheva, Ekaterina, et al.
Published: (2024)

Parsing the Switch: LLM-Based UD Annotation for Complex Code-Switched and Low-Resource Languages
by: Kellert, Olga, et al.
Published: (2025)

PIER: A Novel Metric for Evaluating What Matters in Code-Switching
by: Ugan, Enes Yavuz, et al.
Published: (2025)

Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding
by: Yoo, Haneul, et al.
Published: (2024)

CS3-Bench: Evaluating and Enhancing Speech-to-Speech LLMs for Mandarin-English Code-Switching
by: Liu, Heyang, et al.
Published: (2025)

Lost in Speech: Benchmarking, Evaluation, and Parsing of Spoken Code-Switching Beyond Standard UD Assumptions
by: Tyagi, Nemika, et al.
Published: (2026)

Discriminating Form and Meaning in Multilingual Models with Minimal-Pair ABX Tasks
by: de Seyssel, Maureen, et al.
Published: (2025)

TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairs
by: Başar, Ezgi, et al.
Published: (2025)

A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese
by: Liu, Yikang, et al.
Published: (2024)

Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairs
by: Karabüklü, Serpil, et al.
Published: (2026)

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models
by: Zhou, Xinyu, et al.
Published: (2024)

QFrBLiMP: a Quebec-French Benchmark of Linguistic Minimal Pairs
by: Beauchemin, David, et al.
Published: (2025)

Exploring Gaps in the APS: Direct Minimal Pair Analysis in LLM Syntactic Assessments
by: Pistotti, Timothy, et al.
Published: (2025)

Evaluating Multilingual and Code-Switched Alignment in LLMs via Synthetic Natural Language Inference
by: Abdaljalil, Samir, et al.
Published: (2025)

Semantic Map-based Generation of Navigation Instructions
by: Li, Chengzu, et al.
Published: (2024)

Enhancing Multilingual Language Models for Code-Switched Input Data
by: Xie, Katherine, et al.
Published: (2025)

Code-Switched Language Identification is Harder Than You Think
by: Burchell, Laurie, et al.
Published: (2024)

Grammatical Error Correction for Code-Switched Sentences by Learners of English
by: Chan, Kelvin Wey Han, et al.
Published: (2024)

Methods of Automatic Matrix Language Determination for Code-Switched Speech
by: Iakovenko, Olga, et al.
Published: (2024)

OLA: Output Language Alignment in Code-Switched LLM Interactions
by: Oh, Juhyun, et al.
Published: (2026)

Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Text
by: De Leon, Frances A. Laureano, et al.
Published: (2024)

Code-Based English Models Surprising Performance on Chinese QA Pair Extraction Task
by: Zheng, Linghan, et al.
Published: (2024)

CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units
by: Kang, Yeeun
Published: (2024)

MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs
by: Jumelet, Jaap, et al.
Published: (2025)

Conditioning LLMs to Generate Code-Switched Text
by: Heredia, Maite, et al.
Published: (2025)

DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching
by: Ojo, Jessica, et al.
Published: (2025)