Saved in:
Bibliographic Details
Main Authors: Issam, Abderrahmane, Semerci, Yusuf Can, Scholtes, Jan, Spanakis, Gerasimos
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.21587
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918313058107392
author Issam, Abderrahmane
Semerci, Yusuf Can
Scholtes, Jan
Spanakis, Gerasimos
author_facet Issam, Abderrahmane
Semerci, Yusuf Can
Scholtes, Jan
Spanakis, Gerasimos
contents Despite the centrality of crosslinguistic influence (CLI) to bilingualism research, human studies often yield conflicting results due to inherent experimental variance. We address these inconsistencies by using language models (LMs) as controlled statistical learners to systematically simulate CLI and isolate its underlying drivers. Specifically, we study the effect of varying the L1 language dominance and the L2 language proficiency, which we manipulate by controlling the L2 age of exposure -- defined as the training step at which the L2 is introduced. Furthermore, we investigate the impact of pretraining on L1 languages with varying syntactic distance from the L2. Using cross-linguistic priming, we analyze how activating L1 structures impacts L2 processing. Our results align with evidence from psycholinguistic studies, confirming that language dominance and proficiency are strong predictors of CLI. We further find that while priming of grammatical structures is bidirectional, the priming of ungrammatical structures is sensitive to language dominance. Finally, we provide mechanistic evidence of CLI in LMs, demonstrating that the L1 is co-activated during L2 processing and directly influences the neural circuitry recruited for the L2. More broadly, our work demonstrates that LMs can serve as a computational framework to inform theories of human CLI.
format Preprint
id arxiv_https___arxiv_org_abs_2601_21587
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Language Models as Artificial Learners: Investigating Crosslinguistic Influence
Issam, Abderrahmane
Semerci, Yusuf Can
Scholtes, Jan
Spanakis, Gerasimos
Computation and Language
Despite the centrality of crosslinguistic influence (CLI) to bilingualism research, human studies often yield conflicting results due to inherent experimental variance. We address these inconsistencies by using language models (LMs) as controlled statistical learners to systematically simulate CLI and isolate its underlying drivers. Specifically, we study the effect of varying the L1 language dominance and the L2 language proficiency, which we manipulate by controlling the L2 age of exposure -- defined as the training step at which the L2 is introduced. Furthermore, we investigate the impact of pretraining on L1 languages with varying syntactic distance from the L2. Using cross-linguistic priming, we analyze how activating L1 structures impacts L2 processing. Our results align with evidence from psycholinguistic studies, confirming that language dominance and proficiency are strong predictors of CLI. We further find that while priming of grammatical structures is bidirectional, the priming of ungrammatical structures is sensitive to language dominance. Finally, we provide mechanistic evidence of CLI in LMs, demonstrating that the L1 is co-activated during L2 processing and directly influences the neural circuitry recruited for the L2. More broadly, our work demonstrates that LMs can serve as a computational framework to inform theories of human CLI.
title Language Models as Artificial Learners: Investigating Crosslinguistic Influence
topic Computation and Language
url https://arxiv.org/abs/2601.21587