Saved in:
Bibliographic Details
Main Authors: Basirat, Ali, Namazifard, Danial, Hemmati, Navid Baradaran
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.20592
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We investigate structural traces of language contact in the intermediate representations of a monolingual language model. Focusing on Persian (Farsi) as a historically contact-rich language, we probe the representations of a Persian-trained model when exposed to languages with varying degrees and types of contact with Persian. Our methodology quantifies the amount of linguistic information encoded in intermediate representations and assesses how this information is distributed across model components for different morphosyntactic features. The results show that universal syntactic information is largely insensitive to historical contact, whereas morphological features such as Case and Gender are strongly shaped by language-specific structure, suggesting that contact effects in monolingual language models are selective and structurally constrained.