Image de couverture de livre

Interference Matrix: Quantifying Cross-Lingual Interference in Transformer Encoders

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Alastruey, Belen, Janeiro, João Maria, Allauzen, Alexandre, Elbayad, Maha, Barrault, Loïc, Costa-jussà, Marta R.
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Unveiling the Role of Pretraining in Direct Speech Translation
par: Alastruey, Belen, et autres
Publié: (2024)

Omnilingual SONAR: Cross-Lingual and Cross-Modal Sentence Embeddings Bridging Massively Multilingual Text and Speech
par: Omnilingual SONAR Team, et autres
Publié: (2026)

Large Concept Models: Language Modeling in a Sentence Representation Space
par: LCM team, et autres
Publié: (2024)

MEXMA: Token-level objectives improve sentence representations
par: Janeiro, João Maria, et autres
Publié: (2024)

Merging Text Transformer Models from Different Initializations
par: Verma, Neha, et autres
Publié: (2024)

SpeechAlign: a Framework for Speech Translation Alignment Evaluation
par: Alastruey, Belen, et autres
Publié: (2023)

Linguini: A benchmark for language-agnostic linguistic reasoning
par: Sánchez, Eduardo, et autres
Publié: (2024)

Translate, then Detect: Leveraging Machine Translation for Cross-Lingual Toxicity Classification
par: Bell, Samuel J., et autres
Publié: (2025)

Polynomial Mixing for Efficient Self-supervised Speech Encoders
par: Feillet, Eva, et autres
Publié: (2026)

On the Similarity of Circuits across Languages: a Case Study on the Subject-verb Agreement Task
par: Ferrando, Javier, et autres
Publié: (2024)

A Primer on the Inner Workings of Transformer-based Language Models
par: Ferrando, Javier, et autres
Publié: (2024)

Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders
par: Veitsman, Yana, et autres
Publié: (2026)

Quantifying Cross-Lingual Transfer in Paralinguistic Speech Tasks
par: Buitrago, Pol, et autres
Publié: (2026)

Improving Language and Modality Transfer in Translation by Character-level Modeling
par: Tsiamas, Ioannis, et autres
Publié: (2025)

2M-BELEBELE: Highly Multilingual Speech and American Sign Language Comprehension Dataset
par: Costa-jussà, Marta R., et autres
Publié: (2024)

We Need to Talk About Classification Evaluation Metrics in NLP
par: Vickers, Peter, et autres
Publié: (2024)

Investigating the Effect of Parallel Data in the Cross-Lingual Transfer for Vision-Language Encoders
par: Manea, Andrei-Alexandru, et autres
Publié: (2025)

Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignment
par: Huang, Yongxin, et autres
Publié: (2024)

Text-Guided Semantic Image Encoder
par: Thirukovalluru, Raghuveer, et autres
Publié: (2025)

Languages are Modalities: Cross-Lingual Alignment via Encoder Injection
par: Agarwal, Rajan, et autres
Publié: (2025)

MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning
par: Uemura, Kosei, et autres
Publié: (2025)

Neither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoders
par: Mazumder, Debajyoti, et autres
Publié: (2026)

Uncovering Cross-Objective Interference in Multi-Objective Alignment
par: Lu, Yining, et autres
Publié: (2026)

Gender-specific Machine Translation with Large Language Models
par: Sánchez, Eduardo, et autres
Publié: (2023)

Pushing the Limits of Zero-shot End-to-End Speech Translation
par: Tsiamas, Ioannis, et autres
Publié: (2024)

Identifying and typifying demographic unfairness in phoneme-level embeddings of self-supervised speech recognition models
par: Herron, Felix, et autres
Publié: (2026)

Tutorial: $φ$-Transductions in OpenFst via the Gallic Semiring
par: Cognetta, Marco, et autres
Publié: (2025)

A* shortest string decoding for non-idempotent semirings
par: Gorman, Kyle, et autres
Publié: (2022)

Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models
par: Xu, Zixiang, et autres
Publié: (2025)

CLIX: Cross-Lingual Explanations of Idiomatic Expressions
par: Gluck, Aaron, et autres
Publié: (2025)

Spirit LM: Interleaved Spoken and Written Language Model
par: Nguyen, Tu Anh, et autres
Publié: (2024)

Signal in the Noise: Polysemantic Interference Transfers and Predicts Cross-Model Influence
par: Gong, Bofan, et autres
Publié: (2025)

Responsible Benchmarking of Fairness for Automatic Speech Recognition
par: Herron, Felix, et autres
Publié: (2026)

Where Do Self-Supervised Speech Models Become Unfair?
par: Herron, Felix, et autres
Publié: (2026)

Cross-Lingual and Cross-Cultural Variation in Image Descriptions
par: Berger, Uri, et autres
Publié: (2024)

A Local Perturbation Theory for Cross-Domain Interference and Recovery in Multi-Domain RL
par: Yang, Lei, et autres
Publié: (2026)

Transformers Remember First, Forget Last: Dual-Process Interference in LLMs
par: Chattaraj, Sourav, et autres
Publié: (2026)

On the Paradoxical Interference between Instruction-Following and Task Solving
par: Qi, Yunjia, et autres
Publié: (2026)

Exploring Precision and Recall to assess the quality and diversity of LLMs
par: Bronnec, Florian Le, et autres
Publié: (2024)

More Is Not Always Better: Cross-Component Interference in LLM Agent Scaffolding
par: Liu, Ming
Publié: (2026)