Cover Image

Sparse Subnetwork Enhancement for Underrepresented Languages in Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gurgurov, Daniil, Baeumel, Tanja, van Genabith, Josef, Ostermann, Simon
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Modular Arithmetic: Language Models Solve Math Digit by Digit
by: Baeumel, Tanja, et al.
Published: (2025)

Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation
by: Gurgurov, Daniil, et al.
Published: (2025)

Multilingual Steering by Design: Multilingual Sparse Autoencoders and Principled Layer Selection
by: Ghussin, Yusser Al, et al.
Published: (2026)

On Multilingual Encoder Language Model Compression for Low-Resource Languages
by: Gurgurov, Daniil, et al.
Published: (2025)

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
by: Gurgurov, Daniil, et al.
Published: (2025)

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs
by: Baeumel, Tanja, et al.
Published: (2025)

Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
by: Baeumel, Tanja, et al.
Published: (2026)

The Latin Substrate: How Language Models Represent and Mediate Script Choice
by: Gurgurov, Daniil, et al.
Published: (2026)

Multilingual Political Views of Large Language Models: Identification and Steering
by: Gurgurov, Daniil, et al.
Published: (2025)

CLaS-Bench: A Cross-Lingual Alignment and Steering Benchmark
by: Gurgurov, Daniil, et al.
Published: (2026)

ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performance
by: Gurgurov, Daniil, et al.
Published: (2026)

Probing Context Localization of Polysemous Words in Pre-trained Language Model Sub-Layers
by: Vijayakumar, Soniya, et al.
Published: (2024)

GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge
by: Gurgurov, Daniil, et al.
Published: (2024)

Multilingual Large Language Models and Curse of Multilinguality
by: Gurgurov, Daniil, et al.
Published: (2024)

DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge
by: Ghussin, Yusser Al, et al.
Published: (2026)

Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters
by: Gurgurov, Daniil, et al.
Published: (2024)

From Weights to Activations: Is Steering the Next Frontier of Adaptation?
by: Ostermann, Simon, et al.
Published: (2026)

Why Does Reinforcement Learning Generalize? A Feature-Level Mechanistic Study of Post-Training in Large Language Models
by: Shi, Dan, et al.
Published: (2026)

AutoPsyC: Automatic Recognition of Psychodynamic Conflicts from Semi-structured Interviews with Large Language Models
by: Hossain, Sayed Muddashir, et al.
Published: (2025)

What Language(s) Does Aya-23 Think In? How Multilinguality Affects Internal Language Representations
by: Trinley, Katharina, et al.
Published: (2025)

Sign Language Translation with Sentence Embedding Supervision
by: Hamidullah, Yasser, et al.
Published: (2025)

When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification
by: Shcharbakova, Hanna, et al.
Published: (2025)

Image-to-LaTeX Converter for Mathematical Formulas and Text
by: Gurgurov, Daniil, et al.
Published: (2024)

Seeing, Signing, and Saying: A Vision-Language Model-Assisted Pipeline for Sign Language Data Acquisition and Curation from Social Media
by: Yazdani, Shakib, et al.
Published: (2025)

Spatio-temporal Sign Language Representation and Translation
by: Hamidullah, Yasser, et al.
Published: (2025)

Evolving Subnetwork Training for Large Language Models
by: Li, Hanqi, et al.
Published: (2024)

SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervision
by: Hamidullah, Yasser, et al.
Published: (2025)

LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-Explanations
by: Wang, Qianli, et al.
Published: (2024)

LLM for Everyone: Representing the Underrepresented in Large Language Models
by: Cahyawijaya, Samuel
Published: (2024)

A Critical Study of Automatic Evaluation in Sign Language Translation
by: Yazdani, Shakib, et al.
Published: (2025)

Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference Resolution
by: Anikina, Tatiana, et al.
Published: (2025)

Generative Large Language Models in Automated Fact-Checking: A Survey
by: Vykopal, Ivan, et al.
Published: (2024)

TULIP: Adapting Open-Source Large Language Models for Underrepresented Languages and Specialized Financial Tasks
by: Demirtaş, İrem, et al.
Published: (2025)

When your Cousin has the Right Connections: Unsupervised Bilingual Lexicon Induction for Related Data-Imbalanced Languages
by: Bafna, Niyati, et al.
Published: (2023)

Soft Language Prompts for Language Transfer
by: Vykopal, Ivan, et al.
Published: (2024)

Bigram Subnetworks: Mapping to Next Tokens in Transformer Language Models
by: Chang, Tyler A., et al.
Published: (2025)

Your Language Model Secretly Contains Personality Subnetworks
by: Ye, Ruimeng, et al.
Published: (2026)

Large Language Models for Multilingual Previously Fact-Checked Claim Detection
by: Vykopal, Ivan, et al.
Published: (2025)

When Flores Bloomz Wrong: Cross-Direction Contamination in Machine Translation Evaluation
by: Tan, David, et al.
Published: (2026)

Measuring Spurious Correlation in Classification: 'Clever Hans' in Translationese
by: Borah, Angana, et al.
Published: (2023)