Cover Image

On Multilingual Encoder Language Model Compression for Low-Resource Languages

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gurgurov, Daniil, Gregor, Michal, van Genabith, Josef, Ostermann, Simon
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
by: Gurgurov, Daniil, et al.
Published: (2025)

Sparse Subnetwork Enhancement for Underrepresented Languages in Large Language Models
by: Gurgurov, Daniil, et al.
Published: (2025)

Multilingual Political Views of Large Language Models: Identification and Steering
by: Gurgurov, Daniil, et al.
Published: (2025)

Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters
by: Gurgurov, Daniil, et al.
Published: (2024)

The Latin Substrate: How Language Models Represent and Mediate Script Choice
by: Gurgurov, Daniil, et al.
Published: (2026)

GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge
by: Gurgurov, Daniil, et al.
Published: (2024)

Modular Arithmetic: Language Models Solve Math Digit by Digit
by: Baeumel, Tanja, et al.
Published: (2025)

Multilingual Steering by Design: Multilingual Sparse Autoencoders and Principled Layer Selection
by: Ghussin, Yusser Al, et al.
Published: (2026)

Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation
by: Gurgurov, Daniil, et al.
Published: (2025)

DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge
by: Ghussin, Yusser Al, et al.
Published: (2026)

ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performance
by: Gurgurov, Daniil, et al.
Published: (2026)

Probing Context Localization of Polysemous Words in Pre-trained Language Model Sub-Layers
by: Vijayakumar, Soniya, et al.
Published: (2024)

Multilingual Large Language Models and Curse of Multilinguality
by: Gurgurov, Daniil, et al.
Published: (2024)

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs
by: Baeumel, Tanja, et al.
Published: (2025)

Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
by: Baeumel, Tanja, et al.
Published: (2026)

CLaS-Bench: A Cross-Lingual Alignment and Steering Benchmark
by: Gurgurov, Daniil, et al.
Published: (2026)

Why Does Reinforcement Learning Generalize? A Feature-Level Mechanistic Study of Post-Training in Large Language Models
by: Shi, Dan, et al.
Published: (2026)

When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification
by: Shcharbakova, Hanna, et al.
Published: (2025)

Large Language Models for Multilingual Previously Fact-Checked Claim Detection
by: Vykopal, Ivan, et al.
Published: (2025)

Cross-Prompt Encoder for Low-Performing Languages
by: Mikaberidze, Beso, et al.
Published: (2025)

AutoPsyC: Automatic Recognition of Psychodynamic Conflicts from Semi-structured Interviews with Large Language Models
by: Hossain, Sayed Muddashir, et al.
Published: (2025)

SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervision
by: Hamidullah, Yasser, et al.
Published: (2025)

Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languages
by: Puranegedara, Imalsha, et al.
Published: (2025)

Sign Language Translation with Sentence Embedding Supervision
by: Hamidullah, Yasser, et al.
Published: (2025)

Image-to-LaTeX Converter for Mathematical Formulas and Text
by: Gurgurov, Daniil, et al.
Published: (2024)

Seeing, Signing, and Saying: A Vision-Language Model-Assisted Pipeline for Sign Language Data Acquisition and Curation from Social Media
by: Yazdani, Shakib, et al.
Published: (2025)

Spatio-temporal Sign Language Representation and Translation
by: Hamidullah, Yasser, et al.
Published: (2025)

The AI Language Proficiency Monitor -- Tracking the Progress of LLMs on Multilingual Benchmarks
by: Pomerenke, David, et al.
Published: (2025)

A Rigorous Evaluation of LLM Data Generation Strategies for Low-Resource Languages
by: Anikina, Tatiana, et al.
Published: (2025)

From Weights to Activations: Is Steering the Next Frontier of Adaptation?
by: Ostermann, Simon, et al.
Published: (2026)

PETra: A Multilingual Corpus of Pragmatic Explicitation in Translation
by: Osmelak, Doreen, et al.
Published: (2025)

A Critical Study of Automatic Evaluation in Sign Language Translation
by: Yazdani, Shakib, et al.
Published: (2025)

Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference Resolution
by: Anikina, Tatiana, et al.
Published: (2025)

When your Cousin has the Right Connections: Unsupervised Bilingual Lexicon Induction for Related Data-Imbalanced Languages
by: Bafna, Niyati, et al.
Published: (2023)

Soft Language Prompts for Language Transfer
by: Vykopal, Ivan, et al.
Published: (2024)

LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-Explanations
by: Wang, Qianli, et al.
Published: (2024)

Massively Multilingual Text Translation For Low-Resource Languages
by: Zhou, Zhong
Published: (2024)

Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages
by: Su, Zeli, et al.
Published: (2025)

Multilingual Models for Check-Worthy Social Media Posts Detection
by: Kula, Sebastian, et al.
Published: (2024)

Eka-Eval: An Evaluation Framework for Low-Resource Multilingual Large Language Models
by: Sinha, Samridhi Raj, et al.
Published: (2025)