Cover Image

Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Schmidt, Fabian David, Borchert, Philipp, Vulić, Ivan, Glavaš, Goran
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU
by: Razumovskaia, Evgeniia, et al.
Published: (2023)

ReCoVeR the Target Language: Language Steering without Sacrificing Task Performance
by: Sterz, Hannah, et al.
Published: (2025)

Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
by: Schmidt, Fabian David, et al.
Published: (2025)

To Translate or Not to Translate: A Systematic Investigation of Translation-Based Cross-Lingual Transfer to Low-Resource Languages
by: Ebing, Benedikt, et al.
Published: (2023)

The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks
by: Ebing, Benedikt, et al.
Published: (2025)

Language Fusion for Parameter-Efficient Cross-lingual Transfer
by: Borchert, Philipp, et al.
Published: (2025)

Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignment
by: Huang, Yongxin, et al.
Published: (2024)

MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching
by: Schmidt, Fabian David, et al.
Published: (2025)

Analyzing and Adapting Large Language Models for Few-Shot Multilingual NLU: Are We There Yet?
by: Razumovskaia, Evgeniia, et al.
Published: (2024)

Large Language Models are Miscalibrated In-Context Learners
by: Li, Chengzu, et al.
Published: (2023)

ANHALTEN: Cross-Lingual Transfer for German Token-Level Reference-Free Hallucination Detection
by: Herrlein, Janek, et al.
Published: (2024)

The Impact of Language Adapters in Cross-Lingual Transfer for NLU
by: Kunz, Jenny, et al.
Published: (2024)

Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget
by: Bui, Minh Duc, et al.
Published: (2024)

News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation
by: Iana, Andreea, et al.
Published: (2024)

One Script Instead of Hundreds? On Pretraining Romanized Encoder Language Models
by: Ebing, Benedikt, et al.
Published: (2026)

IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators
by: Paul, Indraneil, et al.
Published: (2024)

Evaluating the Ability of LLMs to Solve Semantics-Aware Process Mining Tasks
by: Rebmann, Adrian, et al.
Published: (2024)

Universal Cross-Tokenizer Distillation via Approximate Likelihood Matching
by: Minixhofer, Benjamin, et al.
Published: (2025)

Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models?
by: Geigle, Gregor, et al.
Published: (2024)

African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classification
by: Geigle, Gregor, et al.
Published: (2024)

UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models
by: Dong, Yijiang River, et al.
Published: (2024)

Supervised In-Context Fine-Tuning for Generative Sequence Labeling
by: Dukić, David, et al.
Published: (2025)

Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language Representations
by: Geigle, Gregor, et al.
Published: (2023)

xMEN: A Modular Toolkit for Cross-Lingual Medical Entity Normalization
by: Borchert, Florian, et al.
Published: (2023)

SpeechTaxi: On Multilingual Semantic Speech Classification
by: Keller, Lennart, et al.
Published: (2024)

Quantifying Language Disparities in Multilingual Large Language Models
by: Hu, Songbo, et al.
Published: (2025)

Geographic Adaptation of Pretrained Language Models
by: Hofmann, Valentin, et al.
Published: (2022)

TransAlign: Machine Translation Encoders are Strong Word Aligners, Too
by: Ebing, Benedikt, et al.
Published: (2025)

On Generalization across Measurement Systems: LLMs Entail More Test-Time Compute for Underrepresented Cultures
by: Bui, Minh Duc, et al.
Published: (2025)

Retrofitting Large Language Models with Dynamic Tokenization
by: Feher, Darius, et al.
Published: (2024)

How Much Do LLMs Hallucinate across Languages? On Realistic Multilingual Estimation of LLM Hallucination
by: Islam, Saad Obaid ul, et al.
Published: (2025)

Leveraging Open Information Extraction for More Robust Domain Transfer of Event Trigger Detection
by: Dukić, David, et al.
Published: (2023)

Specialising and Analysing Instruction-Tuned and Byte-Level Language Models for Organic Reaction Prediction
by: Pang, Jiayun, et al.
Published: (2024)

Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages
by: Gupta, Shivanshu, et al.
Published: (2023)

Compositional Steering of Large Language Models with Steering Tokens
by: Radevski, Gorjan, et al.
Published: (2026)

Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models
by: Xu, Zixiang, et al.
Published: (2025)

Language Anisotropic Cross-Lingual Model Editing
by: Xu, Yang, et al.
Published: (2022)

Native Design Bias: Studying the Impact of English Nativeness on Language Model Performance
by: Reusens, Manon, et al.
Published: (2024)

Polyglot Teachers: Evaluating Language Models for Multilingual Synthetic Data Generation
by: Miranda, Lester James V., et al.
Published: (2026)

CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering
by: Wang, Yumeng, et al.
Published: (2025)