Cover Image

Toward Cross-Lingual Quality Classifiers for Multilingual Pretraining Data Selection

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Turki, Yassine, Sabolčec, Vinko, Messmer, Bettina, Jaggi, Martin
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
by: Messmer, Bettina, et al.
Published: (2025)

Towards an empirical understanding of MoE design choices
by: Fan, Dongyang, et al.
Published: (2024)

URLs Help, Topics Guide: Understanding Metadata Utility in LLM Training
by: Fan, Dongyang, et al.
Published: (2025)

LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs
by: Guo, Pei-Fu, et al.
Published: (2025)

Cross-Lingual Activation Steering for Multilingual Language Models
by: Pokharel, Rhitabrat, et al.
Published: (2026)

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
by: Penedo, Guilherme, et al.
Published: (2025)

mOthello: When Do Cross-Lingual Representation Alignment and Cross-Lingual Transfer Emerge in Multilingual Models?
by: Hua, Tianze, et al.
Published: (2024)

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment
by: Yang, Wen, et al.
Published: (2025)

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining
by: Chen, Zhixun, et al.
Published: (2025)

MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
by: Kargaran, Amir Hossein, et al.
Published: (2024)

SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
by: Wang, Bin, et al.
Published: (2023)

Evaluating Cross-Lingual Classification Approaches Enabling Topic Discovery for Multilingual Social Media Data
by: Uniyal, Deepak, et al.
Published: (2026)

AdaMCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Multilingual Chain-of-Thought
by: Zheng, Weihua, et al.
Published: (2025)

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining
by: Fan, Dongyang, et al.
Published: (2025)

Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languages
by: Africa, David Demitri, et al.
Published: (2025)

Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models
by: Rajaee, Sara, et al.
Published: (2024)

Generative Query Expansion with Multilingual LLMs for Cross-Lingual Information Retrieval
by: Macmillan-Scott, Olivia, et al.
Published: (2025)

Bridging Linguistic Gaps: Cross-Lingual Mapping in Pre-Training and Dataset for Enhanced Multilingual LLM Performance
by: Zheng, Weihua, et al.
Published: (2026)

Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Models
by: Qi, Jirui, et al.
Published: (2023)

Bridging Language Gaps: Advances in Cross-Lingual Information Retrieval with Multilingual LLMs
by: Goworek, Roksana, et al.
Published: (2025)

Thank You, Stingray: Multilingual Large Language Models Can Not (Yet) Disambiguate Cross-Lingual Word Sense
by: Cahyawijaya, Samuel, et al.
Published: (2024)

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models
by: Ali, Mehdi, et al.
Published: (2025)

Multilingual Pretraining for Pixel Language Models
by: Kesen, Ilker, et al.
Published: (2025)

Exploring Polyglot Harmony: On Multilingual Data Allocation for Large Language Models Pretraining
by: Guo, Ping, et al.
Published: (2025)

Revisiting Multilingual Data Mixtures in Language Model Pretraining
by: Foroutan, Negar, et al.
Published: (2025)

Identifying the Correlation Between Language Distance and Cross-Lingual Transfer in a Multilingual Representation Space
by: Philippy, Fred, et al.
Published: (2023)

On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialists
by: Fan, Dongyang, et al.
Published: (2024)

Cross-Lingual Interleaving for Speech Language Models
by: Moumen, Adel, et al.
Published: (2025)

Cross-Lingual Multi-Hop Knowledge Editing
by: Khandelwal, Aditi, et al.
Published: (2024)

Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learning
by: Sankaran, Aditya Narayan, et al.
Published: (2024)

Zero-shot Cross-Lingual Transfer for Synthetic Data Generation in Grammatical Error Detection
by: Latouche, Gaetan Lopez, et al.
Published: (2024)

Semantic uncertainty in advanced decoding methods for LLM generation
by: Foodeei, Darius, et al.
Published: (2025)

CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment
by: Lin, Geyu, et al.
Published: (2024)

A Generative Adversarial Attack for Multilingual Text Classifiers
by: Roth, Tom, et al.
Published: (2024)

An In-Vitro Study on Cross-Lingual Generalization in Language Models
by: Cosma, Adrian
Published: (2026)

Cross-Lingual Jailbreak Detection via Semantic Codebooks
by: Alanova, Shirin, et al.
Published: (2026)

Cross-Lingual Knowledge Editing in Large Language Models
by: Wang, Jiaan, et al.
Published: (2023)

Steering into New Embedding Spaces: Analyzing Cross-Lingual Alignment Induced by Model Interventions in Multilingual Language Models
by: Sundar, Anirudh, et al.
Published: (2025)

Arctic-SnowCoder: Demystifying High-Quality Data in Code Pretraining
by: Wei, Yuxiang, et al.
Published: (2024)

CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention
by: Ye, Zekai, et al.
Published: (2025)