Cover Image

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Zhixun, Guo, Ping, Han, Wenhan, Zhang, Yifan, Liu, Binbin, Lin, Haobin, Liu, Fengze, Zhao, Yan, Zhang, Bingni, Wang, Taifeng, Zheng, Yin, Cohn, Trevor, Fang, Meng
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MuBench: Assessment of Multilingual Capabilities of Large Language Models Across 61 Languages
by: Han, Wenhan, et al.
Published: (2025)

Exploring Polyglot Harmony: On Multilingual Data Allocation for Large Language Models Pretraining
by: Guo, Ping, et al.
Published: (2025)

QuaDMix: Quality-Diversity Balanced Data Selection for Efficient LLM Pretraining
by: Liu, Fengze, et al.
Published: (2025)

InfoLaw: Information Scaling Laws for Large Language Models with Quality-Weighted Mixture Data and Repetition
by: Liu, Fengze, et al.
Published: (2026)

Target-Oriented Pretraining Data Selection via Neuron-Activated Graph
by: Wang, Zijun, et al.
Published: (2026)

TiKMiX: Take Data Influence into Dynamic Mixture for Language Model Pre-training
by: Wang, Yifan, et al.
Published: (2025)

LoraxBench: A Multitask, Multilingual Benchmark Suite for 20 Indonesian Languages
by: Aji, Alham Fikri, et al.
Published: (2025)

MoORE: SVD-based Model MoE-ization for Conflict- and Oblivion-Resistant Multi-Task Adaptation
by: Yuan, Shen, et al.
Published: (2025)

MuPT: A Generative Symbolic Music Pretrained Transformer
by: Qu, Xingwei, et al.
Published: (2024)

Few-Shot Multilingual Open-Domain QA from 5 Examples
by: Jiang, Fan, et al.
Published: (2025)

Quasi-Large Hole Polarons in BiVO4-Implications for Photocatalysis and Solar Energy Conversion
by: Hao, Zhimeng, et al.
Published: (2025)

Multi-EuP: The Multilingual European Parliament Dataset for Analysis of Bias in Information Retrieval
by: Yang, Jinrui, et al.
Published: (2023)

Toward Cross-Lingual Quality Classifiers for Multilingual Pretraining Data Selection
by: Turki, Yassine, et al.
Published: (2026)

Mufu: Multilingual Fused Learning for Low-Resource Translation with LLM
by: Lim, Zheng Wei, et al.
Published: (2024)

YEZE at SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization via Heterogeneous Ensembling
by: Guo, Fengze, et al.
Published: (2026)

Backdoor Attack on Multilingual Machine Translation
by: Wang, Jun, et al.
Published: (2024)

Large Reasoning Models Struggle to Transfer Parametric Knowledge Across Scripts
by: Bandarkar, Lucas, et al.
Published: (2026)

MuDiT & MuSiT: Alignment with Colloquial Expression in Description-to-Song Generation
by: Wang, Zihao, et al.
Published: (2024)

Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision
by: Jiang, Fan, et al.
Published: (2024)

Contrastive Heliophysical Image Pretraining for Solar Dynamics Observatory Records
by: Shen, Shiyu, et al.
Published: (2025)

SEA-Guard: Culturally Grounded Multilingual Safeguard for Southeast Asia
by: Tasawong, Panuthep, et al.
Published: (2026)

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task
by: Liu, Wenhan, et al.
Published: (2024)

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models
by: Ali, Mehdi, et al.
Published: (2025)

The Role of Mixed-Language Documents for Multilingual Large Language Model Pretraining
by: Shao, Jiandong, et al.
Published: (2026)

Dual‐Anion Entropy Engineering of Se–P High‐Entropy Interfaces in HEAs for Optimized H * Binding and Accelerated Hydrogen Evolution
by: Asif Mahmood, et al.
Published: (2026)

Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
by: Messmer, Bettina, et al.
Published: (2025)

MuLan: Adapting Multilingual Diffusion Models for Hundreds of Languages with Negligible Cost
by: Xing, Sen, et al.
Published: (2024)

Agent Assurance in Regulated Financial Services
by: Zhong, Fengze
Published: (2026)

Agent Assurance in Regulated Financial Services
by: Zhong, Fengze
Published: (2026)

Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Models
by: Shen, Xuelin, et al.
Published: (2025)

All-in-One: Heterogeneous Interaction Modeling for Cold-Start Rating Prediction
by: Fang, Shuheng, et al.
Published: (2024)

Cross-modal Information Flow in Multimodal Large Language Models
by: Zhang, Zhi, et al.
Published: (2024)

How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?
by: Liu, Danni, et al.
Published: (2023)

An Empirical Study on Influence-Based Pretraining Data Selection for Code Large Language Models
by: Xing, Chengli, et al.
Published: (2026)

Static Semantics Reconstruction for Enhancing JavaScript-WebAssembly Multilingual Malware Detection
by: Xia, Yifan, et al.
Published: (2023)

MuMu-LLaMA: Multi-modal Music Understanding and Generation via Large Language Models
by: Liu, Shansong, et al.
Published: (2024)

MuCPT: Music-related Natural Language Model Continued Pretraining
by: Tian, Kai, et al.
Published: (2025)

MuToN Quantifies Binding Affinity Changes upon Protein Mutations by Geometric Deep Learning
by: Pengpai Li, et al.
Published: (2024)

LangSAMP: Language-Script Aware Multilingual Pretraining
by: Liu, Yihong, et al.
Published: (2024)

Tracing Multilingual Factual Knowledge Acquisition in Pretraining
by: Liu, Yihong, et al.
Published: (2025)