Cover Image

Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Wenzhen, Pan, Wenbo, Xu, Xu, Qin, Libo, Yue, Li, Zhou, Ming
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Models
by: Zhang, Yongheng, et al.
Published: (2025)

Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities
by: Fujii, Kazuki, et al.
Published: (2024)

Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models
by: Xu, Zixiang, et al.
Published: (2025)

D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
by: Que, Haoran, et al.
Published: (2024)

Marco-LLM: Bridging Languages via Massive Multilingual Training for Cross-Lingual Enhancement
by: Ming, Lingfeng, et al.
Published: (2024)

Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment
by: Xhelili, Orgest, et al.
Published: (2024)

Breaking Language Barriers with MMTweets: Advancing Cross-Lingual Debunked Narrative Retrieval for Fact-Checking
by: Singh, Iknoor, et al.
Published: (2023)

Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies
by: Salhan, Suchir, et al.
Published: (2024)

Beyond English-Centric Training: How Reinforcement Learning Improves Cross-Lingual Reasoning in LLMs
by: Huang, Shulin, et al.
Published: (2025)

Language Anisotropic Cross-Lingual Model Editing
by: Xu, Yang, et al.
Published: (2022)

BadLingual: A Novel Lingual-Backdoor Attack against Large Language Models
by: Wang, Zihan, et al.
Published: (2025)

Analysis of Multi-Source Language Training in Cross-Lingual Transfer
by: Lim, Seong Hoon, et al.
Published: (2024)

GPTs and Language Barrier: A Cross-Lingual Legal QA Examination
by: Nguyen, Ha-Thanh, et al.
Published: (2024)

Breaking the Impasse: Dual-Scale Evolutionary Policy Training for Social Language Agents
by: Wang, Minzheng, et al.
Published: (2026)

Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations
by: Chen, Nuo, et al.
Published: (2023)

CCFQA: A Benchmark for Cross-Lingual and Cross-Modal Speech and Text Factuality Evaluation
by: Du, Yexing, et al.
Published: (2025)

CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention
by: Ye, Zekai, et al.
Published: (2025)

Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias
by: Wan, Zhongwei, et al.
Published: (2023)

Bridging Linguistic Gaps: Cross-Lingual Mapping in Pre-Training and Dataset for Enhanced Multilingual LLM Performance
by: Zheng, Weihua, et al.
Published: (2026)

Language Barriers: Evaluating Cross-Lingual Performance of CNN and Transformer Architectures for Speech Quality Estimation
by: Wardah, Wafaa, et al.
Published: (2025)

Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
by: Guo, Xu, et al.
Published: (2026)

1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators?
by: Huang, Yue, et al.
Published: (2024)

Cross-Lingual Knowledge Editing in Large Language Models
by: Wang, Jiaan, et al.
Published: (2023)

Language-Specific Latent Process Hinders Cross-Lingual Performance
by: Lim, Zheng Wei, et al.
Published: (2025)

PreAlign: Boosting Cross-Lingual Transfer by Early Establishment of Multilingual Alignment
by: Li, Jiahuan, et al.
Published: (2024)

Breaking mBad! Supervised Fine-tuning for Cross-Lingual Detoxification
by: Beniwal, Himanshu, et al.
Published: (2025)

Cross-Lingual Transfer for Natural Language Inference via Multilingual Prompt Translator
by: Qiu, Xiaoyu, et al.
Published: (2024)

Tokenization and Morphological Fidelity in Uralic NLP: A Cross-Lingual Evaluation
by: Xu, Nuo, et al.
Published: (2026)

CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning
by: Ye, Yangfan, et al.
Published: (2025)

LoopRPT: Reinforcement Pre-Training for Looped Language Models
by: Tang, Guo, et al.
Published: (2026)

Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer
by: Zheng, Jianyu, et al.
Published: (2024)

Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models
by: He, Kaiyu, et al.
Published: (2025)

A Two-Stage Framework with Self-Supervised Distillation For Cross-Domain Text Classification
by: Feng, Yunlong, et al.
Published: (2023)

Cross-Lingual Optimization for Language Transfer in Large Language Models
by: Lee, Jungseob, et al.
Published: (2025)

Pralekha: Cross-Lingual Document Alignment for Indic Languages
by: Suryanarayanan, Sanjay, et al.
Published: (2024)

The Impact of Language Adapters in Cross-Lingual Transfer for NLU
by: Kunz, Jenny, et al.
Published: (2024)

Evaluating Cross-Lingual Unlearning in Multilingual Language Models
by: Lizzo, Tyler, et al.
Published: (2026)

Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capability
by: Ri, Ryokan, et al.
Published: (2024)

Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-Training
by: Wang, Zhijun, et al.
Published: (2025)

Cross-modality Information Check for Detecting Jailbreaking in Multimodal Large Language Models
by: Xu, Yue, et al.
Published: (2024)