Cover Image

Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Linjuan, Wei, Haoran, Lin, Huan, Li, Tianhao, Yang, Baosong, Huang, Fei, Lu, Weiming
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Language as a Latent Variable for Reasoning Optimization
by: Wu, Linjuan, et al.
Published: (2026)

A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAM$Δ$ Integration into Upcycled MoE
by: Zhou, Hao, et al.
Published: (2026)

Towards Cross-lingual Values Judgment: A Consensus-Pluralism Perspective
by: Chen, Yukun, et al.
Published: (2026)

Multimodal LLM Enhanced Cross-lingual Cross-modal Retrieval
by: Wang, Yabing, et al.
Published: (2024)

Semantic Aware Linear Transfer by Recycling Pre-trained Language Models for Cross-lingual Transfer
by: Lee, Seungyoon, et al.
Published: (2025)

TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mind
by: Hou, Guiyang, et al.
Published: (2024)

Continual Pre-Training is (not) What You Need in Domain Adaption
by: Chen, Pin-Er, et al.
Published: (2025)

On the Cross-lingual Transferability of Pre-trained wav2vec2-based Models
by: Grosman, Jonatas, et al.
Published: (2025)

MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting
by: Li, Tianhao, et al.
Published: (2024)

Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignment
by: Miao, Zhongtao, et al.
Published: (2024)

Adaptive Cross-lingual Text Classification through In-Context One-Shot Demonstrations
by: Villa-Cueva, Emilio, et al.
Published: (2024)

Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision
by: Jiang, Fan, et al.
Published: (2024)

PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts
by: Wang, Yiming, et al.
Published: (2025)

Cross-lingual Alzheimer's Disease detection based on paralinguistic and pre-trained features
by: Chen, Xuchu, et al.
Published: (2023)

P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs
by: Zhang, Yidan, et al.
Published: (2024)

Qwen-Scope: Turning Sparse Features into Development Tools for Large Language Models
by: Deng, Boyi, et al.
Published: (2026)

Cross-layer Attention Sharing for Pre-trained Large Language Models
by: Mu, Yongyu, et al.
Published: (2024)

xCoT: Cross-lingual Instruction Tuning for Cross-lingual Chain-of-Thought Reasoning
by: Chai, Linzheng, et al.
Published: (2024)

Cross-lingual robustness of LLM-brain alignment and its computational roots
by: Yang, Ni, et al.
Published: (2026)

TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
by: Yan, Junbing, et al.
Published: (2024)

Enhancing One-shot Pruned Pre-trained Language Models through Sparse-Dense-Sparse Mechanism
by: Li, Guanchen, et al.
Published: (2024)

X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions
by: Li, Chong, et al.
Published: (2024)

Constrained Decoding for Cross-lingual Label Projection
by: Le, Duong Minh, et al.
Published: (2024)

Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks
by: Yamaguchi, Atsuki, et al.
Published: (2026)

Efficient Training for Cross-lingual Speech Language Models
by: Zhou, Yan, et al.
Published: (2026)

Rethinking the Chain-of-Thought: The Roles of In-Context Learning and Pre-trained Priors
by: Yang, Hao, et al.
Published: (2025)

Selected Languages are All You Need for Cross-lingual Truthfulness Transfer
by: Liu, Weihao, et al.
Published: (2024)

Thinking Augmented Pre-training
by: Wang, Liang, et al.
Published: (2025)

Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models
by: Blevins, Terra, et al.
Published: (2024)

Understanding and Mitigating Cross-lingual Privacy Leakage via Language-specific and Universal Privacy Neurons
by: Dong, Wenshuo, et al.
Published: (2025)

Comparing LLM prompting with Cross-lingual transfer performance on Indigenous and Low-resource Brazilian Languages
by: Adelani, David Ifeoluwa, et al.
Published: (2024)

Frustratingly Easy Label Projection for Cross-lingual Transfer
by: Chen, Yang, et al.
Published: (2022)

Cross-lingual Editing in Multilingual Language Models
by: Beniwal, Himanshu, et al.
Published: (2024)

Language Fusion for Parameter-Efficient Cross-lingual Transfer
by: Borchert, Philipp, et al.
Published: (2025)

A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Models
by: Hayat, Ahatsham, et al.
Published: (2024)

Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts
by: Wang, Teng, et al.
Published: (2024)

Multilingual Generative Retrieval via Cross-lingual Semantic Compression
by: Huang, Yuxin, et al.
Published: (2025)

XRAG: Cross-lingual Retrieval-Augmented Generation
by: Liu, Wei, et al.
Published: (2025)

Cross-lingual Contextualized Phrase Retrieval
by: Li, Huayang, et al.
Published: (2024)

SparseLLM: Towards Global Pruning for Pre-trained Language Models
by: Bai, Guangji, et al.
Published: (2024)