Image de couverture de livre

Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Su, Zeli, Zhang, Ziyin, Xu, Guixian, Liu, Jianing, Han, XU, Zhang, Ting, Dong, Yushuang
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CMHG: A Dataset and Benchmark for Headline Generation of Minority Languages in China
par: Xu, Guixian, et autres
Publié: (2025)

FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling
par: Xu, Guixian, et autres
Publié: (2026)

SHRP: Specialized Head Routing and Pruning for Efficient Encoder Compression
par: Su, Zeli, et autres
Publié: (2025)

Reinforcement Learning with Semantic Rewards Enables Low-Resource Language Expansion without Alignment Tax
par: Su, Zeli, et autres
Publié: (2026)

Source-Grounded Semantic Reinforcement Learning for Low-Resource Target-Language Generation
par: Su, Zeli, et autres
Publié: (2026)

On Multilingual Encoder Language Model Compression for Low-Resource Languages
par: Gurgurov, Daniil, et autres
Publié: (2025)

Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languages
par: Puranegedara, Imalsha, et autres
Publié: (2025)

Weighted Cross-entropy for Low-Resource Languages in Multilingual Speech Recognition
par: Piñeiro-Martín, Andrés, et autres
Publié: (2024)

Recasting Generic Pretrained Vision Transformers As Object-Centric Scene Encoders For Manipulation Policies
par: Qian, Jianing, et autres
Publié: (2024)

Toward Robust Multilingual Adaptation of LLMs for Low-Resource Languages
par: Li, Haolin, et autres
Publié: (2025)

"Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation
par: Thakur, Nandan, et autres
Publié: (2023)

Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
par: Somayajula, Sai Ashish, et autres
Publié: (2024)

Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study
par: Roy, Aniruddha, et autres
Publié: (2024)

Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Survey
par: Wang, Xinyu, et autres
Publié: (2024)

Pretrained Multilingual Transformers Reveal Quantitative Distance Between Human Languages
par: Zhao, Yue, et autres
Publié: (2026)

Renaissance: Investigating the Pretraining of Vision-Language Encoders
par: Fields, Clayton, et autres
Publié: (2024)

Do LLMs Know What Luxembourgish Borrows? Probing Lexical Neology in Low-Resource Multilingual Models
par: Hosseini-Kivanani, Nina
Publié: (2026)

NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis
par: Wang, Mingyang, et autres
Publié: (2023)

Multilingual Pretraining for Pixel Language Models
par: Kesen, Ilker, et autres
Publié: (2025)

Rethinking Multilingual Continual Pretraining: Data Mixing for Adapting LLMs Across Languages and Resources
par: Li, Zihao, et autres
Publié: (2025)

Conscious Gaze: Adaptive Attention Mechanisms for Hallucination Mitigation in Vision-Language Models
par: Bu, Weijue, et autres
Publié: (2025)

Adapting Where It Matters: Depth-Aware Adaptation for Efficient Multilingual Speech Recognition in Low-Resource Languages
par: Xiao, Yang, et autres
Publié: (2026)

The Role of Mixed-Language Documents for Multilingual Large Language Model Pretraining
par: Shao, Jiandong, et autres
Publié: (2026)

Massively Multilingual Text Translation For Low-Resource Languages
par: Zhou, Zhong
Publié: (2024)

Dynamic Risk‐Stratification Models for Bronchopulmonary Dysplasia in Extremely Preterm Very Low Birth Weight Infants
par: Ting Zhao, et autres
Publié: (2025)

Does Climate Finance Accelerate Progress Toward SDG 7? Evidence From Low‐and Middle‐Income Countries
par: Junyi Tian, et autres
Publié: (2026)

Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books
par: Zhang, Chen, et autres
Publié: (2025)

LLMs for Extremely Low-Resource Finno-Ugric Languages
par: Purason, Taido, et autres
Publié: (2024)

Know What You Know: Metacognitive Entropy Calibration for Verifiable RL Reasoning
par: Zhao, Qiannian, et autres
Publié: (2026)

Do You Know About My Nation? Investigating Multilingual Language Models' Cultural Literacy Through Factual Knowledge
par: Tanwar, Eshaan, et autres
Publié: (2025)

Factual Consistency of Multilingual Pretrained Language Models
par: Fierro, Constanza, et autres
Publié: (2022)

PhoenixCodec: Taming Neural Speech Coding for Extreme Low-Resource Scenarios
par: Wan, Zixiang, et autres
Publié: (2025)

ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World
par: Zhang, Ziyin, et autres
Publié: (2026)

MELA: Multilingual Evaluation of Linguistic Acceptability
par: Zhang, Ziyin, et autres
Publié: (2023)

Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages
par: Alam, Firoj, et autres
Publié: (2026)

Multilingual Transfer and Domain Adaptation for Low-Resource Languages of Spain
par: Luo, Yuanchang, et autres
Publié: (2024)

Multilingual MFA: Forced Alignment on Low-Resource Related Languages
par: Tosolini, Alessio, et autres
Publié: (2025)

Exploring Polyglot Harmony: On Multilingual Data Allocation for Large Language Models Pretraining
par: Guo, Ping, et autres
Publié: (2025)

Locating a shortest vector in certain $2$-dimensional lattices
par: Zou, Guixian
Publié: (2026)

EuroBERT: Scaling Multilingual Encoders for European Languages
par: Boizard, Nicolas, et autres
Publié: (2025)