Image de couverture de livre

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Zihao, Ji, Shaoxiong, Mickus, Timothee, Segonne, Vincent, Tiedemann, Jörg
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning?
par: Ji, Shaoxiong, et autres
Publié: (2024)

Rethinking Multilingual Continual Pretraining: Data Mixing for Adapting LLMs Across Languages and Resources
par: Li, Zihao, et autres
Publié: (2025)

Massively Multilingual Adaptation of Large Language Models Using Bilingual Translation Data
par: Ji, Shaoxiong, et autres
Publié: (2025)

Test-Time Scaling of Reasoning Models for Machine Translation
par: Li, Zihao, et autres
Publié: (2025)

MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki
par: Mickus, Timothee, et autres
Publié: (2024)

SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes
par: Mickus, Timothee, et autres
Publié: (2024)

Model-Based Quality Assessment for Massively Multilingual Parallel Data
par: Ibrahim, Abdelaziz M. A., et autres
Publié: (2026)

KD4MT: A Survey of Knowledge Distillation for Machine Translation
par: de Gibert, Ona, et autres
Publié: (2026)

Life Cycle-Aware Evaluation of Knowledge Distillation for Machine Translation: Environmental Impact and Translation Quality Trade-offs
par: Attieh, Joseph, et autres
Publié: (2026)

SemEval-2025 Task 3: Mu-SHROOM, the Multilingual Shared Task on Hallucinations and Related Observable Overgeneration Mistakes
par: Vázquez, Raúl, et autres
Publié: (2025)

Adapting Definition Modeling for New Languages: A Case Study on Belarusian
par: Kazakouskaya, Daniela, et autres
Publié: (2025)

I Have an Attention Bridge to Sell You: Generalization Capabilities of Modular Translation Architectures
par: Mickus, Timothee, et autres
Publié: (2024)

EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models
par: Ji, Shaoxiong, et autres
Publié: (2024)

Your Model is Overconfident, and Other Lies We Tell Ourselves
par: Mickus, Timothee, et autres
Publié: (2025)

AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling
par: Fedorova, Mariia, et autres
Publié: (2024)

MaLA-500: Massive Language Adaptation of Large Language Models
par: Lin, Peiqin, et autres
Publié: (2024)

The Impact of Vocabulary Overlaps on Knowledge Transfer in Multilingual Machine Translation
par: Itkonen, Oona, et autres
Publié: (2026)

How Many Languages Make Good Multilingual Instruction Tuning? A Case Study on BLOOM
par: Ji, Shaoxiong, et autres
Publié: (2024)

GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models
par: Luo, Hengyu, et autres
Publié: (2025)

Pre-trained Language Models Learn Remarkably Accurate Representations of Numbers
par: Kadlčík, Marek, et autres
Publié: (2025)

Isotropy, Clusters, and Classifiers
par: Mickus, Timothee, et autres
Publié: (2024)

Domain-specific or Uncertainty-aware models: Does it really make a difference for biomedical text classification?
par: Sinha, Aman, et autres
Publié: (2024)

DocHPLT: A Massively Multilingual Document-Level Translation Dataset
par: O'Brien, Dayyán, et autres
Publié: (2025)

A New Massive Multilingual Dataset for High-Performance Language Technologies
par: de Gibert, Ona, et autres
Publié: (2024)

Copy First, Translate Later: Interpreting Translation Dynamics in Multilingual Pretraining
par: Körner, Felicia, et autres
Publié: (2026)

How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?
par: Liu, Danni, et autres
Publié: (2023)

Multilingual Pretraining for Pixel Language Models
par: Kesen, Ilker, et autres
Publié: (2025)

Factual Consistency of Multilingual Pretrained Language Models
par: Fierro, Constanza, et autres
Publié: (2022)

The Role of Mixed-Language Documents for Multilingual Large Language Model Pretraining
par: Shao, Jiandong, et autres
Publié: (2026)

Multilingual Language Model Pretraining using Machine-translated Data
par: Wang, Jiayi, et autres
Publié: (2025)

Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Language
par: Wang, Jiayi, et autres
Publié: (2024)

Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints
par: Song, Ran, et autres
Publié: (2024)

Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructions
par: Li, Jiahuan, et autres
Publié: (2023)

LangSAMP: Language-Script Aware Multilingual Pretraining
par: Liu, Yihong, et autres
Publié: (2024)

MITRA: A Large-Scale Parallel Corpus and Multilingual Pretrained Language Model for Machine Translation and Semantic Retrieval for Pāli, Sanskrit, Buddhist Chinese, and Tibetan
par: Nehrdich, Sebastian, et autres
Publié: (2026)

Revisiting Multilingual Data Mixtures in Language Model Pretraining
par: Foroutan, Negar, et autres
Publié: (2025)

Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis
par: Zhu, Wenhao, et autres
Publié: (2023)

Can Out-of-Distribution Evaluations Uncover Reliance on Shortcuts? A Case Study in Question Answering
par: Štefánik, Michal, et autres
Publié: (2025)

The Translation Barrier Hypothesis: Multilingual Generation with Large Language Models Suffers from Implicit Translation Failure
par: Bafna, Niyati, et autres
Publié: (2025)

Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca
par: Chen, Pinzhen, et autres
Publié: (2023)