Cover Image

Scaling, Simplification, and Adaptation: Lessons from Pretraining on Machine-Translated Text

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Velasco, Dan John, Roque, Matthew Theodore
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretraining
by: Roque, Matthew Theodore, et al.
Published: (2025)

Rethinking the Role of Text Complexity in Language Model Pretraining
by: Velasco, Dan John, et al.
Published: (2025)

Large Language Models for Biomedical Text Simplification: Promising But Not There Yet
by: Li, Zihao, et al.
Published: (2024)

Difficulty Estimation and Simplification of French Text Using LLMs
by: Jamet, Henri, et al.
Published: (2024)

Emergent Communication Pretraining for Few-Shot Machine Translation
by: Li, Yaoyiran, et al.
Published: (2020)

Predicting Anchored Text from Translation Memories for Machine Translation Using Deep Learning Methods
by: Yue, Richard, et al.
Published: (2024)

Automated Feedback Loops to Protect Text Simplification with Generative AI from Information Loss
by: Nandiraju, Abhay Kumara Sri Krishna, et al.
Published: (2025)

Many-to-English Machine Translation Tools, Data, and Pretrained Models
by: Gowda, Thamme, et al.
Published: (2021)

Text Style Transfer with Machine Translation for Graphic Designs
by: Budhauria, Deergh Singh, et al.
Published: (2026)

MuTSE: A Human-in-the-Loop Multi-use Text Simplification Evaluator
by: Roscan, Rares-Alexandru, et al.
Published: (2026)

MultiLS: A Multi-task Lexical Simplification Framework
by: North, Kai, et al.
Published: (2024)

Text and Audio Simplification: Human vs. ChatGPT
by: Leroy, Gondy, et al.
Published: (2024)

MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretraining
by: Dong, Haoyu, et al.
Published: (2025)

SimplifyMyText: An LLM-Based System for Inclusive Plain Language Text Simplification
by: Färber, Michael, et al.
Published: (2025)

Attention Mechanism and Context Modeling System for Text Mining Machine Translation
by: Zhang, Yuwei, et al.
Published: (2024)

On the Generalization and Adaptation Ability of Machine-Generated Text Detectors in Academic Writing
by: Liu, Yule, et al.
Published: (2024)

Efficient Continual Learning in Neural Machine Translation: A Low-Rank Adaptation Approach
by: Carrión, Salvador, et al.
Published: (2025)

Evaluating the Effectiveness of Direct Preference Optimization for Personalizing German Automatic Text Simplifications for Persons with Intellectual Disabilities
by: Gao, Yingqiang, et al.
Published: (2025)

Scaling Laws of Decoder-Only Models on the Multilingual Machine Translation Task
by: Caillaut, Gaëtan, et al.
Published: (2024)

How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?
by: Liu, Danni, et al.
Published: (2023)

Edit-Constrained Decoding for Sentence Simplification
by: Zetsu, Tatsuya, et al.
Published: (2024)

Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safety
by: Chopra, Muskaan, et al.
Published: (2026)

Enhancing Document-Level Machine Translation via Filtered Synthetic Corpora and Two-Stage LLM Adaptation
by: Kim, Ireh, et al.
Published: (2026)

IKnow: Instruction-Knowledge-Aware Continual Pretraining for Effective Domain Adaptation
by: Zhang, Tianyi, et al.
Published: (2025)

MT$^{3}$: Scaling MLLM-based Text Image Machine Translation via Multi-Task Reinforcement Learning
by: Feng, Zhaopeng, et al.
Published: (2025)

On Translating Technical Terminology: A Translation Workflow for Machine-Translated Acronyms
by: Yue, Richard, et al.
Published: (2024)

Emergent Abilities of Large Language Models under Continued Pretraining for Language Adaptation
by: Elhady, Ahmed, et al.
Published: (2025)

MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark
by: Macko, Dominik, et al.
Published: (2023)

Sociotechnical Effects of Machine Translation
by: Moorkens, Joss, et al.
Published: (2025)

Adaptation of Biomedical and Clinical Pretrained Models to French Long Documents: A Comparative Study
by: Bazoge, Adrien, et al.
Published: (2024)

The Role of Handling Attributive Nouns in Improving Chinese-To-English Machine Translation
by: Wang, Lisa, et al.
Published: (2024)

Neural Machine Translation of Clinical Text: An Empirical Investigation into Multilingual Pre-Trained Language Models and Transfer-Learning
by: Han, Lifeng, et al.
Published: (2023)

APIO: Automatic Prompt Induction and Optimization for Grammatical Error Correction and Text Simplification
by: Chernodub, Artem, et al.
Published: (2025)

Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learning
by: Rahman, Md Mushfiqur, et al.
Published: (2024)

Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation
by: Kocyigit, Muhammed Yusuf, et al.
Published: (2025)

Aligning Sentence Simplification with ESL Learner's Proficiency for Language Acquisition
by: Li, Guanlin, et al.
Published: (2025)

ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification
by: North, Kai, et al.
Published: (2022)

Transformer-Encoder Trees for Efficient Multilingual Machine Translation and Speech Translation
by: Guan, Yiwen, et al.
Published: (2025)

Harnessing the Intrinsic Knowledge of Pretrained Language Models for Challenging Text Classification Settings
by: Gao, Lingyu
Published: (2024)

Translation of Multifaceted Data without Re-Training of Machine Translation Systems
by: Moon, Hyeonseok, et al.
Published: (2024)