Scaling, Simplification, and Adaptation: Lessons from Pretraining on Machine-Translated Text

Documenti analoghi

• Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretraining
  di: Roque, Matthew Theodore, et al.
  Pubblicazione: (2025)
• Rethinking the Role of Text Complexity in Language Model Pretraining
  di: Velasco, Dan John, et al.
  Pubblicazione: (2025)
• Large Language Models for Biomedical Text Simplification: Promising But Not There Yet
  di: Li, Zihao, et al.
  Pubblicazione: (2024)
• Difficulty Estimation and Simplification of French Text Using LLMs
  di: Jamet, Henri, et al.
  Pubblicazione: (2024)
• Emergent Communication Pretraining for Few-Shot Machine Translation
  di: Li, Yaoyiran, et al.
  Pubblicazione: (2020)