Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretraining

Documenti analoghi

• Scaling, Simplification, and Adaptation: Lessons from Pretraining on Machine-Translated Text
  di: Velasco, Dan John, et al.
  Pubblicazione: (2025)
• Rethinking the Role of Text Complexity in Language Model Pretraining
  di: Velasco, Dan John, et al.
  Pubblicazione: (2025)
• Beyond Random Sampling: Efficient Language Model Pretraining via Curriculum Learning
  di: Zhang, Yang, et al.
  Pubblicazione: (2025)
• Edit-Constrained Decoding for Sentence Simplification
  di: Zetsu, Tatsuya, et al.
  Pubblicazione: (2024)
• Large Language Models for Biomedical Text Simplification: Promising But Not There Yet
  di: Li, Zihao, et al.
  Pubblicazione: (2024)