Data Mixing for Large Language Models Pretraining: A Survey and Outlook

Documenti analoghi

• An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation
  di: Supryadi, et al.
  Pubblicazione: (2024)
• BiMix: A Bivariate Data Mixing Law for Language Model Pretraining
  di: Ge, Ce, et al.
  Pubblicazione: (2024)
• Multilingual Large Language Models: A Systematic Survey
  di: Zhu, Shaolin, et al.
  Pubblicazione: (2024)
• A Component-Based Survey of Interactions between Large Language Models and Multi-Armed Bandits
  di: Chen, Siguang, et al.
  Pubblicazione: (2026)
• Detecting Pretraining Data from Large Language Models
  di: Shi, Weijia, et al.
  Pubblicazione: (2023)