Organize the Web: Constructing Domains Enhances Pre-Training Data Curation

Documenti analoghi

• BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models
  di: Cao, Qingqing, et al.
  Pubblicazione: (2023)
• Learning to Detect Language Model Training Data via Active Reconstruction
  di: Yin, Junjie Oscar, et al.
  Pubblicazione: (2026)
• Olmix: A Framework for Data Mixing Throughout LM Development
  di: Chen, Mayee F., et al.
  Pubblicazione: (2026)
• QuRating: Selecting High-Quality Data for Training Language Models
  di: Wettig, Alexander, et al.
  Pubblicazione: (2024)
• How to Train Long-Context Language Models (Effectively)
  di: Gao, Tianyu, et al.
  Pubblicazione: (2024)