The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Documenti analoghi

• FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
  di: Penedo, Guilherme, et al.
  Pubblicazione: (2025)
• How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
  di: Niklaus, Joel, et al.
  Pubblicazione: (2026)
• FineWeb-zhtw: Scalable Curation of Traditional Chinese Text Data from the Web
  di: Lin, Cheng-Wei, et al.
  Pubblicazione: (2024)
• SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
  di: Allal, Loubna Ben, et al.
  Pubblicazione: (2025)
• The Sustainability Gap in Robotics: A Large-Scale Survey of Sustainability Awareness in 50,000 Research Articles
  di: Skuric, Antun, et al.
  Pubblicazione: (2026)