FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Penedo, Guilherme, Kydlíček, Hynek, Sabolčec, Vinko, Messmer, Bettina, Foroutan, Negar, Kargaran, Amir Hossein, Raffel, Colin, Jaggi, Martin, Von Werra, Leandro, Wolf, Thomas
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2506.20920