Imagen de Portada

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kandpal, Nikhil, Lester, Brian, Raffel, Colin, Majstorovic, Sebastian, Biderman, Stella, Abbasi, Baber, Soldaini, Luca, Shippole, Enrico, Cooper, A. Feder, Skowron, Aviya, Kirchenbauer, John, Longpre, Shayne, Sutawika, Lintang, Albalak, Alon, Xu, Zhenlin, Penedo, Guilherme, Allal, Loubna Ben, Bakouch, Elie, Pressman, John David, Fan, Honglu, Stander, Dashiell, Song, Guangyu, Gokaslan, Aaron, Goldstein, Tom, Bartoldson, Brian R., Kailkhura, Bhavya, Murray, Tyler
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Grokking Group Multiplication with Cosets
por: Stander, Dashiell, et al.
Publicado: (2023)

Double Visual Defense: Adversarial Pre-training and Instruction Tuning for Improving Vision-Language Model Robustness
por: Wang, Zeyu, et al.
Publicado: (2025)

Position: The Most Expensive Part of an LLM should be its Training Data
por: Kandpal, Nikhil, et al.
Publicado: (2025)

Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studies
por: Bartoldson, Brian R., et al.
Publicado: (2024)

Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoning
por: Sutawika, Lintang, et al.
Publicado: (2026)

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
por: Hägele, Alexander, et al.
Publicado: (2024)

Multi-Token Prediction via Self-Distillation
por: Kirchenbauer, John, et al.
Publicado: (2026)

Get RICH or Die Scaling: Profitably Trading Inference Compute for Robustness
por: McDonald, Tavish, et al.
Publicado: (2025)

Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
por: Geiping, Jonas, et al.
Publicado: (2025)

YaRN: Efficient Context Window Extension of Large Language Models
por: Peng, Bowen, et al.
Publicado: (2023)

AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attribution
por: Liu, Fengyuan, et al.
Publicado: (2024)

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence
por: McLeish, Sean, et al.
Publicado: (2025)

Transformers Can Do Arithmetic with the Right Embeddings
por: McLeish, Sean, et al.
Publicado: (2024)

Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rollouts
por: Zheng, Haizhong, et al.
Publicado: (2025)

Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
por: Christopher, Jacob K, et al.
Publicado: (2024)

ELFS: Label-Free Coreset Selection with Proxy Training Dynamics
por: Zheng, Haizhong, et al.
Publicado: (2024)

AegisLLM: Scaling Agentic Systems for Self-Reflective Defense in LLM Security
por: Cai, Zikui, et al.
Publicado: (2025)

Enhancing Training Data Attribution with Representational Optimization
por: Sun, Weiwei, et al.
Publicado: (2025)

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
por: Penedo, Guilherme, et al.
Publicado: (2024)

The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
por: Longpre, Shayne, et al.
Publicado: (2024)

Self-Directed Synthetic Dialogues and Revisions Technical Report
por: Lambert, Nathan, et al.
Publicado: (2024)

Scaling Self-Supervised Representation Learning for Symbolic Piano Performance
por: Bradshaw, Louis, et al.
Publicado: (2025)

STAR-1: Safer Alignment of Reasoning LLMs with 1K Data
por: Wang, Zijun, et al.
Publicado: (2025)

How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
por: Niklaus, Joel, et al.
Publicado: (2026)

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
por: Allal, Loubna Ben, et al.
Publicado: (2025)

The German‐Soviet War: Combat, Occupation, and Legacies by JeffRutherford and RobertvonMaier, eds. Ithaca: Cornell University Press, 2025. 600 pp. $59.95. ISBN 978‐1‐5017‐8108‐7
por: Vojin Majstorovic
Publicado: (2026)

Literature of the americas in the making: U.S. writers and translation in sur, 1931-1944
por: Gorica Majstorovic
Publicado: (2013)

EL YESO DE ZANCOLLI EN EL TRATAMIENTO DE LAS LESIONES TRAUMATICAS DE LA MANO EN NIÑOS
por: Dashiell Cañizares Betancourt
Publicado: (2006)

Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training
por: Bartoldson, Brian, et al.
Publicado: (2025)

Ingeniería del software : un enfoque pr ctico / Roger S. Pressman ; traductor Jesús Elmer Murrieta Murrieta, Eloy Pineda Rojas, Víctor Campos Olguín
por: Pressman, Roger S
Publicado: (2005)

Ingeniería del software : un enfoque pr ctico / Roger S. Pressman ; traductor, Víctor Campos Olguín, Javíer Enríquez Brito
por: Pressman, Roger S
Publicado: (2010)

Israeli Unilateralism and Israeli—Palestinian Relations, 2001-2006 / Jeremy Pressman
por: Pressman, Jeremy
Publicado: (2001)

Ingeniería del software : un enfoque pr ctico / Roger S. Pressman ; traductor José María Troya, Luis Hern ndez Yañez
por: Pressman, Roger S
Publicado: (1988)

Software engineering; a practitioner's approach / Roger S. Pressman
por: Pressman, Roger S
Publicado: (1982)

Israeli Unilateralism and Israeli-Palestina Relations, 2001-2006
por: Pressman, Jeremy
Publicado: (2001)

La clase media en países latinoamericanos
por: Steven Pressman
Publicado: (2011)

ENTERPRISE ARCHITECTURE AS AN APPROACH TO THE DEVELOPMENT OF INFORMATION SYSTEMS
por: Milosav N. Majstorović
Publicado: (2018)

BUSINESS AND IT ALIGNMENT
por: Milosav N. Majstorović
Publicado: (2016)

Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages
por: Yue, Xiang, et al.
Publicado: (2024)

Driving AR Experience to Purchase Intention: Examining the Role of Users' Immersiveness, Perceived Innovativeness and Engagement in Virtual Try‐On
por: Ruturaj Baber, et al.
Publicado: (2026)