Cover Image

OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Jiacheng, Blanton, Taylor, Elazar, Yanai, Min, Sewon, Chen, YenSung, Chheda-Kothary, Arnavi, Tran, Huy, Bischoff, Byron, Marsh, Eric, Schmitz, Michael, Trier, Cassidy, Sarnat, Aaron, James, Jenna, Borchardt, Jon, Kuehl, Bailey, Cheng, Evie, Farley, Karen, Sreeram, Sruthi, Anderson, Taira, Albright, David, Schoenick, Carissa, Soldaini, Luca, Groeneveld, Dirk, Pang, Rock Yuren, Koh, Pang Wei, Smith, Noah A., Lebrecht, Sophie, Choi, Yejin, Hajishirzi, Hannaneh, Farhadi, Ali, Dodge, Jesse
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Engaging with Children's Artwork in Mixed Visual-Ability Families
by: Chheda-Kothary, Arnavi, et al.
Published: (2024)

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
by: Liu, Jiacheng, et al.
Published: (2024)

AltGeoViz: Facilitating Accessible Geovisualization
by: Li, Chu, et al.
Published: (2024)

GeoVisA11y: An AI-based Geovisualization Question-Answering System for Screen-Reader Users
by: Li, Chu, et al.
Published: (2026)

Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
by: Wettig, Alexander, et al.
Published: (2025)

OLMoE: Open Mixture-of-Experts Language Models
by: Muennighoff, Niklas, et al.
Published: (2024)

BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models
by: Cao, Qingqing, et al.
Published: (2023)

2 OLMo 2 Furious
by: OLMo, Team, et al.
Published: (2024)

OLMo: Accelerating the Science of Language Models
by: Groeneveld, Dirk, et al.
Published: (2024)

EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
by: Zeng, Zhiyuan, et al.
Published: (2025)

ArtInsight: Enabling AI-Powered Artwork Engagement for Mixed Visual-Ability Families
by: Chheda-Kothary, Arnavi, et al.
Published: (2025)

OLMES: A Standard for Language Model Evaluations
by: Gu, Yuling, et al.
Published: (2024)

olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models
by: Poznanski, Jake, et al.
Published: (2025)

Scaling Retrieval-Based Language Models with a Trillion-Token Datastore
by: Shao, Rulin, et al.
Published: (2024)

Learning to Detect Language Model Training Data via Active Reconstruction
by: Yin, Junjie Oscar, et al.
Published: (2026)

CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
by: Chen, Tong, et al.
Published: (2024)

Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models
by: Deitke, Matt, et al.
Published: (2024)

APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
by: Zhao, Bowen, et al.
Published: (2024)

SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
by: Min, Sewon, et al.
Published: (2023)

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
by: Soldaini, Luca, et al.
Published: (2024)

Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
by: Morrison, Jacob, et al.
Published: (2024)

RAG over Thinking Traces Can Improve Reasoning Tasks
by: Arabzadeh, Negar, et al.
Published: (2026)

Olmix: A Framework for Data Mixing Throughout LM Development
by: Chen, Mayee F., et al.
Published: (2026)

How Many Images Does It Take? Estimating Imitation Thresholds in Text-to-Image Models
by: Verma, Sahil, et al.
Published: (2024)

Reliable, Adaptable, and Attributable Language Models with Retrieval
by: Asai, Akari, et al.
Published: (2024)

Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
by: Merrill, William, et al.
Published: (2025)

Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning
by: Kim, Joongwon, et al.
Published: (2024)

ScienceMeter: Tracking Scientific Knowledge Updates in Language Models
by: Wang, Yike, et al.
Published: (2025)

HREF: Human Response-Guided Evaluation of Instruction Following in Language Models
by: Lyu, Xinxi, et al.
Published: (2024)

Learnable Linguistic Watermarks for Tracing Model Extraction Attacks on Large Language Models
by: Bai, Minhao, et al.
Published: (2024)

Establishing Task Scaling Laws via Compute-Efficient Model Ladders
by: Bhagia, Akshita, et al.
Published: (2024)

KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions
by: Xu, Fangyuan, et al.
Published: (2024)

ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Data
by: Chen, Tong, et al.
Published: (2025)

Diagrama de fase sitio-enlace en dímeros
by: W. Lebrecht
Published: (2014)

Umbrales de percolación de sitios. Pequeñas celdas bidimensionales asimétricas
by: W. Lebrecht
Published: (2009)

Frustración en redes arquimedianas antiferromagnéticas
by: W. Lebrecht
Published: (2013)

Frustración local en la red arquimediana (3,4,6,4)
by: W. Lebrecht
Published: (2008)

Umbrales de percolación exactos en redes duales
by: W. Lebrecht
Published: (2010)

Percolación discreta en redes tridimensionales
by: W. Lebrecht
Published: (2011)

Umbral de percolación en las redes de Kagomé y Dice
by: W. Lebrecht
Published: (2013)