Cover Image

Reusing Pre-Training Data at Test Time is a Compute Multiplier

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fang, Alex, Voice, Thomas, Pang, Ruoming, Schmidt, Ludwig, Gunter, Tom
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Language Model-guided Document Selection
by: Kong, Xiang, et al.
Published: (2024)

Datasets, Documents, and Repetitions: The Practicalities of Unequal Data Quality
by: Fang, Alex, et al.
Published: (2025)

Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge?
by: Findeis, Arduin, et al.
Published: (2025)

RATTENTION: Towards the Minimal Sliding Window Size in Local-Global Attention Models
by: Wang, Bailin, et al.
Published: (2025)

How to Select Pre-Trained Code Models for Reuse? A Learning Perspective
by: Bi, Zhangqian, et al.
Published: (2025)

Chain of Methodologies: Scaling Test Time Computation without Training
by: Liu, Cong, et al.
Published: (2025)

Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
by: Guo, Xu, et al.
Published: (2026)

CoRefine: Confidence-Guided Self-Refinement for Adaptive Test-Time Compute
by: Jin, Chen, et al.
Published: (2026)

Inverse Scaling in Test-Time Compute
by: Gema, Aryo Pradipta, et al.
Published: (2025)

FLOP-Efficient Training: Early Stopping Based on Test-Time Compute Awareness
by: Amer, Hossam, et al.
Published: (2026)

On Generalization across Measurement Systems: LLMs Entail More Test-Time Compute for Underrepresented Cultures
by: Bui, Minh Duc, et al.
Published: (2025)

FlashMem: Distilling Intrinsic Latent Memory via Computation Reuse
by: Hou, Yubo, et al.
Published: (2026)

Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Models
by: Nguyen, Thao, et al.
Published: (2025)

Evaluating LLM Alignment on Personality Inference from Real-World Interview Data
by: Zhu, Jianfeng, et al.
Published: (2025)

Reinforcement Learning on Pre-Training Data
by: Li, Siheng, et al.
Published: (2025)

When to Ponder: Adaptive Compute Allocation for Code Generation via Test-Time Training
by: Sim, Gihyeon
Published: (2025)

Investigating Large Language Models in Inferring Personality Traits from User Conversations
by: Zhu, Jianfeng, et al.
Published: (2025)

Can LLMs Infer Personality from Real World Conversations?
by: Zhu, Jianfeng, et al.
Published: (2025)

Understanding Risk and Dependency in AI Chatbot Use from User Discourse
by: Zhu, Jianfeng, et al.
Published: (2026)

Toxicity of the Commons: Curating Open-Source Pre-Training Data
by: Arnett, Catherine, et al.
Published: (2024)

Resolving Discrepancies in Compute-Optimal Scaling of Language Models
by: Porian, Tomer, et al.
Published: (2024)

What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
by: Wen, Xin, et al.
Published: (2024)

Unifying Structured Data as Graph for Data-to-Text Pre-Training
by: Li, Shujie, et al.
Published: (2024)

Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning Analysis
by: Boughorbel, Sabri, et al.
Published: (2024)

Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
by: Arora, Siddhant, et al.
Published: (2025)

Reinforcement Pre-Training
by: Dong, Qingxiu, et al.
Published: (2025)

Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
by: Wettig, Alexander, et al.
Published: (2025)

FIRE: Flexible Integration of Data Quality Ratings for Effective Pre-Training
by: Xu, Liangyu, et al.
Published: (2025)

Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training
by: Langlais, Pierre-Carl, et al.
Published: (2025)

Language Models Improve When Pretraining Data Matches Target Tasks
by: Mizrahi, David, et al.
Published: (2025)

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation
by: Zhu, Qin, et al.
Published: (2024)

What If We Allocate Test-Time Compute Adaptively?
by: Bilal, Ahsan, et al.
Published: (2026)

TestNUC: Enhancing Test-Time Computing Approaches and Scaling through Neighboring Unlabeled Data Consistency
by: Zou, Henry Peng, et al.
Published: (2025)

Beyond Public Access in LLM Pre-Training Data
by: Rosenblat, Sruly, et al.
Published: (2025)

Large Scale Transfer Learning for Tabular Data via Language Modeling
by: Gardner, Josh, et al.
Published: (2024)

ToReMi: Topic-Aware Data Reweighting for Dynamic Pre-Training Data Selection
by: Zhu, Xiaoxuan, et al.
Published: (2025)

Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models
by: Belenki, Lior, et al.
Published: (2025)

Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
by: Geiping, Jonas, et al.
Published: (2025)

In-Place Test-Time Training
by: Feng, Guhao, et al.
Published: (2026)

MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphs
by: Yu, Xingtong, et al.
Published: (2023)