Cover Image

Scaling Laws of Synthetic Data for Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qin, Zeyu, Dong, Qingxiu, Zhang, Xingxing, Dong, Li, Huang, Xiaolong, Yang, Ziyi, Khademi, Mahmoud, Zhang, Dongdong, Awadalla, Hany Hassan, Fung, Yi R., Chen, Weizhu, Cheng, Minhao, Wei, Furu
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Self-Boosting Large Language Models with Synthetic Preference Data
by: Dong, Qingxiu, et al.
Published: (2024)

Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective
by: Yu, Yiyao, et al.
Published: (2025)

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
by: Li, Haoran, et al.
Published: (2024)

Segmenting Text and Learning Their Rewards for Improved RLHF in Language Model
by: Yin, Yueqin, et al.
Published: (2025)

Data Selection via Optimal Control for Language Models
by: Gu, Yuxian, et al.
Published: (2024)

Online Experiential Learning for Language Models
by: Ye, Tianzhu, et al.
Published: (2026)

Towards Optimal Learning of Language Models
by: Gu, Yuxian, et al.
Published: (2024)

A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models
by: Xu, Haoran, et al.
Published: (2023)

WildLong: Synthesizing Realistic Long-Context Instruction Data at Scale
by: Li, Jiaxi, et al.
Published: (2025)

The Era of Agentic Organization: Learning to Organize with Language Models
by: Chi, Zewen, et al.
Published: (2025)

Efficiently Editing Mixture-of-Experts Models with Compressed Experts
by: He, Yifei, et al.
Published: (2025)

Think Only When You Need with Large Hybrid-Reasoning Models
by: Jiang, Lingjie, et al.
Published: (2025)

MathScale: Scaling Instruction Tuning for Mathematical Reasoning
by: Tang, Zhengyang, et al.
Published: (2024)

Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge
by: Tang, Yao, et al.
Published: (2026)

Bootstrap Your Own Context Length
by: Wang, Liang, et al.
Published: (2024)

Reward Reasoning Model
by: Guo, Jiaxin, et al.
Published: (2025)

Reinforcement Pre-Training
by: Dong, Qingxiu, et al.
Published: (2025)

RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning
by: Fu, Shaopeng, et al.
Published: (2026)

Exploring Scaling Laws of CTR Model for Online Performance Improvement
by: Lai, Weijiang, et al.
Published: (2025)

Scalable Token-Level Hallucination Detection in Large Language Models
by: Min, Rui, et al.
Published: (2026)

SciAgent: Tool-augmented Language Models for Scientific Reasoning
by: Ma, Yubo, et al.
Published: (2024)

Principled Synthetic Data Enables the First Scaling Laws for LLMs in Recommendation
by: Zhang, Benyu, et al.
Published: (2026)

Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Math
by: Xu, Haoran, et al.
Published: (2025)

Scaling Laws for Linear Complexity Language Models
by: Shen, Xuyang, et al.
Published: (2024)

Uncovering, Explaining, and Mitigating the Superficial Safety of Backdoor Defense
by: Min, Rui, et al.
Published: (2024)

Decoding in Geometry: Alleviating Embedding-Space Crowding for Complex Reasoning
by: Yang, Yixin, et al.
Published: (2026)

Further Explanations on "SAT Requires Exhaustive Search"
by: Dong, Qingxiu, et al.
Published: (2024)

Scaling Laws For Mixed Quantization
by: Cao, Zeyu, et al.
Published: (2024)

Why are you so different? A behavioral theory perspective of CSR communication strategy
by: Wen Zhang, et al.
Published: (2026)

RICo: Refined In-Context Contribution for Automatic Instruction-Tuning Data Selection
by: Yang, Yixin, et al.
Published: (2025)

Improving the Scaling Laws of Synthetic Data with Deliberate Practice
by: Askari-Hemmat, Reyhane, et al.
Published: (2025)

Scaling Speech-Text Pre-training with Synthetic Interleaved Data
by: Zeng, Aohan, et al.
Published: (2024)

Scaling Laws Behind Code Understanding Model
by: Lin, Jiayi, et al.
Published: (2024)

Do Climate Change Regulatory Pressures Increase Corporate Environmental Sustainability Performance? The Moderating Roles of Foreign Market Exposure and Industry Carbon Intensity
by: Xiaolong Shui, et al.
Published: (2024)

Flexibility Characterization of Sustainable Power Systems in Demand Space: A Data-Driven Inverse Optimization Approach
by: Awadalla, Mohamed, et al.
Published: (2022)

Data-Based Efficient Off-Policy Stabilizing Optimal Control Algorithms for Discrete-Time Linear Systems via Damping Coefficients
by: Li, Dongdong, et al.
Published: (2024)

ClinTutor-R1: Advancing Scalable and Robust One-to-Many Alignment in Clinical Socratic Education
by: He, Zhitao, et al.
Published: (2025)

Chain-of-Dictionary Prompting Elicits Translation in Large Language Models
by: Lu, Hongyuan, et al.
Published: (2023)

Parallel Scaling Law for Language Models
by: Chen, Mouxiang, et al.
Published: (2025)

Project_Asma_Declaration
by: Khademi
Published: (2025)