Cover Image

Practical Scaling Laws: Converting Compute into Performance in a Data-Constrained World

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bryant, Christopher M., Liu, Hao
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Prescriptive Scaling Laws for Data Constrained Training
by: Lovelace, Justin, et al.
Published: (2026)

Scaling Laws for Data Filtering -- Data Curation cannot be Compute Agnostic
by: Goyal, Sachin, et al.
Published: (2024)

Improving the Scaling Laws of Synthetic Data with Deliberate Practice
by: Askari-Hemmat, Reyhane, et al.
Published: (2025)

Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training
by: Liu, Lei, et al.
Published: (2025)

Scaling Laws in Linear Regression: Compute, Parameters, and Data
by: Lin, Licong, et al.
Published: (2024)

Configuration-to-Performance Scaling Law with Neural Ansatz
by: Zhang, Huaqing, et al.
Published: (2026)

Scaling Laws for Optimal Data Mixtures
by: Shukor, Mustafa, et al.
Published: (2025)

Compute-Constrained Data Selection
by: Yin, Junjie Oscar, et al.
Published: (2024)

Entropy Law: The Story Behind Data Compression and LLM Performance
by: Yin, Mingjia, et al.
Published: (2024)

Scaling Laws for Pre-training Agents and World Models
by: Pearce, Tim, et al.
Published: (2024)

Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning
by: Wu, Xiaojun, et al.
Published: (2025)

Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory
by: Niu, Xueyan, et al.
Published: (2024)

Scaling Law of Sim2Real Transfer Learning in Expanding Computational Materials Databases for Real-World Predictions
by: Minami, Shunya, et al.
Published: (2024)

Towards Scaling Law Analysis For Spatiotemporal Weather Data
by: Kiefer, Alexander, et al.
Published: (2026)

Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra
by: Worschech, Roman, et al.
Published: (2024)

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
by: Hägele, Alexander, et al.
Published: (2024)

Scaling Laws for Precision
by: Kumar, Tanishq, et al.
Published: (2024)

xLSTM Scaling Laws: Competitive Performance with Linear Time-Complexity
by: Beck, Maximilian, et al.
Published: (2025)

Scaling Data-Constrained Language Models
by: Muennighoff, Niklas, et al.
Published: (2023)

Scaling Laws for the Value of Individual Data Points in Machine Learning
by: Covert, Ian, et al.
Published: (2024)

Adaptive Data Optimization: Dynamic Sample Selection with Scaling Laws
by: Jiang, Yiding, et al.
Published: (2024)

Zero-Shot Performance Prediction for Probabilistic Scaling Laws
by: Schram, Viktoria, et al.
Published: (2025)

Parametric Scaling Law of Tuning Bias in Conformal Prediction
by: Zeng, Hao, et al.
Published: (2025)

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study
by: Liu, Hao, et al.
Published: (2024)

gzip Predicts Data-dependent Scaling Laws
by: Pandey, Rohan
Published: (2024)

Wukong: Towards a Scaling Law for Large-Scale Recommendation
by: Zhang, Buyun, et al.
Published: (2024)

On the Invariance and Generality of Neural Scaling Laws
by: Han, Xing, et al.
Published: (2026)

Scaling Laws for Predicting Downstream Performance in LLMs
by: Chen, Yangyi, et al.
Published: (2024)

Provable Data Scaling Law for Meta Learning via Complexity Minimization
by: Fukuchi, Kazuto, et al.
Published: (2026)

Data-Aware Gradient Compression for FL in Communication-Constrained Mobile Computing
by: Lu, Rongwei, et al.
Published: (2023)

Scaling Laws for Downstream Task Performance of Large Language Models
by: Isik, Berivan, et al.
Published: (2024)

Scaling Laws are Redundancy Laws
by: Bi, Yuda, et al.
Published: (2025)

How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines
by: Sengupta, Ayan, et al.
Published: (2025)

Scaling Laws for Mixture Pretraining Under Data Constraints
by: Sedova, Anastasiia, et al.
Published: (2026)

Scaling Laws for Data-Efficient Visual Transfer Learning
by: Yang, Wenxuan, et al.
Published: (2025)

Scaling Laws Revisited: Modeling the Role of Data Quality in Language Model Pretraining
by: Subramanyam, Anirudh, et al.
Published: (2025)

Scaling Laws for Differentially Private Language Models
by: McKenna, Ryan, et al.
Published: (2025)

Minimum-Action Learning: Energy-Constrained Symbolic Model Selection for Physical Law Identification from Noisy Data
by: Frasch, Martin G.
Published: (2026)

Predicting Task Performance with Context-aware Scaling Laws
by: Montgomery, Kyle, et al.
Published: (2025)

Observational Scaling Laws and the Predictability of Language Model Performance
by: Ruan, Yangjun, et al.
Published: (2024)