Cover Image

Scaling Laws are Redundancy Laws

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bi, Yuda, Calhoun, Vince D
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Cross-Spectral Witness for Hidden Nonequilibrium Beyond the Scalar Ceiling
by: Bi, Yuda, et al.
Published: (2026)

Conditioning on a Volatility Proxy Compresses the Apparent Timescale of Collective Market Correlation
by: Bi, Yuda, et al.
Published: (2026)

Redundancy as a Structural Information Principle for Learning and Generalization
by: Bi, Yuda, et al.
Published: (2025)

Grokking as a Falsifiable Finite-Size Transition
by: Bi, Yuda, et al.
Published: (2026)

A 1/R Law for Kurtosis Contrast in Balanced Mixtures
by: Bi, Yuda, et al.
Published: (2026)

Improved Scaling Laws in Linear Regression via Data Reuse
by: Lin, Licong, et al.
Published: (2025)

Timescale Coalescence Makes Hidden Persistent Forcing Spectrally Dark
by: Bi, Yuda, et al.
Published: (2026)

Parametric Scaling Law of Tuning Bias in Conformal Prediction
by: Zeng, Hao, et al.
Published: (2025)

Scaling Laws in Linear Regression: Compute, Parameters, and Data
by: Lin, Licong, et al.
Published: (2024)

Laws of thermodynamics for exponential families
by: Balsubramani, Akshay
Published: (2025)

Generalization and Scaling Laws for Mixture-of-Experts Transformers
by: Mayaki, Mansour Zoubeirou a
Published: (2026)

Reservoir Subspace Injection for Online ICA under Top-n Whitening
by: Xiao, Wenjun, et al.
Published: (2026)

Scaling Laws from Sequential Feature Recovery: A Solvable Hierarchical Model
by: Wortsman-Zurich, Arie, et al.
Published: (2026)

A Limit Theory of Foundation Models: A Mathematical Approach to Understanding Emergent Intelligence and Scaling Laws
by: Shu, Jun, et al.
Published: (2026)

Uniform Laws of Large Numbers in Product Spaces
by: Holzman, Ron, et al.
Published: (2026)

An Asymptotic Law of the Iterated Logarithm for $\mathrm{KL}_{\inf}$
by: Ram, Ashwin, et al.
Published: (2026)

Asymmetric Scaling Laws from Sparse Features
by: Sous, John, et al.
Published: (2026)

4+3 Phases of Compute-Optimal Neural Scaling Laws
by: Paquette, Elliot, et al.
Published: (2024)

First-Extinction Law for Resampling Processes
by: Benati, Matteo, et al.
Published: (2025)

Structural Foundations for Leading Digit Laws: Beyond Probabilistic Mixtures
by: Berman, Vladimir
Published: (2025)

Spectral Coherence Index: A Model-Free Metric for Protein Structural Ensemble Quality Assessment
by: Bi, Yuda, et al.
Published: (2026)

Matching and mixing: Matchability of graphs under Markovian error
by: Li, Zhirui, et al.
Published: (2026)

Data-driven Learning of Interaction Laws in Multispecies Particle Systems with Gaussian Processes: Convergence Theory and Applications
by: Feng, Jinchao, et al.
Published: (2025)

From Zipf's Law to Neural Scaling through Heaps' Law and Hilberg's Hypothesis
by: Dębowski, Łukasz
Published: (2025)

Optimizing the Induced Correlation in Omnibus Joint Graph Embeddings
by: Pantazis, Konstantinos, et al.
Published: (2024)

From Data to Laws: Neural Discovery of Conservation Laws Without False Positives
by: Ray, Rahul D
Published: (2026)

L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling
by: Chen, Zhuo, et al.
Published: (2025)

GRAND: Graph Release with Assured Node Differential Privacy
by: Liu, Suqing, et al.
Published: (2025)

Statistical Inverse Problems in Hilbert Scales
by: Rastogi, Abhishake
Published: (2022)

Ranking Reasoning LLMs under Test-Time Scaling
by: Hariri, Mohsen, et al.
Published: (2026)

Detection of Block-Exchangeable Structure in Large-Scale Correlation Matrices
by: Perreault, Samuel, et al.
Published: (2017)

Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime
by: Hu, Hong, et al.
Published: (2024)

A Gapped Scale-Sensitive Dimension and Lower Bounds for Offset Rademacher Complexity
by: Jia, Zeyu, et al.
Published: (2025)

Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets
by: Yu, Zixiong, et al.
Published: (2024)

The Financial Connectome: A Brain-Inspired Framework for Modeling Latent Market Dynamics
by: Bi, Yuda, et al.
Published: (2025)

On the Nonasymptotic Scaling Guarantee of Hyperparameter Estimation in Inhomogeneous, Weakly-Dependent Complex Network Dynamical Systems
by: Yu, Yi, et al.
Published: (2026)

A Neural Scaling Law from Lottery Ticket Ensembling
by: Liu, Ziming, et al.
Published: (2023)

Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling
by: Li, Yufan, et al.
Published: (2025)

Representation-Enhanced Neural Knowledge Integration with Application to Large-Scale Medical Ontology Learning
by: Liu, Suqi, et al.
Published: (2024)

Convergence of Dirichlet Forms for MCMC Optimal Scaling with Dependent Target Distributions on Large Graphs
by: Ning, Ning
Published: (2022)