Imagen de Portada

Unified Neural Network Scaling Laws and Scale-time Equivalence

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Boopathy, Akhilan, Fiete, Ila
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Breaking Neural Network Scaling Laws with Modularity
por: Boopathy, Akhilan, et al.
Publicado: (2024)

Towards Exact Computation of Inductive Bias
por: Boopathy, Akhilan, et al.
Publicado: (2024)

Resampling-free Particle Filters in High-dimensions
por: Boopathy, Akhilan, et al.
Publicado: (2024)

Permutation Invariant Learning with High-Dimensional Particle Filters
por: Boopathy, Akhilan, et al.
Publicado: (2024)

Delay Embedding Theory of Neural Sequence Models
por: Ostrow, Mitchell, et al.
Publicado: (2024)

Large Pre-Training Datasets Don't Always Guarantee Robustness after Fine-Tuning
por: Hwang, Jaedong, et al.
Publicado: (2024)

Grid Cell-Inspired Fragmentation and Recall for Efficient Map Building
por: Hwang, Jaedong, et al.
Publicado: (2023)

Modular connectivity in neural networks emerges from Poisson noise-motivated regularisation, and promotes robustness and compositional generalisation
por: Qian, Daoyuan, et al.
Publicado: (2025)

Do Diffusion Models Learn Semantically Meaningful and Efficient Representations?
por: Liang, Qiyao, et al.
Publicado: (2024)

Key-value memory in the brain
por: Gershman, Samuel J., et al.
Publicado: (2025)

Compositional Generalization via Forced Rendering of Disentangled Latents
por: Liang, Qiyao, et al.
Publicado: (2025)

How Diffusion Models Learn to Factorize and Compose
por: Liang, Qiyao, et al.
Publicado: (2024)

Neural Neural Scaling Laws
por: Hu, Michael Y., et al.
Publicado: (2026)

Unified Scaling Laws for Compressed Representations
por: Panferov, Andrei, et al.
Publicado: (2025)

Fault-Tolerant Neural Networks from Biological Error Correction Codes
por: Zlokapa, Alexander, et al.
Publicado: (2022)

Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra
por: Worschech, Roman, et al.
Publicado: (2024)

On the Invariance and Generality of Neural Scaling Laws
por: Han, Xing, et al.
Publicado: (2026)

Compression Scaling Laws:Unifying Sparsity and Quantization
por: Frantar, Elias, et al.
Publicado: (2025)

Scaling Laws of Graph Neural Networks for Atomistic Materials Modeling
por: Li, Chaojian, et al.
Publicado: (2025)

Configuration-to-Performance Scaling Law with Neural Ansatz
por: Zhang, Huaqing, et al.
Publicado: (2026)

Towards Neural Scaling Laws on Graphs
por: Liu, Jingzhe, et al.
Publicado: (2024)

On the Optimizer Dependence of Neural Scaling Laws
por: Ramani, Vansh, et al.
Publicado: (2026)

Explaining Neural Scaling Laws
por: Bahri, Yasaman, et al.
Publicado: (2021)

Bayesian Neural Scaling Law Extrapolation with Prior-Data Fitted Networks
por: Lee, Dongwoo, et al.
Publicado: (2025)

Neural Scaling Laws for Deep Regression
por: Cadez, Tilen, et al.
Publicado: (2025)

Scaling Laws for Neural Material Models
por: Trikha, Akshay, et al.
Publicado: (2025)

Information-Theoretic Foundations for Neural Scaling Laws
por: Jeon, Hong Jun, et al.
Publicado: (2024)

Scaling Laws and In-Context Learning: A Unified Theoretical Framework
por: Mehta, Sushant, et al.
Publicado: (2025)

How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines
por: Sengupta, Ayan, et al.
Publicado: (2025)

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study
por: Liu, Hao, et al.
Publicado: (2024)

Renormalizable Spectral-Shell Dynamics as the Origin of Neural Scaling Laws
por: Zhang, Yizhou
Publicado: (2025)

Complexity Scaling Laws for Neural Models using Combinatorial Optimization
por: Weissman, Lowell, et al.
Publicado: (2025)

On Neural Scaling Laws for Weather Emulation through Continual Training
por: Subramanian, Shashank, et al.
Publicado: (2026)

Unifying Learning Dynamics and Generalization in Transformers Scaling Law
por: Yang, Chiwun
Publicado: (2025)

Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Frontier AI Models
por: Duan, Sunny, et al.
Publicado: (2024)

AlphaZero Neural Scaling and Zipf's Law: a Tale of Board Games and Power Laws
por: Neumann, Oren, et al.
Publicado: (2024)

The Blessing of Dimensionality in LLM Fine-tuning: A Variance-Curvature Perspective
por: Liang, Qiyao, et al.
Publicado: (2026)

Scaling Laws are Redundancy Laws
por: Bi, Yuda, et al.
Publicado: (2025)

Neural Scaling Laws Rooted in the Data Distribution
por: Brill, Ari
Publicado: (2024)

A Dynamical Model of Neural Scaling Laws
por: Bordelon, Blake, et al.
Publicado: (2024)