Imagen de Portada

Renormalization group for deep neural networks: Universality of learning and scaling laws

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Coppola, Gorka Peraza, Helias, Moritz, Ringel, Zohar
Formato:	Preprint
Publicado:	2025
Materias:	Disordered Systems and Neural Networks
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Critical feature learning in deep neural networks
por: Fischer, Kirsten, et al.
Publicado: (2024)

Lecture notes: From Gaussian processes to feature learning
por: Helias, Moritz, et al.
Publicado: (2026)

Dynamics of neural scaling laws in random feature regression with powerlaw-distributed kernel eigenvalues
por: Kramp, Jakob, et al.
Publicado: (2026)

Linking Network and Neuron-level Correlations by Renormalized Field Theory
por: Dick, Michael, et al.
Publicado: (2023)

Applications of Statistical Field Theory in Deep Learning
por: Ringel, Zohar, et al.
Publicado: (2025)

From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning
por: Rubin, Noa, et al.
Publicado: (2025)

Algorithmic Task Capture, Computational Complexity, and Inductive Bias of Infinite Transformers
por: Davidovich, Orit, et al.
Publicado: (2026)

Demystifying Spectral Bias on Real-World Data
por: Lavie, Itay, et al.
Publicado: (2024)

Implicit bias produces neural scaling laws in learning curves, from perceptrons to deep networks
por: D'Amico, Francesco, et al.
Publicado: (2025)

Renormalization group analysis of noisy neural field
por: Zang, Jie, et al.
Publicado: (2025)

Grokking as a First Order Phase Transition in Two Layer Networks
por: Rubin, Noa, et al.
Publicado: (2023)

Optimizing p-spin models through hypergraph neural networks and deep reinforcement learning
por: Zeng, Li, et al.
Publicado: (2026)

Effect of Synaptic Heterogeneity on Neuronal Coordination
por: Layer, Moritz, et al.
Publicado: (2023)

Wilsonian Renormalization of Neural Network Gaussian Processes
por: Howard, Jessica N., et al.
Publicado: (2024)

Reduction of interaction order in hard combinatorial optimization via conditionally independent degrees of freedom
por: Ciobanu, Alexandru, et al.
Publicado: (2025)

Towards Understanding Inductive Bias in Transformers: A View From Infinity
por: Lavie, Itay, et al.
Publicado: (2024)

A unified theory of feature learning in RNNs and DNNs
por: Bauer, Jan P., et al.
Publicado: (2026)

Field theory for optimal signal propagation in ResNets
por: Fischer, Kirsten, et al.
Publicado: (2023)

Improving deep neural network performance through sampling
por: Ghantasala, Lakshmi A., et al.
Publicado: (2025)

Renormalization group of topological scattering networks
por: Zhang, Zhe, et al.
Publicado: (2024)

Arbitrage equilibrium and the emergence of universal microstructure in deep neural networks
por: Venkatasubramanian, Venkat, et al.
Publicado: (2024)

Graph Neural Networks Do Not Always Oversmooth
por: Epping, Bastian, et al.
Publicado: (2024)

Numerical study of Darcy's law of yield stress fluids on a deep tree-like network
por: Munier, Stéphane, et al.
Publicado: (2024)

Statistical physics through the lens of real-space mutual information
por: Gökmen, Doruk Efe, et al.
Publicado: (2021)

Beyond-mean-field fluctuations for the solution of constraint satisfaction problems
por: Foos, Niklas, et al.
Publicado: (2025)

Topological mechanical neural networks as classifiers through in situ backpropagation learning
por: Li, Shuaifeng, et al.
Publicado: (2025)

A statistical mechanics framework for Bayesian deep neural networks beyond the infinite-width limit
por: Pacelli, R., et al.
Publicado: (2022)

Emergent weight morphologies in deep neural networks
por: de Jong, Pascal, et al.
Publicado: (2025)

Computing frustration and near-monotonicity in deep neural networks
por: Wendin, Joel, et al.
Publicado: (2025)

Finite-time Lyapunov exponents of deep neural networks
por: Storm, L., et al.
Publicado: (2023)

Application of deep neural networks for computing the renormalization group flow of the two-dimensional phi^4 field theory
por: Zhao, Yueqi, et al.
Publicado: (2025)

Generalized hetero-associative neural networks
por: Agliari, Elena, et al.
Publicado: (2024)

Compression theory for inhomogeneous systems
por: Gökmen, Doruk Efe, et al.
Publicado: (2023)

Spring-block theory of feature learning in deep neural networks
por: Shi, Cheng, et al.
Publicado: (2024)

Renormalization of networks with weak geometric coupling
por: van der Kolk, Jasper, et al.
Publicado: (2024)

High-dimensional learning of narrow neural networks
por: Cui, Hugo
Publicado: (2024)

Partial annealing and pattern decorrelation in associative neural networks
por: Albanese, Linda, et al.
Publicado: (2026)

Microscopic and collective signatures of feature learning in neural networks
por: Corti, Andrea, et al.
Publicado: (2025)

Instant prediction of relaxation in moiré superlattices using neural networks
por: Belonovskii, Aleksei V., et al.
Publicado: (2025)

Glassy dynamics near the interpolation transition in deep recurrent networks
por: Hertz, John, et al.
Publicado: (2024)