Cover Image

Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Levi, Noam, Beck, Alon, Bar-Sinai, Yohai
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Disordered Systems and Neural Networks Mathematical Physics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Grokking at the Edge of Linear Separability
by: Beck, Alon, et al.
Published: (2024)

Learning Shrinks the Hard Tail: Training-Dependent Inference Scaling in a Solvable Linear Model
by: Levi, Noam
Published: (2026)

Probing the Latent Hierarchical Structure of Data via Diffusion Models
by: Sclocchi, Antonio, et al.
Published: (2024)

Is Grokking a Computational Glass Relaxation?
by: Zhang, Xiaotian, et al.
Published: (2025)

Grokking as the Transition from Lazy to Rich Training Dynamics
by: Kumar, Tanishq, et al.
Published: (2023)

Hopfield model with planted patterns: a teacher-student self-supervised learning model
by: Alemanno, Francesco, et al.
Published: (2023)

Universal characteristics of deep neural network loss surfaces from random matrix theory
by: Baskerville, Nicholas P, et al.
Published: (2022)

Dense Hopfield Networks in the Teacher-Student Setting
by: Thériault, Robin, et al.
Published: (2024)

The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets
by: Levi, Noam, et al.
Published: (2023)

Grokking as a First Order Phase Transition in Two Layer Networks
by: Rubin, Noa, et al.
Published: (2023)

Class Imbalance in Anomaly Detection: Learning from an Exactly Solvable Model
by: Pezzicoli, F. S., et al.
Published: (2025)

Sampling Data with Chains of Forward-Backward Diffusion Steps
by: Kang, Hyunmo, et al.
Published: (2026)

Grokking in the Ising Model
by: Hutchison, Karolina, et al.
Published: (2025)

More Bang for the Buck: Improving the Inference of Large Language Models at a Fixed Budget using Reset and Discard (ReD)
by: Meir, Sagi, et al.
Published: (2026)

Grokking vs. Learning: Same Features, Different Encodings
by: Manning-Coe, Dmitry, et al.
Published: (2025)

Grokking Modular Polynomials
by: Doshi, Darshil, et al.
Published: (2024)

Incorporating rank-free coupling and external field via an incoherent modulated spatial photonic Ising machine
by: Zheng, Ze, et al.
Published: (2025)

Existence of a Phase Transition in the One-Dimensional Ising Spin Glass Model with Long-Range Interactions on the Nishimori Line
by: Okuyama, Manaka, et al.
Published: (2026)

A spin-glass model for the loss surfaces of generative adversarial networks
by: Baskerville, Nicholas P, et al.
Published: (2021)

Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models
by: Atanasov, Alexander, et al.
Published: (2025)

A spectral approach to Hebbian-like neural networks
by: Agliari, Elena, et al.
Published: (2024)

Exact Learning Dynamics of In-Context Learning in Linear Transformers and Its Application to Non-Linear Transformers
by: Mainali, Nischal, et al.
Published: (2025)

Self-attention as an attractor network: transient memories without backpropagation
by: D'Amico, Francesco, et al.
Published: (2024)

Anchored advected interfaces, Oslo model, and roughness at depinning
by: Shapira, Assaf, et al.
Published: (2023)

Gauge theory for quantum XYZ spin glasses
by: Itoi, C., et al.
Published: (2023)

The weak and strong disorder regimes in the continuous random field Ising model
by: Heymans, G. O., et al.
Published: (2026)

At Most Two Infinite Blue Clusters in the CMR Representation of the Edwards-Anderson Spin Glass
by: Pei, Yan Ru
Published: (2026)

Density of states correlations in Lévy Rosenzweig-Porter model via supersymmetry approach
by: Safonova, Elizaveta, et al.
Published: (2025)

Serial vs parallel recall in the Blume-Every-Griffiths neural networks
by: Albanese, Linda, et al.
Published: (2026)

Existence of de Almeida-Thouless-type instability in the transverse field Sherrington-Kirkpatrick model
by: Itoi, C., et al.
Published: (2024)

Higher-order localization landscape theory of Anderson localization
by: Skipetrov, Sergey E.
Published: (2024)

Local topology for periodic Hamiltonians and fuzzy tori
by: Doll, Nora, et al.
Published: (2024)

The importance of being empty: a spectral approach to Hopfield neural networks with diluted examples
by: Agliari, Elena, et al.
Published: (2025)

Concentration properties of Gaussian random fields
by: Sharma, Gargee
Published: (2014)

Disordered harmonic chain with random masses and springs: a combinatorial approach
by: Bernard, Maximilien, et al.
Published: (2025)

Interpolations for a quantum Parisi formula in transverse field mean-field spin glass models
by: Itoi, C., et al.
Published: (2025)

Winding Number Statistics for Chiral Random Matrices: Universal Correlations and Statistical Moments in the Unitary Case
by: Hahn, Nico, et al.
Published: (2024)

Stark localization of interacting particles
by: De Roeck, Wojciech, et al.
Published: (2026)

The thermodynamic limit in mean field neural networks
by: Agliari, Elena, et al.
Published: (2024)

Free Convolution and Generalized Dyson Brownian Motion
by: Bousseyroux, Pierre, et al.
Published: (2024)