Image de couverture de livre

A Basin-Selection Perspective on Grokking via Singular Learning Theory

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cullen, Ben, Estan-Ruiz, Sergio, Danait, Riya, Li, Jiayi
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Sublinear Sketches for Approximate Nearest Neighbor and Kernel Density Estimation
par: Danait, Ved, et autres
Publié: (2025)

To Grok Grokking: Provable Grokking in Ridge Regression
par: Xu, Mingyue, et autres
Publié: (2026)

Grokked Models are Better Unlearners
par: Liang, Yuanbang, et autres
Publié: (2025)

The Complexity Dynamics of Grokking
par: DeMoss, Branton, et autres
Publié: (2024)

Measuring Sharpness in Grokking
par: Miller, Jack, et autres
Publié: (2024)

Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks
par: Minegishi, Gouki, et autres
Publié: (2023)

Unified View of Grokking, Double Descent and Emergent Abilities: A Perspective from Circuits Competition
par: Huang, Yufei, et autres
Publié: (2024)

Acceleration of Grokking in Learning Arithmetic Operations via Kolmogorov-Arnold Representation
par: Park, Yeachan, et autres
Publié: (2024)

Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking
par: Han, Ting, et autres
Publié: (2025)

Topological Signatures of Grokking
par: Tang, Yifan, et autres
Publié: (2026)

PAC-Bayes Bounds for Gibbs Posteriors via Singular Learning Theory
par: Wang, Chenyang, et autres
Publié: (2026)

ILDR: Geometric Early Detection of Grokking
par: Golwala, Shreel
Publié: (2026)

Exploring Grokking: Experimental and Mechanistic Investigations
par: Qiye, Hu, et autres
Publié: (2024)

The Norm-Separation Delay Law of Grokking: A First-Principles Theory of Delayed Generalization
par: Khanh, Truong Xuan, et autres
Publié: (2026)

Grokking Explained: A Statistical Phenomenon
par: Carvalho, Breno W., et autres
Publié: (2025)

What Can Grokking Teach Us About Learning Under Nonstationarity?
par: Lyle, Clare, et autres
Publié: (2025)

Critical Data Size of Language Models from a Grokking Perspective
par: Zhu, Xuekai, et autres
Publié: (2024)

Grokking in LLM Pretraining? Monitor Memorization-to-Generalization without Test
par: Li, Ziyue, et autres
Publié: (2025)

Distributional Spectral Diagnostics for Localizing Grokking Transitions
par: Wang, Ziyue, et autres
Publié: (2026)

GrokAlign: Geometric Characterisation and Acceleration of Grokking
par: Walker, Thomas, et autres
Publié: (2025)

Early-Warning Signals of Grokking via Loss-Landscape Geometry
par: Xu, Yongzhong
Publié: (2026)

Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition
par: Mohamadi, Mohamad Amin, et autres
Publié: (2024)

Understanding Grokking Through A Robustness Viewpoint
par: Tan, Zhiquan, et autres
Publié: (2023)

Egalitarian Gradient Descent: A Simple Approach to Accelerated Grokking
par: Pasand, Ali Saheb, et autres
Publié: (2025)

Grokking in Linear Models for Logistic Regression
par: Das, Nataraj, et autres
Publié: (2026)

Controlling Grokking with Nonlinearity and Data Symmetry
par: Salah, Ahmed, et autres
Publié: (2024)

Two Speeds of Learning: A Representation-Readout Decomposition of Grokking and Double Descent
par: Chou, Chi-Ning, et autres
Publié: (2026)

Grokking of Diffusion Models: Case Study on Modular Addition
par: Kim, Joon Hyeok, et autres
Publié: (2026)

Explaining Grokking in Transformers through the Lens of Inductive Bias
par: Singh, Jaisidh, et autres
Publié: (2026)

Beyond Progress Measures: Theoretical Insights into the Mechanism of Grokking
par: Gu, Zihan, et autres
Publié: (2025)

Provable Scaling Laws of Feature Emergence from Learning Dynamics of Grokking
par: Tian, Yuandong
Publié: (2025)

Grokking Finite-Dimensional Algebra
par: Notsawo, Pascal Jr Tikeng, et autres
Publié: (2026)

Grokking Group Multiplication with Cosets
par: Stander, Dashiell, et autres
Publié: (2023)

Muon Optimizer Accelerates Grokking
par: Tveit, Amund, et autres
Publié: (2025)

A Systematic Empirical Study of Grokking: Depth, Architecture, Activation, and Regularization
par: Manir, Shalima Binta, et autres
Publié: (2026)

Explaining Grokking and Information Bottleneck through Neural Collapse Emergence
par: Sakamoto, Keitaro, et autres
Publié: (2025)

When Data Falls Short: Grokking Below the Critical Threshold
par: Singh, Vaibhav, et autres
Publié: (2025)

Deep Grokking: Would Deep Neural Networks Generalize Better?
par: Fan, Simin, et autres
Publié: (2024)

Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity
par: Miller, Jack, et autres
Publié: (2023)

Grokfast: Accelerated Grokking by Amplifying Slow Gradients
par: Lee, Jaerin, et autres
Publié: (2024)