Imagen de Portada

A Systematic Empirical Study of Grokking: Depth, Architecture, Activation, and Regularization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Manir, Shalima Binta, Rupa, Anamika Paul
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Care-Conditioned Neuromodulation for Autonomy-Preserving Supportive Dialogue Agents
por: Manir, Shalima Binta, et al.
Publicado: (2026)

ASEHybrid: When Geometry Matters Beyond Homophily in Graph Neural Networks
por: Manir, Shalima Binta, et al.
Publicado: (2026)

Predicting the Performance of Graph Convolutional Networks with Spectral Properties of the Graph Laplacian
por: Manir, Shalima Binta, et al.
Publicado: (2025)

Hierarchical Learning for Maze Navigation: Emergence of Mental Representations via Second-Order Learning
por: Manir, Shalima Binta, et al.
Publicado: (2025)

Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold
por: Rupa, Anamika Paul
Publicado: (2026)

One Model, Two Minds: A Context-Gated Graph Learner that Recreates Human Biases
por: Manir, Shalima Binta, et al.
Publicado: (2025)

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance
por: Rupa, Anamika Paul, et al.
Publicado: (2026)

Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity
por: Miller, Jack, et al.
Publicado: (2023)

Feature Repulsion and Spectral Lock-in: An Empirical Study of Two-Layer Network Grokking
por: Xu, Yongzhong
Publicado: (2026)

To Grok Grokking: Provable Grokking in Ridge Regression
por: Xu, Mingyue, et al.
Publicado: (2026)

Tracing the Path to Grokking: Embeddings, Dropout, and Network Activation
por: Salah, Ahmed, et al.
Publicado: (2025)

The Complexity Dynamics of Grokking
por: DeMoss, Branton, et al.
Publicado: (2024)

Measuring Sharpness in Grokking
por: Miller, Jack, et al.
Publicado: (2024)

Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks
por: Minegishi, Gouki, et al.
Publicado: (2023)

Grokking of Diffusion Models: Case Study on Modular Addition
por: Kim, Joon Hyeok, et al.
Publicado: (2026)

Towards Empirical Interpretation of Internal Circuits and Properties in Grokked Transformers on Modular Polynomials
por: Furuta, Hiroki, et al.
Publicado: (2024)

Grokked Models are Better Unlearners
por: Liang, Yuanbang, et al.
Publicado: (2025)

Topological Signatures of Grokking
por: Tang, Yifan, et al.
Publicado: (2026)

ILDR: Geometric Early Detection of Grokking
por: Golwala, Shreel
Publicado: (2026)

Exploring Grokking: Experimental and Mechanistic Investigations
por: Qiye, Hu, et al.
Publicado: (2024)

Grokking Explained: A Statistical Phenomenon
por: Carvalho, Breno W., et al.
Publicado: (2025)

Revisiting Auxiliary Losses for Conditional Depth Routing: An Empirical Study
por: Lin, Qingwei
Publicado: (2026)

Distributional Spectral Diagnostics for Localizing Grokking Transitions
por: Wang, Ziyue, et al.
Publicado: (2026)

GrokAlign: Geometric Characterisation and Acceleration of Grokking
por: Walker, Thomas, et al.
Publicado: (2025)

Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond
por: Jeffares, Alan, et al.
Publicado: (2024)

Understanding Grokking Through A Robustness Viewpoint
por: Tan, Zhiquan, et al.
Publicado: (2023)

Egalitarian Gradient Descent: A Simple Approach to Accelerated Grokking
por: Pasand, Ali Saheb, et al.
Publicado: (2025)

Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study
por: Ma, Chi, et al.
Publicado: (2024)

Grokking in Linear Models for Logistic Regression
por: Das, Nataraj, et al.
Publicado: (2026)

Controlling Grokking with Nonlinearity and Data Symmetry
por: Salah, Ahmed, et al.
Publicado: (2024)

Latent Algorithmic Structure Precedes Grokking: A Mechanistic Study of ReLU MLPs on Modular Arithmetic
por: Swaroop, Anand
Publicado: (2026)

Explaining Grokking in Transformers through the Lens of Inductive Bias
por: Singh, Jaisidh, et al.
Publicado: (2026)

Beyond Progress Measures: Theoretical Insights into the Mechanism of Grokking
por: Gu, Zihan, et al.
Publicado: (2025)

Grokking Finite-Dimensional Algebra
por: Notsawo, Pascal Jr Tikeng, et al.
Publicado: (2026)

Grokking Group Multiplication with Cosets
por: Stander, Dashiell, et al.
Publicado: (2023)

Muon Optimizer Accelerates Grokking
por: Tveit, Amund, et al.
Publicado: (2025)

A Basin-Selection Perspective on Grokking via Singular Learning Theory
por: Cullen, Ben, et al.
Publicado: (2026)

Training Diverse Graph Experts for Ensembles: A Systematic Empirical Study
por: Deng, Gangda, et al.
Publicado: (2025)

The Geometric Inductive Bias of Grokking: Bypassing Phase Transitions via Architectural Topology
por: Yıldırım, Alper
Publicado: (2026)

Explaining Grokking and Information Bottleneck through Neural Collapse Emergence
por: Sakamoto, Keitaro, et al.
Publicado: (2025)