:: Library Catalog

Imagen de Portada

Guardado en:

Detalles Bibliográficos
Autores principales:	Miller, Jack, Gleeson, Patrick, O'Neill, Charles, Bui, Thang, Levi, Noam
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	https://arxiv.org/abs/2402.08946
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity
por: Miller, Jack, et al.
Publicado: (2023)

Sparse Autoencoders Enable Scalable and Reliable Circuit Identification in Language Models
por: O'Neill, Charles, et al.
Publicado: (2024)

Grokking at the Edge of Linear Separability
por: Beck, Alon, et al.
Publicado: (2024)

Self-Attention as a Parametric Endofunctor: A Categorical Framework for Transformer Architectures
por: O'Neill, Charles
Publicado: (2025)

Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding
por: Levi, Noam, et al.
Publicado: (2023)

Type 2 Tobit Sample Selection Models with Bayesian Additive Regression Trees
por: O'Neill, Eoghan
Publicado: (2025)

Compute Optimal Inference and Provable Amortisation Gap in Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2024)

Resurrecting the Salmon: Rethinking Mechanistic Interpretability with Domain-Specific Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2025)

Likelihood approximations via Gaussian approximate inference
por: Bui, Thang D.
Publicado: (2024)

A Simple Model of Inference Scaling Laws
por: Levi, Noam
Publicado: (2024)

Learning Shrinks the Hard Tail: Training-Dependent Inference Scaling in a Solvable Linear Model
por: Levi, Noam
Publicado: (2026)

Disentangling Dense Embeddings with Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2024)

Sketching the Heat Kernel: Using Gaussian Processes to Embed Data
por: Gilbert, Anna C., et al.
Publicado: (2024)

Beyond ReinMax: Low-Variance Gradient Estimators for Discrete Latent Variables
por: Wang, Daniel, et al.
Publicado: (2026)

Modelling the Doughnut of social and planetary boundaries with frugal machine learning
por: Vrizzi, Stefano, et al.
Publicado: (2025)

From superposition to sparse codes: interpretable representations in neural networks
por: Klindt, David, et al.
Publicado: (2025)

To Grok Grokking: Provable Grokking in Ridge Regression
por: Xu, Mingyue, et al.
Publicado: (2026)

Beyond Progress Measures: Theoretical Insights into the Mechanism of Grokking
por: Gu, Zihan, et al.
Publicado: (2025)

Progress Measures for Grokking on Real-world Tasks
por: Golechha, Satvik
Publicado: (2024)

A Single Direction of Truth: An Observer Model's Linear Residual Probe Exposes and Steers Contextual Hallucinations
por: O'Neill, Charles, et al.
Publicado: (2025)

Sparse Gaussian Processes: Structured Approximations and Power-EP Revisited
por: Bui, Thang D., et al.
Publicado: (2025)

CA-PCA: Manifold Dimension Estimation, Adapted for Curvature
por: Gilbert, Anna C., et al.
Publicado: (2023)

Low-Rank Key Value Attention
por: O'Neill, James, et al.
Publicado: (2026)

The Complexity Dynamics of Grokking
por: DeMoss, Branton, et al.
Publicado: (2024)

Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks
por: Minegishi, Gouki, et al.
Publicado: (2023)

The Implicit Bias of Logit Regularization
por: Beck, Alon, et al.
Publicado: (2026)

Classifying Overlapping Gaussian Mixtures in High Dimensions: From Optimal Classifiers to Neural Nets
por: Cohen, Khen, et al.
Publicado: (2024)

Late-Stage Generalization Collapse in Grokking: Detecting anti-grokking with Weightwatcher
por: Prakash, Hari K, et al.
Publicado: (2026)

The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets
por: Levi, Noam, et al.
Publicado: (2023)

Grokking and Generalization Collapse: Insights from \texttt{HTSR} theory
por: Prakash, Hari K., et al.
Publicado: (2025)

Tighter sparse variational Gaussian processes
por: Bui, Thang D., et al.
Publicado: (2025)

Grokked Models are Better Unlearners
por: Liang, Yuanbang, et al.
Publicado: (2025)

Topological Signatures of Grokking
por: Tang, Yifan, et al.
Publicado: (2026)

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition
por: Clauw, Kenzo, et al.
Publicado: (2024)

Pretraining Scaling Laws for Generative Evaluations of Language Models
por: Schaeffer, Rylan, et al.
Publicado: (2025)

Decoupled Weight Decay for Any $p$ Norm
por: Outmezguine, Nadav Joseph, et al.
Publicado: (2024)

Exploring Grokking: Experimental and Mechanistic Investigations
por: Qiye, Hu, et al.
Publicado: (2024)

ILDR: Geometric Early Detection of Grokking
por: Golwala, Shreel
Publicado: (2026)

Distributional Spectral Diagnostics for Localizing Grokking Transitions
por: Wang, Ziyue, et al.
Publicado: (2026)

GrokAlign: Geometric Characterisation and Acceleration of Grokking
por: Walker, Thomas, et al.
Publicado: (2025)