Saved in:
| Main Authors: | Lufkin, Leon, Saxe, Andrew M., Grant, Erin |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.17284 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Hybrid Associative Memories
by: Lufkin, Leon, et al.
Published: (2026)
by: Lufkin, Leon, et al.
Published: (2026)
Early learning of the optimal constant solution in neural networks and humans
by: Rubruck, Jirko, et al.
Published: (2024)
by: Rubruck, Jirko, et al.
Published: (2024)
Temporal receptive field in dynamic graph learning: A comprehensive analysis
by: Karmim, Yannis, et al.
Published: (2024)
by: Karmim, Yannis, et al.
Published: (2024)
Covariant spatio-temporal receptive fields for spiking neural networks
by: Pedersen, Jens Egholm, et al.
Published: (2024)
by: Pedersen, Jens Egholm, et al.
Published: (2024)
Algorithm Development in Neural Networks: Insights from the Streaming Parity Task
by: van Rossem, Loek, et al.
Published: (2025)
by: van Rossem, Loek, et al.
Published: (2025)
When Representations Align: Universality in Representation Learning Dynamics
by: van Rossem, Loek, et al.
Published: (2024)
by: van Rossem, Loek, et al.
Published: (2024)
Softmax $\geq$ Linear: Transformers may learn to classify in-context by kernel gradient descent
by: Dragutinović, Sara, et al.
Published: (2025)
by: Dragutinović, Sara, et al.
Published: (2025)
Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures
by: Zhang, Yedi, et al.
Published: (2025)
by: Zhang, Yedi, et al.
Published: (2025)
Understanding Unimodal Bias in Multimodal Deep Linear Networks
by: Zhang, Yedi, et al.
Published: (2023)
by: Zhang, Yedi, et al.
Published: (2023)
When Are Bias-Free ReLU Networks Effectively Linear Networks?
by: Zhang, Yedi, et al.
Published: (2024)
by: Zhang, Yedi, et al.
Published: (2024)
Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks
by: Jarvis, Devon, et al.
Published: (2025)
by: Jarvis, Devon, et al.
Published: (2025)
On The Specialization of Neural Modules
by: Jarvis, Devon, et al.
Published: (2024)
by: Jarvis, Devon, et al.
Published: (2024)
On the locality of local neural operator in learning fluid dynamics
by: Ye, Ximeng, et al.
Published: (2023)
by: Ye, Ximeng, et al.
Published: (2023)
Meta-Learning Strategies through Value Maximization in Neural Networks
by: Carrasco-Davis, Rodrigo, et al.
Published: (2023)
by: Carrasco-Davis, Rodrigo, et al.
Published: (2023)
Revisiting the Role of Relearning in Semantic Dementia
by: Jarvis, Devon, et al.
Published: (2025)
by: Jarvis, Devon, et al.
Published: (2025)
Training Dynamics of In-Context Learning in Linear Attention
by: Zhang, Yedi, et al.
Published: (2025)
by: Zhang, Yedi, et al.
Published: (2025)
Optimal Representation Size: High-Dimensional Analysis of Pretraining and Linear Probing
by: Njaradi, Valentina, et al.
Published: (2026)
by: Njaradi, Valentina, et al.
Published: (2026)
Distinct Computations Emerge From Compositional Curricula in In-Context Learning
by: Lee, Jin Hwa, et al.
Published: (2025)
by: Lee, Jin Hwa, et al.
Published: (2025)
A Theory of Initialisation's Impact on Specialisation
by: Jarvis, Devon, et al.
Published: (2025)
by: Jarvis, Devon, et al.
Published: (2025)
What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation
by: Singh, Aaditya K., et al.
Published: (2024)
by: Singh, Aaditya K., et al.
Published: (2024)
A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning
by: Anguita, Nicolas, et al.
Published: (2026)
by: Anguita, Nicolas, et al.
Published: (2026)
Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks
by: Mannelli, Stefano Sarao, et al.
Published: (2024)
by: Mannelli, Stefano Sarao, et al.
Published: (2024)
Optimal Learning Rate Schedule for Balancing Effort and Performance
by: Njaradi, Valentina, et al.
Published: (2026)
by: Njaradi, Valentina, et al.
Published: (2026)
Strategy Coopetition Explains the Emergence and Transience of In-Context Learning
by: Singh, Aaditya K., et al.
Published: (2025)
by: Singh, Aaditya K., et al.
Published: (2025)
Flexible task abstractions emerge in linear networks with fast and bounded units
by: Sandbrink, Kai, et al.
Published: (2024)
by: Sandbrink, Kai, et al.
Published: (2024)
The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions
by: Patel, Nishil, et al.
Published: (2023)
by: Patel, Nishil, et al.
Published: (2023)
Unified all-atom molecule generation with neural fields
by: Kirchmeyer, Matthieu, et al.
Published: (2025)
by: Kirchmeyer, Matthieu, et al.
Published: (2025)
Machine Learning-Augmented Optimization of Large Bilevel and Two-stage Stochastic Programs: Application to Cycling Network Design
by: Chan, Timothy C. Y., et al.
Published: (2022)
by: Chan, Timothy C. Y., et al.
Published: (2022)
Nonlinear subspace clustering by functional link neural networks
by: Shi, Long, et al.
Published: (2024)
by: Shi, Long, et al.
Published: (2024)
From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks
by: Dominé, Clémentine C. J., et al.
Published: (2024)
by: Dominé, Clémentine C. J., et al.
Published: (2024)
Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning
by: Kunin, Daniel, et al.
Published: (2024)
by: Kunin, Daniel, et al.
Published: (2024)
Graph neural network force fields for adiabatic dynamics of lattice Hamiltonians
by: Fan, Yunhao, et al.
Published: (2026)
by: Fan, Yunhao, et al.
Published: (2026)
Intrinsic training dynamics of deep neural networks
by: Marcotte, Sibylle, et al.
Published: (2025)
by: Marcotte, Sibylle, et al.
Published: (2025)
Nonlinear functional regression by functional deep neural network with kernel embedding
by: Shi, Zhongjie, et al.
Published: (2024)
by: Shi, Zhongjie, et al.
Published: (2024)
Active learning of neural population dynamics using two-photon holographic optogenetics
by: Wagenmaker, Andrew, et al.
Published: (2024)
by: Wagenmaker, Andrew, et al.
Published: (2024)
Mixture of neural fields for heterogeneous reconstruction in cryo-EM
by: Levy, Axel, et al.
Published: (2024)
by: Levy, Axel, et al.
Published: (2024)
Graph neural networks informed locally by thermodynamics
by: Tierz, Alicia, et al.
Published: (2024)
by: Tierz, Alicia, et al.
Published: (2024)
BERTology of Molecular Property Prediction
by: Mostafanejad, Mohammad, et al.
Published: (2026)
by: Mostafanejad, Mohammad, et al.
Published: (2026)
Sharp Information-Theoretic Thresholds for Shuffled Linear Regression
by: Lufkin, Leon, et al.
Published: (2024)
by: Lufkin, Leon, et al.
Published: (2024)
Comparison of neural network training strategies for the simulation of dynamical systems
by: Strasser, Paul, et al.
Published: (2025)
by: Strasser, Paul, et al.
Published: (2025)
Similar Items
-
Hybrid Associative Memories
by: Lufkin, Leon, et al.
Published: (2026) -
Early learning of the optimal constant solution in neural networks and humans
by: Rubruck, Jirko, et al.
Published: (2024) -
Temporal receptive field in dynamic graph learning: A comprehensive analysis
by: Karmim, Yannis, et al.
Published: (2024) -
Covariant spatio-temporal receptive fields for spiking neural networks
by: Pedersen, Jens Egholm, et al.
Published: (2024) -
Algorithm Development in Neural Networks: Insights from the Streaming Parity Task
by: van Rossem, Loek, et al.
Published: (2025)