Imagen de Portada

Dynamically Learning to Integrate in Recurrent Neural Networks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Bordelon, Blake, Cotler, Jordan, Pehlevan, Cengiz, Zavatone-Veth, Jacob A.
Formato:	Preprint
Publicado:	2025
Materias:	Neurons and Cognition Disordered Systems and Neural Networks Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Learning Curves for Noisy Heterogeneous Feature-Subsampled Ridge Ensembles
por: Ruben, Benjamin S., et al.
Publicado: (2023)

Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models
por: Atanasov, Alexander, et al.
Publicado: (2025)

Dynamical Learning in Deep Asymmetric Recurrent Neural Networks
por: Badalotti, Davide, et al.
Publicado: (2025)

Nadaraya-Watson kernel smoothing as a random energy model
por: Zavatone-Veth, Jacob A., et al.
Publicado: (2024)

Summary statistics of learning link changing neural representations to behavior
por: Zavatone-Veth, Jacob A., et al.
Publicado: (2025)

Disordered Dynamics in High Dimensions: Connections to Random Matrices and Machine Learning
por: Bordelon, Blake, et al.
Publicado: (2026)

Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer
por: Bordelon, Blake, et al.
Publicado: (2025)

Risk and cross validation in ridge regression with correlated samples
por: Atanasov, Alexander, et al.
Publicado: (2024)

Scaling and renormalization in high-dimensional regression
por: Atanasov, Alexander, et al.
Publicado: (2024)

A Dynamical Model of Neural Scaling Laws
por: Bordelon, Blake, et al.
Publicado: (2024)

A note on the dynamics of extended-context disordered kinetic spin models
por: Zavatone-Veth, Jacob A., et al.
Publicado: (2025)

Transfer Learning in Infinite Width Feature Learning Networks
por: Lauditi, Clarissa, et al.
Publicado: (2025)

How Feature Learning Can Improve Neural Scaling Laws
por: Bordelon, Blake, et al.
Publicado: (2024)

Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks
por: Mannelli, Stefano Sarao, et al.
Publicado: (2024)

Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer
por: Lauditi, Clarissa, et al.
Publicado: (2026)

How does training shape the Riemannian geometry of neural network representations?
por: Zavatone-Veth, Jacob A., et al.
Publicado: (2023)

Infinite Limits of Multi-head Transformer Dynamics
por: Bordelon, Blake, et al.
Publicado: (2024)

Collective Dynamics in Spiking Neural Networks Beyond Dale's Principle
por: Ah-Weng, Ross, et al.
Publicado: (2026)

Adaptive kernel predictors from feature-learning infinite limits of neural networks
por: Lauditi, Clarissa, et al.
Publicado: (2025)

DeepNose: An Equivariant Convolutional Neural Network Predictive Of Human Olfactory Percepts
por: Shuvaev, Sergey, et al.
Publicado: (2024)

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks
por: Umar, Ali Hussaini, et al.
Publicado: (2026)

Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time
por: Bordelon, Blake, et al.
Publicado: (2025)

Spectral Analysis of Representational Similarity with Limited Neurons
por: Kang, Hyunmo, et al.
Publicado: (2025)

Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networks
por: Takasu, Shotaro, et al.
Publicado: (2025)

Proof of a perfect platonic representation hypothesis
por: Ziyin, Liu, et al.
Publicado: (2025)

L1-Regularized ICA: A Novel Method for Analysis of Task-related fMRI Data
por: Endo, Yusuke, et al.
Publicado: (2024)

Statistical Mechanics of Support Vector Regression
por: Canatar, Abdulkadir, et al.
Publicado: (2024)

Solving adversarial examples requires solving exponential misalignment
por: Salvatore, Alessandro, et al.
Publicado: (2026)

Integrated Information Decomposition Unveils Major Structural Traits of $In$ $Silico$ and $In$ $Vitro$ Neuronal Networks
por: Menesse, Gustavo, et al.
Publicado: (2024)

Responses to transient perturbation can distinguish intrinsic from latent criticality in spiking neural populations
por: Crosser, Jacob T., et al.
Publicado: (2025)

Applications of information geometry to spiking neural network behavior
por: Crosser, Jacob T., et al.
Publicado: (2023)

Grokking as the Transition from Lazy to Rich Training Dynamics
por: Kumar, Tanishq, et al.
Publicado: (2023)

Neural Langevin Machine: a local asymmetric learning rule can be creative
por: Yu, Zhendong, et al.
Publicado: (2025)

Asymptotic theory of in-context learning by linear attention
por: Lu, Yue M., et al.
Publicado: (2024)

Linear Readout of Neural Manifolds with Continuous Variables
por: Slatton, Will, et al.
Publicado: (2026)

Non-Equilibrium Stochastic Dynamics as a Unified Framework for Insight and Repetitive Learning: A Kramers Escape Approach to Continual Learning
por: Kim, Gunn
Publicado: (2026)

Astrocytic NMDA Receptors Modulate the Dynamics of Continuous Attractors
por: Liu, Zihan, et al.
Publicado: (2024)

A generalized neural tangent kernel for surrogate gradient learning
por: Eilers, Luke, et al.
Publicado: (2024)

Energy-Based Dynamical Models for Neurocomputation, Learning, and Optimization
por: Montanari, Arthur N., et al.
Publicado: (2026)

Why Do Animals Need Shaping? A Theory of Task Composition and Curriculum Learning
por: Lee, Jin Hwa, et al.
Publicado: (2024)