Cover Image

Differential learning kinetics govern the transition from memorization to generalization during in-context learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Alex, Reddy, Gautam
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Disordered Systems and Neural Networks Artificial Intelligence Neural and Evolutionary Computing Neurons and Cognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Neural Langevin Machine: a local asymmetric learning rule can be creative
by: Yu, Zhendong, et al.
Published: (2025)

Simplified derivations for high-dimensional convex learning problems
by: Clark, David G., et al.
Published: (2024)

Spiking mode-based neural networks
by: Lin, Zhanghan, et al.
Published: (2023)

DeepNose: An Equivariant Convolutional Neural Network Predictive Of Human Olfactory Percepts
by: Shuvaev, Sergey, et al.
Published: (2024)

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks
by: Umar, Ali Hussaini, et al.
Published: (2026)

Fermi-Bose Machine achieves both generalization and adversarial robustness
by: Xie, Mingshan, et al.
Published: (2024)

Structure of activity in multiregion recurrent neural networks
by: Clark, David G., et al.
Published: (2024)

Connectivity structure and dynamics of nonlinear recurrent neural networks
by: Clark, David G., et al.
Published: (2024)

Identifying the impact of local connectivity patterns on dynamics in excitatory-inhibitory networks
by: Shao, Yuxiu, et al.
Published: (2024)

Response time of lateral predictive coding and benefits of modular structures
by: Cai, Guanghui, et al.
Published: (2026)

Theory of coupled neuronal-synaptic dynamics
by: Clark, David G., et al.
Published: (2023)

Sketch of a novel approach to a neural model
by: Scheler, Gabriele
Published: (2022)

Learning in Wilson-Cowan model for metapopulation
by: Marino, Raffaele, et al.
Published: (2024)

Heterosynaptic Circuits Are Universal Gradient Machines
by: Ziyin, Liu, et al.
Published: (2025)

Nonlinear classification of neural manifolds with contextual information
by: Mignacco, Francesca, et al.
Published: (2024)

Dynamical stability for dense patterns in discrete attractor neural networks
by: Cohen, Uri, et al.
Published: (2025)

Neural population geometry and optimal coding of tasks with shared latent structure
by: Wakhloo, Albert J., et al.
Published: (2024)

A Dynamical Theory of Sequential Retrieval in Input-Driven Hopfield Networks
by: Betteti, Simone, et al.
Published: (2026)

Freezing chaos without synaptic plasticity
by: Huang, Weizhong, et al.
Published: (2025)

Analytically tractable model of synaptic crowding explains emergent small-world structure and network dynamics
by: Fukushima, Makoto
Published: (2026)

When can in-context learning generalize out of task distribution?
by: Goddard, Chase, et al.
Published: (2025)

A generalized neural tangent kernel for surrogate gradient learning
by: Eilers, Luke, et al.
Published: (2024)

Dreaming improves memorization in a Hopfield model with bounded synaptic strength
by: Marinari, Enzo, et al.
Published: (2026)

Theories of synaptic memory consolidation and intelligent plasticity for continual learning
by: Zenke, Friedemann, et al.
Published: (2024)

The dynamic interplay between in-context and in-weight learning in humans and neural networks
by: Russin, Jacob, et al.
Published: (2024)

Hierarchy of chaotic dynamics in random modular networks
by: Kuśmierz, Łukasz, et al.
Published: (2024)

Sparse learning enabled by constraints on connectivity and function
by: Baig, Mirza M. Junaid, et al.
Published: (2024)

Task learning through stimulation-induced plasticity in neural networks
by: Borra, Francesco, et al.
Published: (2024)

Competitive plasticity to reduce the energetic costs of learning
by: van Rossum, Mark CW
Published: (2023)

Self-organized learning emerges from coherent coupling of critical neurons
by: Liu, Chuanbo, et al.
Published: (2025)

Self-supervised local learning rules learn the hidden hierarchical structure of high-dimensional data
by: Delrocq, Ariane, et al.
Published: (2026)

Consciousness is entailed by compositional learning of new causal structures in deep predictive processing systems
by: Aksyuk, V. A.
Published: (2023)

How connectivity structure shapes rich and lazy learning in neural circuits
by: Liu, Yuhan Helena, et al.
Published: (2023)

Implementing engrams from a machine learning perspective: XOR as a basic motif
by: de Lucas, Jesus Marco, et al.
Published: (2024)

State-space kinetic Ising model reveals task-dependent entropy flow in sparsely active nonequilibrium neuronal dynamics
by: Ishihara, Ken, et al.
Published: (2025)

A statistical physics framework for optimal learning
by: Mignacco, Francesca, et al.
Published: (2025)

Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning
by: Chavlis, Spyridon, et al.
Published: (2024)

Spectral Analysis of Representational Similarity with Limited Neurons
by: Kang, Hyunmo, et al.
Published: (2025)

Learning Curves for Noisy Heterogeneous Feature-Subsampled Ridge Ensembles
by: Ruben, Benjamin S., et al.
Published: (2023)

L1-Regularized ICA: A Novel Method for Analysis of Task-related fMRI Data
by: Endo, Yusuke, et al.
Published: (2024)