Cover Image

Recurrent Self-Attention Dynamics: An Energy-Agnostic Perspective from Jacobians

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tomihari, Akiyoshi, Karakida, Ryo
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Disordered Systems and Neural Networks Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking
by: Karakida, Ryo, et al.
Published: (2024)

Dropout Universality: Scaling Laws and Optimal Scheduling at the Edge-of-Chaos
by: Sarmiento, Lucas Fernandez
Published: (2026)

Random Features Hopfield Networks generalize retrieval to previously unseen examples
by: Kalaj, Silvio, et al.
Published: (2024)

Thermal Robustness of Retrieval in Dense Associative Memories: LSE vs LSR Kernels
by: Petrova, Tatiana
Published: (2026)

Supervised Hebbian Learning
by: Alemanno, Francesco, et al.
Published: (2022)

Prototype Analysis in Hopfield Networks with Hebbian Learning
by: McAlister, Hayden, et al.
Published: (2024)

Pruning-induced phases in fully-connected neural networks: the eumentia, the dementia, and the amentia
by: Pan, Haining, et al.
Published: (2026)

Preisach Attention: A Hysteretic Model of Sequential Memory
by: Frydrych, Piotr
Published: (2026)

Polychronous Wave Computing: Timing-Native Address Selection in Spiking Networks
by: Berloff, Natalila G.
Published: (2026)

How noise affects memory in linear recurrent networks
by: Guan, JingChuan, et al.
Published: (2024)

Evidence of Scaling Regimes in the Hopfield Dynamics of Whole Brain Model
by: Gosti, Giorgio, et al.
Published: (2024)

Connecting phases of matter to the flatness of the loss landscape in analog variational quantum algorithms
by: Srimahajariyapong, Kasidit, et al.
Published: (2025)

Role of scrambling and noise in temporal information processing with quantum systems
by: Xiong, Weijie, et al.
Published: (2025)

Neural Langevin Machine: a local asymmetric learning rule can be creative
by: Yu, Zhendong, et al.
Published: (2025)

DeepNose: An Equivariant Convolutional Neural Network Predictive Of Human Olfactory Percepts
by: Shuvaev, Sergey, et al.
Published: (2024)

Dependence of Equilibrium Propagation Training Success on Network Architecture
by: Wang, Qingshan, et al.
Published: (2026)

Polariton lattices as binarized neuromorphic networks
by: Sedov, Evgeny, et al.
Published: (2024)

Predictive Coding Graphs are a Superset of Feedforward Neural Networks
by: van Zwol, Björn
Published: (2026)

Dataset-learning duality and emergent criticality
by: Kukleva, Ekaterina, et al.
Published: (2024)

Nature-Inspired Local Propagation
by: Betti, Alessandro, et al.
Published: (2024)

Approximation Theory for Neural Networks: Old and New
by: Mukherjee, Soumendu Sundar, et al.
Published: (2026)

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks
by: Umar, Ali Hussaini, et al.
Published: (2026)

Thermodynamics of bidirectional associative memories
by: Barra, Adriano, et al.
Published: (2022)

Predictive Coding Networks and Inference Learning: Tutorial and Survey
by: van Zwol, Björn, et al.
Published: (2024)

Dynamical stability for dense patterns in discrete attractor neural networks
by: Cohen, Uri, et al.
Published: (2025)

Memory Uncertainty Relation and Harmonic Memory in Random Recurrent Networks
by: Haruna, Taichi, et al.
Published: (2026)

Understanding Transformer Optimization via Gradient Heterogeneity
by: Tomihari, Akiyoshi, et al.
Published: (2025)

Adaptive Synaptogenesis Implemented on a Nanomagnetic Platform
by: Mullick, Faiyaz Elahi, et al.
Published: (2025)

iMixer: hierarchical Hopfield network implies an invertible, implicit and iterative MLP-Mixer
by: Ota, Toshihiro, et al.
Published: (2023)

Differential learning kinetics govern the transition from memorization to generalization during in-context learning
by: Nguyen, Alex, et al.
Published: (2024)

Heterosynaptic Circuits Are Universal Gradient Machines
by: Ziyin, Liu, et al.
Published: (2025)

A Generative Neural Annealer for Black-Box Combinatorial Optimization
by: Zhang, Yuan-Hang, et al.
Published: (2025)

Nonlinear classification of neural manifolds with contextual information
by: Mignacco, Francesca, et al.
Published: (2024)

Exploring Structural Nonlinearity in Binary Polariton-Based Neuromorphic Architectures
by: Sedov, Evgeny, et al.
Published: (2024)

Neural population geometry and optimal coding of tasks with shared latent structure
by: Wakhloo, Albert J., et al.
Published: (2024)

Fermi-Bose Machine achieves both generalization and adversarial robustness
by: Xie, Mingshan, et al.
Published: (2024)

A Dynamical Theory of Sequential Retrieval in Input-Driven Hopfield Networks
by: Betteti, Simone, et al.
Published: (2026)

Structure of activity in multiregion recurrent neural networks
by: Clark, David G., et al.
Published: (2024)

Connectivity structure and dynamics of nonlinear recurrent neural networks
by: Clark, David G., et al.
Published: (2024)

Simplified derivations for high-dimensional convex learning problems
by: Clark, David G., et al.
Published: (2024)