Cover Image

A Framework for Non-Linear Attention via Modern Hopfield Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Farooq, Ahmed
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Long-Sequence Memory with Temporal Kernels and Dense Hopfield Functionals
by: Farooq, Ahmed
Published: (2025)

Nonparametric Modern Hopfield Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Classifying States of the Hopfield Network with Improved Accuracy, Generalization, and Interpretability
by: McAlister, Hayden, et al.
Published: (2025)

Kernel Logistic Regression Learning for High-Capacity Hopfield Networks
by: Tamamori, Akira
Published: (2025)

Quantitative Attractor Analysis of High-Capacity Kernel Hopfield Networks
by: Tamamori, Akira
Published: (2025)

Kernel Ridge Regression for Efficient Learning of High-Capacity Hopfield Networks
by: Tamamori, Akira
Published: (2025)

Accelerating Hopfield Network Dynamics: Beyond Synchronous Updates and Forward Euler
by: Goemaere, Cédric, et al.
Published: (2023)

Prototype Analysis in Hopfield Networks with Hebbian Learning
by: McAlister, Hayden, et al.
Published: (2024)

Self-Organization and Spectral Mechanism of Attractor Landscapes in High-Capacity Kernel Hopfield Networks
by: Tamamori, Akira
Published: (2025)

Random Features Hopfield Networks generalize retrieval to previously unseen examples
by: Kalaj, Silvio, et al.
Published: (2024)

Geometric and dynamical analysis of attractor boundaries and storage limits in kernel Hopfield networks
by: Tamamori, Akira
Published: (2026)

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

MDN: Parallelizing Stepwise Momentum for Delta Linear Attention
by: Huang, Yulong, et al.
Published: (2026)

NiSNN-A: Non-iterative Spiking Neural Networks with Attention with Application to Motor Imagery EEG Classification
by: Zhang, Chuhan, et al.
Published: (2023)

Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
by: Pierro, Alessandro, et al.
Published: (2025)

Equivariant Neural Networks for General Linear Symmetries on Lie Algebras
by: Kim, Chankyo, et al.
Published: (2025)

CGP++ : A Modern C++ Implementation of Cartesian Genetic Programming
by: Kalkreuth, Roman, et al.
Published: (2024)

Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues
by: Orvieto, Antonio, et al.
Published: (2023)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
by: Kutsuna, Takuro
Published: (2024)

GT-SNT: A Linear-Time Transformer for Large-Scale Graphs via Spiking Node Tokenization
by: Zhang, Huizhe, et al.
Published: (2025)

Rethinking Deep Learning: Non-backpropagation and Non-optimization Machine Learning Approach Using Hebbian Neural Networks
by: Itoh, Kei
Published: (2024)

Modern Hopfield Networks meet Encoded Neural Representations -- Addressing Practical Considerations
by: Kashyap, Satyananda, et al.
Published: (2024)

Recurrent Neural Networks Learn to Store and Generate Sequences using Non-Linear Representations
by: Csordás, Róbert, et al.
Published: (2024)

Non-linear PCA via Evolution Strategies: a Novel Objective Function
by: Uriot, Thomas, et al.
Published: (2026)

Probabilistically Rewired Message-Passing Neural Networks
by: Qian, Chendi, et al.
Published: (2023)

SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attention
by: Sun, Yundong, et al.
Published: (2024)

Learning by the F-adjoint
by: Boughammoura, Ahmed
Published: (2024)

Amorphous Solid Model of Vectorial Hopfield Neural Networks
by: Gallavotti, F., et al.
Published: (2025)

FGATT: A Robust Framework for Wireless Data Imputation Using Fuzzy Graph Attention Networks and Transformer Encoders
by: Xing, Jinming, et al.
Published: (2024)

Hopfield Networks Meet Big Data: A Brain-Inspired Deep Learning Framework for Semantic Data Linking
by: Kannan, Ashwin Viswanathan, et al.
Published: (2025)

On Non-Linear operators for Geometric Deep Learning
by: Sergeant-Perthuis, Grégoire, et al.
Published: (2022)

Spatiotemporal Forecasting of Traffic Flow using Wavelet-based Temporal Attention
by: Jakhmola, Yash, et al.
Published: (2024)

Online Training of Hopfield Networks using Predictive Coding
by: Ganjidoost, Ehsan, et al.
Published: (2024)

Self-Motivated Growing Neural Network for Adaptive Architecture via Local Structural Plasticity
by: Jia, Yiyang, et al.
Published: (2025)

Neuromorphic Graph Anomaly Detection via Adaptive STDP and Spiking Graph Neural Networks
by: Fofanah, Abdul Joseph, et al.
Published: (2026)

AlphaGrad: Non-Linear Gradient Normalization Optimizer
by: Sane, Soham
Published: (2025)

Hierarchical Kernel Transformer: Multi-Scale Attention with an Information-Theoretic Approximation Analysis
by: Cirrincione, Giansalvo
Published: (2026)

A Simple Generative Network
by: Nissani, Daniel N.
Published: (2021)

ReLiCADA -- Reservoir Computing using Linear Cellular Automata Design Algorithm
by: Kantic, Jonas, et al.
Published: (2023)

Stable and Robust Deep Learning By Hyperbolic Tangent Exponential Linear Unit (TeLU)
by: Fernandez, Alfredo, et al.
Published: (2024)