Cover Image

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Jerry Yao-Chieh, Wu, Dennis, Liu, Han
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Nonparametric Modern Hopfield Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction
by: Wu, Dennis, et al.
Published: (2023)

Long-Sequence Memory with Temporal Kernels and Dense Hopfield Functionals
by: Farooq, Ahmed
Published: (2025)

Sequential Learning in the Dense Associative Memory
by: McAlister, Hayden, et al.
Published: (2024)

Word2Spike: Poisson Rate Coding for Associative Memories and Neuromorphic Algorithms
by: Kalra, Archit, et al.
Published: (2025)

Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models
by: Wu, Dennis, et al.
Published: (2024)

Dynamics of Structured Complex-Valued Hopfield Neural Networks
by: Garimella, Rama Murthy, et al.
Published: (2025)

Memory Capacity Analysis of Time-delay Reservoir Computing Based on Silicon Microring Resonator Nonlinearities
by: Castro, Bernard J. Giron, et al.
Published: (2024)

Novel Complex-Valued Hopfield Neural Networks with Phase and Magnitude Quantization
by: Ramamurthy, Garimella, et al.
Published: (2025)

Dense Associative Memories with Analog Circuits
by: Bacvanski, Marc Gong, et al.
Published: (2025)

EngramNCA: a Neural Cellular Automaton Model of Memory Transfer
by: Guichard, Etienne, et al.
Published: (2025)

A Crowding Distance That Provably Solves the Difficulties of the NSGA-II in Many-Objective Optimization
by: Zheng, Weijie, et al.
Published: (2024)

Memory-Driven Metaheuristics: Improving Optimization Performance
by: Farahmand-Tabar, Salar
Published: (2024)

LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling
by: Xie, Keqin
Published: (2026)

Memory-DD: A Low-Complexity Dendrite-Inspired Neuron for Temporal Prediction Tasks
by: Yang, Dongjian, et al.
Published: (2025)

MARCO: A Memory-Augmented Reinforcement Framework for Combinatorial Optimization
by: Garmendia, Andoni I., et al.
Published: (2024)

Memory Mosaics
by: Zhang, Jianyu, et al.
Published: (2024)

Evolutionary Multi-Objective Optimisation for Fairness-Aware Self Adjusting Memory Classifiers in Data Streams
by: Amarasinghe, Pivithuru Thejan, et al.
Published: (2024)

Already Moderate Population Sizes Provably Yield Strong Robustness to Noise
by: Antipov, Denis, et al.
Published: (2024)

Stochastic Population Update Can Provably Be Helpful in Multi-Objective Evolutionary Algorithms
by: Bian, Chao, et al.
Published: (2023)

Graph Memory Learning: Imitating Lifelong Remembering and Forgetting of Brain Networks
by: Miao, Jiaxing, et al.
Published: (2024)

Evolutionary Reinforcement Learning via Cooperative Coevolution
by: Hu, Chengpeng, et al.
Published: (2024)

Enabling Robust In-Context Memory and Rapid Task Adaptation in Transformers with Hebbian and Gradient-Based Plasticity
by: Chaudhary, Siddharth
Published: (2025)

Preisach Attention: A Hysteretic Model of Sequential Memory
by: Frydrych, Piotr
Published: (2026)

Oscillator-Based Associative Memory with Exponential Capacity: Theory, Algorithms, and Hardware Implementation
by: Ogranovich, Arie, et al.
Published: (2026)

Provable Benefits of Complex Parameterizations for Structured State Space Models
by: Ran-Milo, Yuval, et al.
Published: (2024)

Evolve Cost-aware Acquisition Functions Using Large Language Models
by: Yao, Yiming, et al.
Published: (2024)

Learning Successor Features with Distributed Hebbian Temporal Memory
by: Dzhivelikian, Evgenii, et al.
Published: (2023)

Memory Networks: Towards Fully Biologically Plausible Learning
by: Ruiz, Jacobo, et al.
Published: (2024)

A Genetic Algorithm for Multi-Capacity Fixed-Charge Flow Network Design
by: Eardley, Caleb, et al.
Published: (2024)

Exploring Synaptic Resonance in Large Language Models: A Novel Approach to Contextual Memory Integration
by: Applegarth, George, et al.
Published: (2025)

Code Evolution Graphs: Understanding Large Language Model Driven Design of Algorithms
by: van Stein, Niki, et al.
Published: (2025)

Improved Robustness and Hyperparameter Selection in the Dense Associative Memory
by: McAlister, Hayden, et al.
Published: (2024)

Robust Dynamic Material Handling via Adaptive Constrained Evolutionary Reinforcement Learning
by: Hu, Chengpeng, et al.
Published: (2025)

Analog Alchemy: Neural Computation with In-Memory Inference, Learning and Routing
by: Demirag, Yigit
Published: (2024)

The Price of Meaning: Why Every Semantic Memory System Forgets
by: Barman, Sambartha Ray, et al.
Published: (2026)

Modality-Dependent Memory Mechanisms in Cross-Modal Neuromorphic Computing
by: Blessing, Effiong, et al.
Published: (2025)

A Unified Cortical Circuit Model with Divisive Normalization and Self-Excitation for Robust Representation and Memory Maintenance
by: Su, Jie, et al.
Published: (2025)

Measuring the Measures: Discriminative Capacity of Representational Similarity Metrics Across Model Families
by: Wu, Jialin, et al.
Published: (2025)

QSLM: A Performance- and Memory-aware Quantization Framework with Tiered Search Strategy for Spike-driven Language Models
by: Putra, Rachmad Vidya Wicaksana, et al.
Published: (2026)