Cover Image

Continual Learning in Modern Hopfield Networks with an Application to Diffusion Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Takeda, Ken, Oizumi, Masafumi, Karakida, Ryo
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Modern Hopfield Networks with Continuous-Time Memories
by: Santos, Saul, et al.
Published: (2025)

Understanding MLP-Mixer as a Wide and Sparse MLP
by: Hayase, Tomohiro, et al.
Published: (2023)

On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width
by: Ishikawa, Satoki, et al.
Published: (2023)

Self-attention Networks Localize When QK-eigenspectrum Concentrates
by: Bao, Han, et al.
Published: (2024)

Rectified Lagrangian for Out-of-Distribution Detection in Modern Hopfield Networks
by: Moriai, Ryo, et al.
Published: (2025)

The Impact of Anisotropic Covariance Structure on the Training Dynamics and Generalization Error of Linear Networks
by: Watanabe, Taishi, et al.
Published: (2026)

Optimal Layer Selection for Latent Data Augmentation
by: Takase, Tomoumi, et al.
Published: (2024)

Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation
by: Ishikawa, Satoki, et al.
Published: (2024)

Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs
by: Sakai, Mana, et al.
Published: (2025)

Recurrent Self-Attention Dynamics: An Energy-Agnostic Perspective from Jacobians
by: Tomihari, Akiyoshi, et al.
Published: (2025)

Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix
by: Hayase, Tomohiro, et al.
Published: (2025)

Nonparametric Modern Hopfield Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

Geometry-Aware Attention Guidance for Diffusion Models via Modern Hopfield Dynamics
by: Kim, Kwanyoung
Published: (2026)

On the Role of Hidden States of Modern Hopfield Network in Transformer
by: Masumura, Tsubasa, et al.
Published: (2025)

A Unified Framework for Critical Scaling of Inverse Temperature in Self-Attention
by: Hayase, Tomohiro, et al.
Published: (2026)

Investigating Fine- and Coarse-grained Structural Correspondences Between Deep Neural Networks and Human Object Image Similarity Judgments Using Unsupervised Alignment
by: Takahashi, Soh, et al.
Published: (2025)

Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models
by: Wu, Dennis, et al.
Published: (2024)

A Framework for Non-Linear Attention via Modern Hopfield Networks
by: Farooq, Ahmed
Published: (2025)

Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking
by: Karakida, Ryo, et al.
Published: (2024)

Sparse and Structured Hopfield Networks
by: Santos, Saul, et al.
Published: (2024)

Modern Hopfield Networks meet Encoded Neural Representations -- Addressing Practical Considerations
by: Kashyap, Satyananda, et al.
Published: (2024)

On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysis
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

BiSHop: Bi-Directional Cellular Learning for Tabular Data with Generalized Sparse Modern Hopfield Model
by: Xu, Chenwei, et al.
Published: (2024)

Stochastic Attention via Langevin Dynamics on the Modern Hopfield Energy
by: Alswaidan, Abdulrahman, et al.
Published: (2026)

Improving Out-of-Distribution Data Handling and Corruption Resistance via Modern Hopfield Networks
by: Sargolzaei, Saleh, et al.
Published: (2024)

Hopfield Networks for Asset Allocation
by: Nicolini, Carlo, et al.
Published: (2024)

Adaptive Hopfield Network: Rethinking Similarities in Associative Memory
by: Wang, Shurong, et al.
Published: (2025)

TSPDiffuser: Diffusion Models as Learned Samplers for Traveling Salesperson Path Planning Problems
by: Yonetani, Ryo
Published: (2024)

Kernel Logistic Regression Learning for High-Capacity Hopfield Networks
by: Tamamori, Akira
Published: (2025)

Formalized Hopfield Networks and Boltzmann Machines
by: Cipollina, Matteo, et al.
Published: (2025)

Modern Hopfield Networks Require Chain-of-Thought to Solve $\mathsf{NC}^1$-Hard Problems
by: Cao, Yang, et al.
Published: (2024)

Prototype Analysis in Hopfield Networks with Hebbian Learning
by: McAlister, Hayden, et al.
Published: (2024)

Beyond Fixed Points: Superpolynomial Capacity of Asymmetric Hopfield Networks
by: Kumar, Aakash, et al.
Published: (2026)

Neural Pathways to Program Success: Hopfield Networks for PERT Analysis
by: Ahamed, Azgar Ali Noor
Published: (2025)

Vision Hopfield Memory Networks
by: Wang, Jianfeng, et al.
Published: (2026)

Kernel Ridge Regression for Efficient Learning of High-Capacity Hopfield Networks
by: Tamamori, Akira
Published: (2025)

Balancing Fidelity and Diversity in Diffusion Models via Symmetric Attention Decomposition: Hopfield Perspective
by: Cho, Hyunmin, et al.
Published: (2026)

Hopfield-Fenchel-Young Networks: A Unified Framework for Associative Memory Retrieval
by: Santos, Saul, et al.
Published: (2024)

Dynamic Manifold Hopfield Networks for Context-Dependent Associative Memory
by: Li, Chong, et al.
Published: (2025)

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)