Analysis of the Hopfield Model Incorporating the Effects of Unlearning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Takeuchi, Shuta, Takahashi, Takashi, Kabashima, Yoshiyuki
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914315517296640
author Takeuchi, Shuta
Takahashi, Takashi
Kabashima, Yoshiyuki
author_facet Takeuchi, Shuta
Takahashi, Takashi
Kabashima, Yoshiyuki
contents We analyze a variant of the Hopfield model that incorporates an unlearning mechanism based on spin correlations in the high-temperature regime. In the large system limit where extensively many patterns are stored, we employ the replica method under the replica symmetric ansatz to characterize the model analytically. Our analysis provides a systematic and self-consistent framework that yields order-parameter equations and stability conditions at finite temperatures over a wide range of parameter settings. The resulting theory accurately captures the behavior of the signal-to-noise ratio, the memory capacity, and the criteria for selecting optimal hyperparameters, in agreement with the qualitative findings of Nokura (1996 \textit{J. Phys. A: Math. Gen.} \textbf{29} 3871). Moreover, the theoretical predictions show good agreement with numerical simulations, supporting the conclusion that unlearning enhances memory capacity by suppressing spurious memories.
format Preprint
id arxiv_https___arxiv_org_abs_2602_08428
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Analysis of the Hopfield Model Incorporating the Effects of Unlearning
Takeuchi, Shuta
Takahashi, Takashi
Kabashima, Yoshiyuki
Disordered Systems and Neural Networks
Statistical Mechanics
We analyze a variant of the Hopfield model that incorporates an unlearning mechanism based on spin correlations in the high-temperature regime. In the large system limit where extensively many patterns are stored, we employ the replica method under the replica symmetric ansatz to characterize the model analytically. Our analysis provides a systematic and self-consistent framework that yields order-parameter equations and stability conditions at finite temperatures over a wide range of parameter settings. The resulting theory accurately captures the behavior of the signal-to-noise ratio, the memory capacity, and the criteria for selecting optimal hyperparameters, in agreement with the qualitative findings of Nokura (1996 \textit{J. Phys. A: Math. Gen.} \textbf{29} 3871). Moreover, the theoretical predictions show good agreement with numerical simulations, supporting the conclusion that unlearning enhances memory capacity by suppressing spurious memories.
title Analysis of the Hopfield Model Incorporating the Effects of Unlearning
topic Disordered Systems and Neural Networks
Statistical Mechanics
url https://arxiv.org/abs/2602.08428