Statistical mechanics of vector Hopfield network near and above saturation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915797446688768 |
|---|---|
| author | Nicoletti, Flavio D'Amico, Francesco Negri, Matteo |
| author_facet | Nicoletti, Flavio D'Amico, Francesco Negri, Matteo |
| contents | We study analytically and numerically a Hopfield fully-connected network with $d$-dimensional vector spins. These networks are models of associative memory that generalize the standard Hopfield with Ising spins, where $P$ examples are stored in a network of $N$ units as local minima in an energy landscape. We study the equilibrium and out-of-equilibrium properties of the system, considering the system in its retrieval phase $α<α_c$ and beyond, where $α=P/N$ is the capacity of the system and $α_c$ is its critical value, above which storage fails. We derive the Replica Symmetric solution for the equilibrium thermodynamics of the system, together with its phase diagram: we find that the retrieval phase of the network shrinks with growing spin dimension, having ultimately a vanishing critical capacity $α_c\propto 1/d$ in the large $d$ limit. As a trade-off, we observe that in the same limit vector Hopfield networks are able to denoise corrupted input patterns in the first step of retrieval dynamics, up to very large capacities $α\propto d$. We also study the static properties of the system at zero temperature, considering the statistical properties of soft modes of the energy Hessian spectrum. We find that local minima of the energy landscape related to memory states have ungapped spectra with rare soft eigenmodes: these excitations are localized, their measure condensating on the noisiest neurons of the memory state. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_02586 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Statistical mechanics of vector Hopfield network near and above saturation Nicoletti, Flavio D'Amico, Francesco Negri, Matteo Disordered Systems and Neural Networks We study analytically and numerically a Hopfield fully-connected network with $d$-dimensional vector spins. These networks are models of associative memory that generalize the standard Hopfield with Ising spins, where $P$ examples are stored in a network of $N$ units as local minima in an energy landscape. We study the equilibrium and out-of-equilibrium properties of the system, considering the system in its retrieval phase $α<α_c$ and beyond, where $α=P/N$ is the capacity of the system and $α_c$ is its critical value, above which storage fails. We derive the Replica Symmetric solution for the equilibrium thermodynamics of the system, together with its phase diagram: we find that the retrieval phase of the network shrinks with growing spin dimension, having ultimately a vanishing critical capacity $α_c\propto 1/d$ in the large $d$ limit. As a trade-off, we observe that in the same limit vector Hopfield networks are able to denoise corrupted input patterns in the first step of retrieval dynamics, up to very large capacities $α\propto d$. We also study the static properties of the system at zero temperature, considering the statistical properties of soft modes of the energy Hessian spectrum. We find that local minima of the energy landscape related to memory states have ungapped spectra with rare soft eigenmodes: these excitations are localized, their measure condensating on the noisiest neurons of the memory state. |
| title | Statistical mechanics of vector Hopfield network near and above saturation |
| topic | Disordered Systems and Neural Networks |
| url | https://arxiv.org/abs/2507.02586 |