Emergence of robust memory manifolds
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2021
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912016524902400 |
|---|---|
| author | Can, Tankut Krishnamurthy, Kamesh |
| author_facet | Can, Tankut Krishnamurthy, Kamesh |
| contents | The ability to store continuous variables in the state of a biological system (e.g. a neural network) is critical for many behaviours. Most models for implementing such a memory manifold require hand-crafted symmetries in the interactions or precise fine-tuning of parameters. We present a general principle that we refer to as {\it frozen stabilisation} (FS), which allows a family of neural networks to self-organise to a critical state exhibiting multiple memory manifolds without parameter fine-tuning or symmetries. Memory manifolds arising from FS exhibit a wide range of emergent relaxational timescales and can be used as general purpose integrators for inputs aligned with the manifold. Moreover, FS allows robust memory manifolds in small networks, and this is relevant to debates of implementing continuous attractors with a small number of neurons in light of recent experimental discoveries. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2109_03879 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Emergence of robust memory manifolds Can, Tankut Krishnamurthy, Kamesh Neurons and Cognition Disordered Systems and Neural Networks Biological Physics The ability to store continuous variables in the state of a biological system (e.g. a neural network) is critical for many behaviours. Most models for implementing such a memory manifold require hand-crafted symmetries in the interactions or precise fine-tuning of parameters. We present a general principle that we refer to as {\it frozen stabilisation} (FS), which allows a family of neural networks to self-organise to a critical state exhibiting multiple memory manifolds without parameter fine-tuning or symmetries. Memory manifolds arising from FS exhibit a wide range of emergent relaxational timescales and can be used as general purpose integrators for inputs aligned with the manifold. Moreover, FS allows robust memory manifolds in small networks, and this is relevant to debates of implementing continuous attractors with a small number of neurons in light of recent experimental discoveries. |
| title | Emergence of robust memory manifolds |
| topic | Neurons and Cognition Disordered Systems and Neural Networks Biological Physics |
| url | https://arxiv.org/abs/2109.03879 |