Fault-Tolerant Neural Networks from Biological Error Correction Codes
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2022
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910890388881408 |
|---|---|
| author | Zlokapa, Alexander Tan, Andrew K. Martyn, John M. Fiete, Ila R. Tegmark, Max Chuang, Isaac L. |
| author_facet | Zlokapa, Alexander Tan, Andrew K. Martyn, John M. Fiete, Ila R. Tegmark, Max Chuang, Isaac L. |
| contents | It has been an open question in deep learning if fault-tolerant computation is possible: can arbitrarily reliable computation be achieved using only unreliable neurons? In the grid cells of the mammalian cortex, analog error correction codes have been observed to protect states against neural spiking noise, but their role in information processing is unclear. Here, we use these biological error correction codes to develop a universal fault-tolerant neural network that achieves reliable computation if the faultiness of each neuron lies below a sharp threshold; remarkably, we find that noisy biological neurons fall below this threshold. The discovery of a phase transition from faulty to fault-tolerant neural computation suggests a mechanism for reliable computation in the cortex and opens a path towards understanding noisy analog systems relevant to artificial intelligence and neuromorphic computing. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2202_12887 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Fault-Tolerant Neural Networks from Biological Error Correction Codes Zlokapa, Alexander Tan, Andrew K. Martyn, John M. Fiete, Ila R. Tegmark, Max Chuang, Isaac L. Machine Learning Neural and Evolutionary Computing Neurons and Cognition It has been an open question in deep learning if fault-tolerant computation is possible: can arbitrarily reliable computation be achieved using only unreliable neurons? In the grid cells of the mammalian cortex, analog error correction codes have been observed to protect states against neural spiking noise, but their role in information processing is unclear. Here, we use these biological error correction codes to develop a universal fault-tolerant neural network that achieves reliable computation if the faultiness of each neuron lies below a sharp threshold; remarkably, we find that noisy biological neurons fall below this threshold. The discovery of a phase transition from faulty to fault-tolerant neural computation suggests a mechanism for reliable computation in the cortex and opens a path towards understanding noisy analog systems relevant to artificial intelligence and neuromorphic computing. |
| title | Fault-Tolerant Neural Networks from Biological Error Correction Codes |
| topic | Machine Learning Neural and Evolutionary Computing Neurons and Cognition |
| url | https://arxiv.org/abs/2202.12887 |