Biologically-Informed Excitatory and Inhibitory Balance for Robust Spiking Neural Network Training
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913327777579008 |
|---|---|
| author | Kilgore, Joseph A. Kopsick, Jeffrey D. Ascoli, Giorgio A. Adam, Gina C. |
| author_facet | Kilgore, Joseph A. Kopsick, Jeffrey D. Ascoli, Giorgio A. Adam, Gina C. |
| contents | Spiking neural networks drawing inspiration from biological constraints of the brain promise an energy-efficient paradigm for artificial intelligence. However, challenges exist in identifying guiding principles to train these networks in a robust fashion. In addition, training becomes an even more difficult problem when incorporating biological constraints of excitatory and inhibitory connections. In this work, we identify several key factors, such as low initial firing rates and diverse inhibitory spiking patterns, that determine the overall ability to train spiking networks with various ratios of excitatory to inhibitory neurons on AI-relevant datasets. The results indicate networks with the biologically realistic 80:20 excitatory:inhibitory balance can reliably train at low activity levels and in noisy environments. Additionally, the Van Rossum distance, a measure of spike train synchrony, provides insight into the importance of inhibitory neurons to increase network robustness to noise. This work supports further biologically-informed large-scale networks and energy efficient hardware implementations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_15627 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Biologically-Informed Excitatory and Inhibitory Balance for Robust Spiking Neural Network Training Kilgore, Joseph A. Kopsick, Jeffrey D. Ascoli, Giorgio A. Adam, Gina C. Neural and Evolutionary Computing Emerging Technologies Spiking neural networks drawing inspiration from biological constraints of the brain promise an energy-efficient paradigm for artificial intelligence. However, challenges exist in identifying guiding principles to train these networks in a robust fashion. In addition, training becomes an even more difficult problem when incorporating biological constraints of excitatory and inhibitory connections. In this work, we identify several key factors, such as low initial firing rates and diverse inhibitory spiking patterns, that determine the overall ability to train spiking networks with various ratios of excitatory to inhibitory neurons on AI-relevant datasets. The results indicate networks with the biologically realistic 80:20 excitatory:inhibitory balance can reliably train at low activity levels and in noisy environments. Additionally, the Van Rossum distance, a measure of spike train synchrony, provides insight into the importance of inhibitory neurons to increase network robustness to noise. This work supports further biologically-informed large-scale networks and energy efficient hardware implementations. |
| title | Biologically-Informed Excitatory and Inhibitory Balance for Robust Spiking Neural Network Training |
| topic | Neural and Evolutionary Computing Emerging Technologies |
| url | https://arxiv.org/abs/2404.15627 |