Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914866101485568 |
|---|---|
| author | Zhou, Chenlin Zhang, Han Yu, Liutao Ye, Yumin Zhou, Zhaokun Huang, Liwei Ma, Zhengyu Fan, Xiaopeng Zhou, Huihui Tian, Yonghong |
| author_facet | Zhou, Chenlin Zhang, Han Yu, Liutao Ye, Yumin Zhou, Zhaokun Huang, Liwei Ma, Zhengyu Fan, Xiaopeng Zhou, Huihui Tian, Yonghong |
| contents | Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct training algorithms based on the surrogate gradient method provide sufficient flexibility to design novel SNN architectures and explore the spatial-temporal dynamics of SNNs. According to previous studies, the performance of models is highly dependent on their sizes. Recently, direct training deep SNNs have achieved great progress on both neuromorphic datasets and large-scale static datasets. Notably, transformer-based SNNs show comparable performance with their ANN counterparts. In this paper, we provide a new perspective to summarize the theories and methods for training deep SNNs with high performance in a systematic and comprehensive way, including theory fundamentals, spiking neuron models, advanced SNN models and residual architectures, software frameworks and neuromorphic hardware, applications, and future trends. The reviewed papers are collected at https://github.com/zhouchenlin2096/Awesome-Spiking-Neural-Networks |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_04289 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods Zhou, Chenlin Zhang, Han Yu, Liutao Ye, Yumin Zhou, Zhaokun Huang, Liwei Ma, Zhengyu Fan, Xiaopeng Zhou, Huihui Tian, Yonghong Neural and Evolutionary Computing Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct training algorithms based on the surrogate gradient method provide sufficient flexibility to design novel SNN architectures and explore the spatial-temporal dynamics of SNNs. According to previous studies, the performance of models is highly dependent on their sizes. Recently, direct training deep SNNs have achieved great progress on both neuromorphic datasets and large-scale static datasets. Notably, transformer-based SNNs show comparable performance with their ANN counterparts. In this paper, we provide a new perspective to summarize the theories and methods for training deep SNNs with high performance in a systematic and comprehensive way, including theory fundamentals, spiking neuron models, advanced SNN models and residual architectures, software frameworks and neuromorphic hardware, applications, and future trends. The reviewed papers are collected at https://github.com/zhouchenlin2096/Awesome-Spiking-Neural-Networks |
| title | Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods |
| topic | Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2405.04289 |