Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2307.04054 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916160646152192 |
|---|---|
| author | Lu, Sen Sengupta, Abhronil |
| author_facet | Lu, Sen Sengupta, Abhronil |
| contents | Spike-Timing-Dependent Plasticity (STDP) is an unsupervised learning mechanism for Spiking Neural Networks (SNNs) that has received significant attention from the neuromorphic hardware community. However, scaling such local learning techniques to deeper networks and large-scale tasks has remained elusive. In this work, we investigate a Deep-STDP framework where a rate-based convolutional network, that can be deployed in a neuromorphic setting, is trained in tandem with pseudo-labels generated by the STDP clustering process on the network outputs. We achieve $24.56\%$ higher accuracy and $3.5\times$ faster convergence speed at iso-accuracy on a 10-class subset of the Tiny ImageNet dataset in contrast to a $k$-means clustering approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_04054 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity Lu, Sen Sengupta, Abhronil Computer Vision and Pattern Recognition Spike-Timing-Dependent Plasticity (STDP) is an unsupervised learning mechanism for Spiking Neural Networks (SNNs) that has received significant attention from the neuromorphic hardware community. However, scaling such local learning techniques to deeper networks and large-scale tasks has remained elusive. In this work, we investigate a Deep-STDP framework where a rate-based convolutional network, that can be deployed in a neuromorphic setting, is trained in tandem with pseudo-labels generated by the STDP clustering process on the network outputs. We achieve $24.56\%$ higher accuracy and $3.5\times$ faster convergence speed at iso-accuracy on a 10-class subset of the Tiny ImageNet dataset in contrast to a $k$-means clustering approach. |
| title | Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2307.04054 |