Biologically Plausible Learning via Bidirectional Spike-Based Distillation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914320372203520 |
|---|---|
| author | Lv, Changze Wang, Yifei Zhang, Yanxun Lu, Yiyang Xu, Jingwen Wang, Xiaohua Yu, Di Du, Xin Huang, Xuanjing Zheng, Xiaoqing |
| author_facet | Lv, Changze Wang, Yifei Zhang, Yanxun Lu, Yiyang Xu, Jingwen Wang, Xiaohua Yu, Di Du, Xin Huang, Xuanjing Zheng, Xiaoqing |
| contents | Developing biologically plausible learning algorithms that can achieve performance comparable to error backpropagation remains a longstanding challenge. Existing approaches often compromise biological plausibility by entirely avoiding the use of spikes for error propagation or relying on both positive and negative learning signals, while the question of how spikes can represent negative values remains unresolved. To address these limitations, we introduce Bidirectional Spike-based Distillation (BSD), a novel learning algorithm that jointly trains a feedforward and a backward spiking network. We formulate learning as a transformation between two spiking representations (i.e., stimulus encoding and concept encoding) so that the feedforward network implements perception and decision-making by mapping stimuli to actions, while the backward network supports memory recall by reconstructing stimuli from concept representations. Extensive experiments on diverse benchmarks, including image recognition, image generation, and sequential regression, show that BSD achieves performance comparable to networks trained with classical error backpropagation. These findings represent a significant step toward biologically grounded, spike-driven learning in neural networks. Our code is available at https://github.com/alden199/Bidirectional-Spike-Based-Distillation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_20284 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Biologically Plausible Learning via Bidirectional Spike-Based Distillation Lv, Changze Wang, Yifei Zhang, Yanxun Lu, Yiyang Xu, Jingwen Wang, Xiaohua Yu, Di Du, Xin Huang, Xuanjing Zheng, Xiaoqing Neural and Evolutionary Computing Developing biologically plausible learning algorithms that can achieve performance comparable to error backpropagation remains a longstanding challenge. Existing approaches often compromise biological plausibility by entirely avoiding the use of spikes for error propagation or relying on both positive and negative learning signals, while the question of how spikes can represent negative values remains unresolved. To address these limitations, we introduce Bidirectional Spike-based Distillation (BSD), a novel learning algorithm that jointly trains a feedforward and a backward spiking network. We formulate learning as a transformation between two spiking representations (i.e., stimulus encoding and concept encoding) so that the feedforward network implements perception and decision-making by mapping stimuli to actions, while the backward network supports memory recall by reconstructing stimuli from concept representations. Extensive experiments on diverse benchmarks, including image recognition, image generation, and sequential regression, show that BSD achieves performance comparable to networks trained with classical error backpropagation. These findings represent a significant step toward biologically grounded, spike-driven learning in neural networks. Our code is available at https://github.com/alden199/Bidirectional-Spike-Based-Distillation. |
| title | Biologically Plausible Learning via Bidirectional Spike-Based Distillation |
| topic | Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2509.20284 |