NeoHebbian Synapses to Accelerate Online Training of Neuromorphic Hardware
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910718698192896 |
|---|---|
| author | Pande, Shubham Bezugam, Sai Sukruth Bhattacharya, Tinish Wlazlak, Ewelina Chakaravorty, Anjan Chakrabarti, Bhaswar Strukov, Dmitri |
| author_facet | Pande, Shubham Bezugam, Sai Sukruth Bhattacharya, Tinish Wlazlak, Ewelina Chakaravorty, Anjan Chakrabarti, Bhaswar Strukov, Dmitri |
| contents | Neuromorphic systems that employ advanced synaptic learning rules, such as the three-factor learning rule, require synaptic devices of increased complexity. Herein, a novel neoHebbian artificial synapse utilizing ReRAM devices has been proposed and experimentally validated to meet this demand. This synapse features two distinct state variables: a neuron coupling weight and an "eligibility trace" that dictates synaptic weight updates. The coupling weight is encoded in the ReRAM conductance, while the "eligibility trace" is encoded in the local temperature of the ReRAM and is modulated by applying voltage pulses to a physically co-located resistive heating element. The utility of the proposed synapse has been investigated using two representative tasks: first, temporal signal classification using Recurrent Spiking Neural Networks (RSNNs) employing the e-prop algorithm, and second, Reinforcement Learning (RL) for path planning tasks in feedforward networks using a modified version of the same learning rule. System-level simulations, accounting for various device and system-level non-idealities, confirm that these synapses offer a robust solution for the fast, compact, and energy-efficient implementation of advanced learning rules in neuromorphic hardware. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_18272 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | NeoHebbian Synapses to Accelerate Online Training of Neuromorphic Hardware Pande, Shubham Bezugam, Sai Sukruth Bhattacharya, Tinish Wlazlak, Ewelina Chakaravorty, Anjan Chakrabarti, Bhaswar Strukov, Dmitri Emerging Technologies Neural and Evolutionary Computing Neuromorphic systems that employ advanced synaptic learning rules, such as the three-factor learning rule, require synaptic devices of increased complexity. Herein, a novel neoHebbian artificial synapse utilizing ReRAM devices has been proposed and experimentally validated to meet this demand. This synapse features two distinct state variables: a neuron coupling weight and an "eligibility trace" that dictates synaptic weight updates. The coupling weight is encoded in the ReRAM conductance, while the "eligibility trace" is encoded in the local temperature of the ReRAM and is modulated by applying voltage pulses to a physically co-located resistive heating element. The utility of the proposed synapse has been investigated using two representative tasks: first, temporal signal classification using Recurrent Spiking Neural Networks (RSNNs) employing the e-prop algorithm, and second, Reinforcement Learning (RL) for path planning tasks in feedforward networks using a modified version of the same learning rule. System-level simulations, accounting for various device and system-level non-idealities, confirm that these synapses offer a robust solution for the fast, compact, and energy-efficient implementation of advanced learning rules in neuromorphic hardware. |
| title | NeoHebbian Synapses to Accelerate Online Training of Neuromorphic Hardware |
| topic | Emerging Technologies Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2411.18272 |