Saved in:
Bibliographic Details
Main Authors: Nimbekar, Anagha, Katti, Prabodh, Li, Chen, Al-Hashimi, Bashir M., Acharyya, Amit, Rajendran, Bipin
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.16298
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917823161303040
author Nimbekar, Anagha
Katti, Prabodh
Li, Chen
Al-Hashimi, Bashir M.
Acharyya, Amit
Rajendran, Bipin
author_facet Nimbekar, Anagha
Katti, Prabodh
Li, Chen
Al-Hashimi, Bashir M.
Acharyya, Amit
Rajendran, Bipin
contents Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In this paper, we develop a hardware-software co-optimisation strategy to port software-trained deep neural networks (DNN) to reduced-precision spiking models demonstrating fast and accurate inference in a novel event-driven CMOS reconfigurable spiking inference accelerator. Experimental results show that a reduced-precision Resnet-18 and VGG-11 SNN models achieves classification accuracy within 1% of the baseline full-precision DNN model within 8 spike timesteps. We also demonstrate an FPGA prototype implementation of the spiking inference accelerator with a throughput of 38.4 giga operations per second (GOPS) consuming 1.54 Watts on PYNQ-Z2 FPGA. This corresponds to 0.6 GOPS per processing element and 2.25,GOPS/DSP slice, which is 2x and 4.5x higher utilisation efficiency respectively compared to the state-of-the-art. Our co-optimisation strategy can be employed to develop deep reduced precision SNN models and port them to resource-efficient event-driven hardware accelerators for edge applications.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16298
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hardware-Software Co-optimised Fast and Accurate Deep Reconfigurable Spiking Inference Accelerator Architecture Design Methodology
Nimbekar, Anagha
Katti, Prabodh
Li, Chen
Al-Hashimi, Bashir M.
Acharyya, Amit
Rajendran, Bipin
Neural and Evolutionary Computing
Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In this paper, we develop a hardware-software co-optimisation strategy to port software-trained deep neural networks (DNN) to reduced-precision spiking models demonstrating fast and accurate inference in a novel event-driven CMOS reconfigurable spiking inference accelerator. Experimental results show that a reduced-precision Resnet-18 and VGG-11 SNN models achieves classification accuracy within 1% of the baseline full-precision DNN model within 8 spike timesteps. We also demonstrate an FPGA prototype implementation of the spiking inference accelerator with a throughput of 38.4 giga operations per second (GOPS) consuming 1.54 Watts on PYNQ-Z2 FPGA. This corresponds to 0.6 GOPS per processing element and 2.25,GOPS/DSP slice, which is 2x and 4.5x higher utilisation efficiency respectively compared to the state-of-the-art. Our co-optimisation strategy can be employed to develop deep reduced precision SNN models and port them to resource-efficient event-driven hardware accelerators for edge applications.
title Hardware-Software Co-optimised Fast and Accurate Deep Reconfigurable Spiking Inference Accelerator Architecture Design Methodology
topic Neural and Evolutionary Computing
url https://arxiv.org/abs/2410.16298