Hardware-software co-exploration with racetrack memory based in-memory computing for CNN inference in embedded systems
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915368720662528 |
|---|---|
| author | Choong, Benjamin Chen Ming Luo, Tao Liu, Cheng He, Bingsheng Zhang, Wei Zhou, Joey Tianyi |
| author_facet | Choong, Benjamin Chen Ming Luo, Tao Liu, Cheng He, Bingsheng Zhang, Wei Zhou, Joey Tianyi |
| contents | Deep neural networks generate and process large volumes of data, posing challenges for low-resource embedded systems. In-memory computing has been demonstrated as an efficient computing infrastructure and shows promise for embedded AI applications. Among newly-researched memory technologies, racetrack memory is a non-volatile technology that allows high data density fabrication, making it a good fit for in-memory computing. However, integrating in-memory arithmetic circuits with memory cells affects both the memory density and power efficiency. It remains challenging to build efficient in-memory arithmetic circuits on racetrack memory within area and energy constraints. To this end, we present an efficient in-memory convolutional neural network (CNN) accelerator optimized for use with racetrack memory. We design a series of fundamental arithmetic circuits as in-memory computing cells suited for multiply-and-accumulate operations. Moreover, we explore the design space of racetrack memory based systems and CNN model architectures, employing co-design to improve the efficiency and performance of performing CNN inference in racetrack memory while maintaining model accuracy. Our designed circuits and model-system co-optimization strategies achieve a small memory bank area with significant improvements in energy and performance for racetrack memory based embedded systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_01429 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Hardware-software co-exploration with racetrack memory based in-memory computing for CNN inference in embedded systems Choong, Benjamin Chen Ming Luo, Tao Liu, Cheng He, Bingsheng Zhang, Wei Zhou, Joey Tianyi Emerging Technologies Artificial Intelligence Hardware Architecture Deep neural networks generate and process large volumes of data, posing challenges for low-resource embedded systems. In-memory computing has been demonstrated as an efficient computing infrastructure and shows promise for embedded AI applications. Among newly-researched memory technologies, racetrack memory is a non-volatile technology that allows high data density fabrication, making it a good fit for in-memory computing. However, integrating in-memory arithmetic circuits with memory cells affects both the memory density and power efficiency. It remains challenging to build efficient in-memory arithmetic circuits on racetrack memory within area and energy constraints. To this end, we present an efficient in-memory convolutional neural network (CNN) accelerator optimized for use with racetrack memory. We design a series of fundamental arithmetic circuits as in-memory computing cells suited for multiply-and-accumulate operations. Moreover, we explore the design space of racetrack memory based systems and CNN model architectures, employing co-design to improve the efficiency and performance of performing CNN inference in racetrack memory while maintaining model accuracy. Our designed circuits and model-system co-optimization strategies achieve a small memory bank area with significant improvements in energy and performance for racetrack memory based embedded systems. |
| title | Hardware-software co-exploration with racetrack memory based in-memory computing for CNN inference in embedded systems |
| topic | Emerging Technologies Artificial Intelligence Hardware Architecture |
| url | https://arxiv.org/abs/2507.01429 |