Count2Multiply: Reliable In-Memory High-Radix Counting

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: de Lima, João Paulo Cardoso, Morris III, Benjamin Franklin, Khan, Asif Ali, Castrillon, Jeronimo, Jones, Alex K.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913806853079040
author de Lima, João Paulo Cardoso
Morris III, Benjamin Franklin
Khan, Asif Ali
Castrillon, Jeronimo
Jones, Alex K.
author_facet de Lima, João Paulo Cardoso
Morris III, Benjamin Franklin
Khan, Asif Ali
Castrillon, Jeronimo
Jones, Alex K.
contents Computing-in-memory (CIM) has been demonstrated across various memory technologies, ranging from memristive crossbars performing analog dot-product computations to large-scale digital bitwise operations in commodity DRAM and other proposed non-volative memory technologies. However, current CIM solutions face latency and reliability challenges. CIM fidelity lags considerably behind access fidelity. Furthermore, bulk-bitwise CIM, although highly parallelized, requires long latency for operations like multiplication and addition, due to their bit-serial computation. This paper presents Count2Multiply, a technology-agnostic digital CIM approach to perform multiplication, addition and other operations using high-radix, massively parallel counting enabled by CIM bulk-bitwise logic operations. Designed to meet fault tolerance requirements, Count2Multiply integrates traditional row-wise error correction codes, such as Hamming and BCH, to address the high error rates in existing CIM designs. We demonstrate Count2Multiply with a detailed application to CIM in conventional DRAM due to its ubiquity and high endurance. However, we note that the Count2Multiply architecture is compatible with other functionally complete CIM proposals. Compared to the state-of-the-art in-DRAM CIM method, Count2Multiply achieves up to 10x speedup, 8x higher GOPS/Watt, and 9.5x higher GOPS/area, while outperforming GPU for vector-matrix multiplications.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10136
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Count2Multiply: Reliable In-Memory High-Radix Counting
de Lima, João Paulo Cardoso
Morris III, Benjamin Franklin
Khan, Asif Ali
Castrillon, Jeronimo
Jones, Alex K.
Hardware Architecture
Emerging Technologies
Computing-in-memory (CIM) has been demonstrated across various memory technologies, ranging from memristive crossbars performing analog dot-product computations to large-scale digital bitwise operations in commodity DRAM and other proposed non-volative memory technologies. However, current CIM solutions face latency and reliability challenges. CIM fidelity lags considerably behind access fidelity. Furthermore, bulk-bitwise CIM, although highly parallelized, requires long latency for operations like multiplication and addition, due to their bit-serial computation. This paper presents Count2Multiply, a technology-agnostic digital CIM approach to perform multiplication, addition and other operations using high-radix, massively parallel counting enabled by CIM bulk-bitwise logic operations. Designed to meet fault tolerance requirements, Count2Multiply integrates traditional row-wise error correction codes, such as Hamming and BCH, to address the high error rates in existing CIM designs. We demonstrate Count2Multiply with a detailed application to CIM in conventional DRAM due to its ubiquity and high endurance. However, we note that the Count2Multiply architecture is compatible with other functionally complete CIM proposals. Compared to the state-of-the-art in-DRAM CIM method, Count2Multiply achieves up to 10x speedup, 8x higher GOPS/Watt, and 9.5x higher GOPS/area, while outperforming GPU for vector-matrix multiplications.
title Count2Multiply: Reliable In-Memory High-Radix Counting
topic Hardware Architecture
Emerging Technologies
url https://arxiv.org/abs/2409.10136