Kernel Approximation using Analog In-Memory Computing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916470027452416 |
|---|---|
| author | Büchel, Julian Camposampiero, Giacomo Vasilopoulos, Athanasios Lammie, Corey Gallo, Manuel Le Rahimi, Abbas Sebastian, Abu |
| author_facet | Büchel, Julian Camposampiero, Giacomo Vasilopoulos, Athanasios Lammie, Corey Gallo, Manuel Le Rahimi, Abbas Sebastian, Abu |
| contents | Kernel functions are vital ingredients of several machine learning algorithms, but often incur significant memory and computational costs. We introduce an approach to kernel approximation in machine learning algorithms suitable for mixed-signal Analog In-Memory Computing (AIMC) architectures. Analog In-Memory Kernel Approximation addresses the performance bottlenecks of conventional kernel-based methods by executing most operations in approximate kernel methods directly in memory. The IBM HERMES Project Chip, a state-of-the-art phase-change memory based AIMC chip, is utilized for the hardware demonstration of kernel approximation. Experimental results show that our method maintains high accuracy, with less than a 1% drop in kernel-based ridge classification benchmarks and within 1% accuracy on the Long Range Arena benchmark for kernelized attention in Transformer neural networks. Compared to traditional digital accelerators, our approach is estimated to deliver superior energy efficiency and lower power consumption. These findings highlight the potential of heterogeneous AIMC architectures to enhance the efficiency and scalability of machine learning applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_03375 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Kernel Approximation using Analog In-Memory Computing Büchel, Julian Camposampiero, Giacomo Vasilopoulos, Athanasios Lammie, Corey Gallo, Manuel Le Rahimi, Abbas Sebastian, Abu Machine Learning Hardware Architecture Kernel functions are vital ingredients of several machine learning algorithms, but often incur significant memory and computational costs. We introduce an approach to kernel approximation in machine learning algorithms suitable for mixed-signal Analog In-Memory Computing (AIMC) architectures. Analog In-Memory Kernel Approximation addresses the performance bottlenecks of conventional kernel-based methods by executing most operations in approximate kernel methods directly in memory. The IBM HERMES Project Chip, a state-of-the-art phase-change memory based AIMC chip, is utilized for the hardware demonstration of kernel approximation. Experimental results show that our method maintains high accuracy, with less than a 1% drop in kernel-based ridge classification benchmarks and within 1% accuracy on the Long Range Arena benchmark for kernelized attention in Transformer neural networks. Compared to traditional digital accelerators, our approach is estimated to deliver superior energy efficiency and lower power consumption. These findings highlight the potential of heterogeneous AIMC architectures to enhance the efficiency and scalability of machine learning applications. |
| title | Kernel Approximation using Analog In-Memory Computing |
| topic | Machine Learning Hardware Architecture |
| url | https://arxiv.org/abs/2411.03375 |