Compute-in-Memory Implementation of State Space Models for Event Sequence Processing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911334255296512 |
|---|---|
| author | Zhang, Xiaoyu Hu, Mingtao Lu, Sen Kim, Soohyeon Lee, Eric Yeu-Jer Liu, Yuyang Lu, Wei D. |
| author_facet | Zhang, Xiaoyu Hu, Mingtao Lu, Sen Kim, Soohyeon Lee, Eric Yeu-Jer Liu, Yuyang Lu, Wei D. |
| contents | State space models (SSMs) have recently emerged as a powerful framework for long sequence processing, outperforming traditional methods on diverse benchmarks. Fundamentally, SSMs can generalize both recurrent and convolutional networks and have been shown to even capture key functions of biological systems. Here we report an approach to implement SSMs in energy-efficient compute-in-memory (CIM) hardware to achieve real-time, event-driven processing. Our work re-parameterizes the model to function with real-valued coefficients and shared decay constants, reducing the complexity of model mapping onto practical hardware systems. By leveraging device dynamics and diagonalized state transition parameters, the state evolution can be natively implemented in crossbar-based CIM systems combined with memristors exhibiting short-term memory effects. Through this algorithm and hardware co-design, we show the proposed system offers both high accuracy and high energy efficiency while supporting fully asynchronous processing for event-based vision and audio tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_13912 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Compute-in-Memory Implementation of State Space Models for Event Sequence Processing Zhang, Xiaoyu Hu, Mingtao Lu, Sen Kim, Soohyeon Lee, Eric Yeu-Jer Liu, Yuyang Lu, Wei D. Signal Processing Artificial Intelligence Machine Learning State space models (SSMs) have recently emerged as a powerful framework for long sequence processing, outperforming traditional methods on diverse benchmarks. Fundamentally, SSMs can generalize both recurrent and convolutional networks and have been shown to even capture key functions of biological systems. Here we report an approach to implement SSMs in energy-efficient compute-in-memory (CIM) hardware to achieve real-time, event-driven processing. Our work re-parameterizes the model to function with real-valued coefficients and shared decay constants, reducing the complexity of model mapping onto practical hardware systems. By leveraging device dynamics and diagonalized state transition parameters, the state evolution can be natively implemented in crossbar-based CIM systems combined with memristors exhibiting short-term memory effects. Through this algorithm and hardware co-design, we show the proposed system offers both high accuracy and high energy efficiency while supporting fully asynchronous processing for event-based vision and audio tasks. |
| title | Compute-in-Memory Implementation of State Space Models for Event Sequence Processing |
| topic | Signal Processing Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2511.13912 |