Exploiting temporal parallelism for LSTM Autoencoder acceleration on FPGA

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Leftheriotis, Aimilios, Masouros, Dimosthenis, Soudris, Dimitrios, Theodoridis, George
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912966205505536
author Leftheriotis, Aimilios
Masouros, Dimosthenis
Soudris, Dimitrios
Theodoridis, George
author_facet Leftheriotis, Aimilios
Masouros, Dimosthenis
Soudris, Dimitrios
Theodoridis, George
contents Recurrent Neural Networks (RNNs) are vital for sequential data processing. Long Short-Term Memory Autoencoders (LSTM-AEs) are particularly effective for unsupervised anomaly detection in time-series data. However, inherent sequential dependencies limit parallel computation. While previous work has explored FPGA-based acceleration for LSTM networks, efforts have typically focused on optimizing a single LSTM layer at a time. We introduce a novel FPGA-based accelerator using a dataflow architecture that exploits temporal parallelism for concurrent multi-layer processing of different timesteps within sequences. Experimental evaluations on four representative LSTM-AE models with varying widths and depths, implemented on a Zynq UltraScale+ MPSoC FPGA, demonstrate significant advantages over CPU (Intel Xeon Gold 5218R) and GPU (NVIDIA V100) implementations. Our accelerator achieves latency speedups up to 79.6x vs. CPU and 18.2x vs. GPU, alongside energy-per-timestep reductions of up to 1722x vs. CPU and 59.3x vs. GPU. These results, including superior network depth scalability, highlight our approach's potential for high-performance, real-time, power-efficient LSTM-AE-based anomaly detection on FPGAs.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13982
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Exploiting temporal parallelism for LSTM Autoencoder acceleration on FPGA
Leftheriotis, Aimilios
Masouros, Dimosthenis
Soudris, Dimitrios
Theodoridis, George
Hardware Architecture
Machine Learning
Recurrent Neural Networks (RNNs) are vital for sequential data processing. Long Short-Term Memory Autoencoders (LSTM-AEs) are particularly effective for unsupervised anomaly detection in time-series data. However, inherent sequential dependencies limit parallel computation. While previous work has explored FPGA-based acceleration for LSTM networks, efforts have typically focused on optimizing a single LSTM layer at a time. We introduce a novel FPGA-based accelerator using a dataflow architecture that exploits temporal parallelism for concurrent multi-layer processing of different timesteps within sequences. Experimental evaluations on four representative LSTM-AE models with varying widths and depths, implemented on a Zynq UltraScale+ MPSoC FPGA, demonstrate significant advantages over CPU (Intel Xeon Gold 5218R) and GPU (NVIDIA V100) implementations. Our accelerator achieves latency speedups up to 79.6x vs. CPU and 18.2x vs. GPU, alongside energy-per-timestep reductions of up to 1722x vs. CPU and 59.3x vs. GPU. These results, including superior network depth scalability, highlight our approach's potential for high-performance, real-time, power-efficient LSTM-AE-based anomaly detection on FPGAs.
title Exploiting temporal parallelism for LSTM Autoencoder acceleration on FPGA
topic Hardware Architecture
Machine Learning
url https://arxiv.org/abs/2603.13982