Real-Time Stream Compaction for Sparse Machine Learning on FPGAs

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Neu, Marc, Haide, Isabel, Ferber, Torben, Becker, Jürgen
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917297152589824
author Neu, Marc
Haide, Isabel
Ferber, Torben
Becker, Jürgen
author_facet Neu, Marc
Haide, Isabel
Ferber, Torben
Becker, Jürgen
contents Machine learning algorithms are being used more frequently in the first-level triggers in collider experiments, with Graph Neural Networks pushing the hardware requirements of FPGA-based triggers beyond the current state of the art. To meet the stringent demands of high-throughput and low-latency environments, we propose a concept for latency-optimized preprocessing of sparse sensor data, enabling efficient GNN hardware acceleration by removing dynamic input sparsity. Our approach rearranges data coming from a large number of First-In-First-Out interfaces, typically sensor frontends, to a smaller number of FIFO interfaces connected to a machine learning hardware accelerator. In order to achieve high throughput while minimizing the hardware utilization, we developed a hierarchical sparsity compression pipeline optimized for FPGAs. We implemented our concept in the Chisel design language as an open-source hardware generator. For demonstration, we implemented one configuration of our module as preprocessing stage in a GNN-based first-level trigger for the Electromagnetic Calorimeter inside the Belle II detector. Additionally we evaluate latency, throughput, resource utilization, and scalability for a wide range of parameters, to enable broader use for other large scale scientific experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2602_23281
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Real-Time Stream Compaction for Sparse Machine Learning on FPGAs
Neu, Marc
Haide, Isabel
Ferber, Torben
Becker, Jürgen
High Energy Physics - Experiment
Hardware Architecture
Machine learning algorithms are being used more frequently in the first-level triggers in collider experiments, with Graph Neural Networks pushing the hardware requirements of FPGA-based triggers beyond the current state of the art. To meet the stringent demands of high-throughput and low-latency environments, we propose a concept for latency-optimized preprocessing of sparse sensor data, enabling efficient GNN hardware acceleration by removing dynamic input sparsity. Our approach rearranges data coming from a large number of First-In-First-Out interfaces, typically sensor frontends, to a smaller number of FIFO interfaces connected to a machine learning hardware accelerator. In order to achieve high throughput while minimizing the hardware utilization, we developed a hierarchical sparsity compression pipeline optimized for FPGAs. We implemented our concept in the Chisel design language as an open-source hardware generator. For demonstration, we implemented one configuration of our module as preprocessing stage in a GNN-based first-level trigger for the Electromagnetic Calorimeter inside the Belle II detector. Additionally we evaluate latency, throughput, resource utilization, and scalability for a wide range of parameters, to enable broader use for other large scale scientific experiments.
title Real-Time Stream Compaction for Sparse Machine Learning on FPGAs
topic High Energy Physics - Experiment
Hardware Architecture
url https://arxiv.org/abs/2602.23281