Bullet Trains: Parallelizing Training of Temporally Precise Spiking Neural Networks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Morrill, Todd, Pehle, Christian, Zador, Anthony
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910265859112960
author Morrill, Todd
Pehle, Christian
Zador, Anthony
author_facet Morrill, Todd
Pehle, Christian
Zador, Anthony
contents Continuous-time, event-native spiking neural networks (SNNs) operate strictly on spike events, treating spike timing and ordering as the representation rather than an artifact of time discretization. This viewpoint aligns with biological computation and with the native resolution of event sensors and neuromorphic processors, while enabling compute and memory that scale with the number of events. However, two challenges hinder practical, end-to-end trainable event-based SNN systems: 1) exact charge--fire--reset dynamics impose inherently sequential processing of input spikes, and 2) precise spike times must be solved without time bins. We address both. First, we use parallel associative scans to consume multiple input spikes at once, yielding up to 44x speedups over sequential simulation while retaining exact hard-reset dynamics. Second, we implement differentiable spike time solvers that compute spike times to machine-precision without discrete-time approximations or restrictive analytic assumptions. We demonstrate the viability of training SNNs using our solutions on four event-based datasets on GPUs.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13283
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Bullet Trains: Parallelizing Training of Temporally Precise Spiking Neural Networks
Morrill, Todd
Pehle, Christian
Zador, Anthony
Neural and Evolutionary Computing
Machine Learning
Continuous-time, event-native spiking neural networks (SNNs) operate strictly on spike events, treating spike timing and ordering as the representation rather than an artifact of time discretization. This viewpoint aligns with biological computation and with the native resolution of event sensors and neuromorphic processors, while enabling compute and memory that scale with the number of events. However, two challenges hinder practical, end-to-end trainable event-based SNN systems: 1) exact charge--fire--reset dynamics impose inherently sequential processing of input spikes, and 2) precise spike times must be solved without time bins. We address both. First, we use parallel associative scans to consume multiple input spikes at once, yielding up to 44x speedups over sequential simulation while retaining exact hard-reset dynamics. Second, we implement differentiable spike time solvers that compute spike times to machine-precision without discrete-time approximations or restrictive analytic assumptions. We demonstrate the viability of training SNNs using our solutions on four event-based datasets on GPUs.
title Bullet Trains: Parallelizing Training of Temporally Precise Spiking Neural Networks
topic Neural and Evolutionary Computing
Machine Learning
url https://arxiv.org/abs/2603.13283