Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ghader, Mohammadnavid, Kheradpisheh, Saeed Reza, Farahani, Bahar, Fazlali, Mahmood
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916761157238784
author Ghader, Mohammadnavid
Kheradpisheh, Saeed Reza
Farahani, Bahar
Fazlali, Mahmood
author_facet Ghader, Mohammadnavid
Kheradpisheh, Saeed Reza
Farahani, Bahar
Fazlali, Mahmood
contents Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP) remains challenging due to computational inefficiencies and a lack of biological plausibility. This study explores the Forward-Forward (FF) algorithm as an alternative learning framework for SNNs. Unlike backpropagation, which relies on forward and backward passes, the FF algorithm employs two forward passes, enabling layer-wise localized learning, enhanced computational efficiency, and improved compatibility with neuromorphic hardware. We introduce an FF-based SNN training framework and evaluate its performance across both non-spiking (MNIST, Fashion-MNIST, Kuzushiji-MNIST) and spiking (Neuro-MNIST, SHD) datasets. Experimental results demonstrate that our model surpasses existing FF-based SNNs on evaluated static datasets with a much lighter architecture while achieving accuracy comparable to state-of-the-art backpropagation-trained SNNs. On more complex spiking tasks such as SHD, our approach outperforms other SNN models and remains competitive with leading backpropagation-trained SNNs. These findings highlight the FF algorithm's potential to advance SNN training methodologies by addressing some key limitations of backpropagation.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20411
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
Ghader, Mohammadnavid
Kheradpisheh, Saeed Reza
Farahani, Bahar
Fazlali, Mahmood
Neural and Evolutionary Computing
Artificial Intelligence
Machine Learning
Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP) remains challenging due to computational inefficiencies and a lack of biological plausibility. This study explores the Forward-Forward (FF) algorithm as an alternative learning framework for SNNs. Unlike backpropagation, which relies on forward and backward passes, the FF algorithm employs two forward passes, enabling layer-wise localized learning, enhanced computational efficiency, and improved compatibility with neuromorphic hardware. We introduce an FF-based SNN training framework and evaluate its performance across both non-spiking (MNIST, Fashion-MNIST, Kuzushiji-MNIST) and spiking (Neuro-MNIST, SHD) datasets. Experimental results demonstrate that our model surpasses existing FF-based SNNs on evaluated static datasets with a much lighter architecture while achieving accuracy comparable to state-of-the-art backpropagation-trained SNNs. On more complex spiking tasks such as SHD, our approach outperforms other SNN models and remains competitive with leading backpropagation-trained SNNs. These findings highlight the FF algorithm's potential to advance SNN training methodologies by addressing some key limitations of backpropagation.
title Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
topic Neural and Evolutionary Computing
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2502.20411