Benchmarking Spiking Neurons for Linear Quadratic Regulator Control of Multi-linked Pole on a Cart: from Single Neuron to Ensemble

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Banerjee, Shreyan, Gava, Luna, Rounak, Aasifa, Pakrashi, Vikram
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916826173145088
author Banerjee, Shreyan
Gava, Luna
Rounak, Aasifa
Pakrashi, Vikram
author_facet Banerjee, Shreyan
Gava, Luna
Rounak, Aasifa
Pakrashi, Vikram
contents The emerging field of neuromorphic computing for edge control applications poses the need to quantitatively estimate and limit the number of spiking neurons, to reduce network complexity and optimize the number of neurons per core and hence, the chip size, in an application-specific neuromorphic hardware. While rate-encoding for spiking neurons provides a robust way to encode signals with the same number of neurons as an ANN, it often lacks precision. To achieve the desired accuracy, a population of neurons is often needed to encode the complete range of input signals. However, using population encoding immensely increases the total number of neurons required for a particular application, thus increasing the power consumption and on-board resource utilization. A transition from two neurons to a population of neurons for the LQR control of a cartpole is shown in this work. The near-linear behavior of a Leaky-Integrate-and-Fire neuron can be exploited to achieve the Linear Quadratic Regulator (LQR) control of a cartpole system. This has been shown in simulation, followed by a demonstration on a single-neuron hardware, known as Lu.i. The improvement in control performance is then demonstrated by using a population of varying numbers of neurons for similar control in the Nengo Neural Engineering Framework, on CPU and on Intel's Loihi neuromorphic chip. Finally, linear control is demonstrated for four multi-linked pendula on cart systems, using a population of neurons in Nengo, followed by an implementation of the same on Loihi. This study compares LQR control in the NEF using $7$ control and $7$ neuromorphic performance metrics, followed by a comparison with other conventional spiking and non-spiking controllers.
format Preprint
id arxiv_https___arxiv_org_abs_2507_03621
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Benchmarking Spiking Neurons for Linear Quadratic Regulator Control of Multi-linked Pole on a Cart: from Single Neuron to Ensemble
Banerjee, Shreyan
Gava, Luna
Rounak, Aasifa
Pakrashi, Vikram
Systems and Control
The emerging field of neuromorphic computing for edge control applications poses the need to quantitatively estimate and limit the number of spiking neurons, to reduce network complexity and optimize the number of neurons per core and hence, the chip size, in an application-specific neuromorphic hardware. While rate-encoding for spiking neurons provides a robust way to encode signals with the same number of neurons as an ANN, it often lacks precision. To achieve the desired accuracy, a population of neurons is often needed to encode the complete range of input signals. However, using population encoding immensely increases the total number of neurons required for a particular application, thus increasing the power consumption and on-board resource utilization. A transition from two neurons to a population of neurons for the LQR control of a cartpole is shown in this work. The near-linear behavior of a Leaky-Integrate-and-Fire neuron can be exploited to achieve the Linear Quadratic Regulator (LQR) control of a cartpole system. This has been shown in simulation, followed by a demonstration on a single-neuron hardware, known as Lu.i. The improvement in control performance is then demonstrated by using a population of varying numbers of neurons for similar control in the Nengo Neural Engineering Framework, on CPU and on Intel's Loihi neuromorphic chip. Finally, linear control is demonstrated for four multi-linked pendula on cart systems, using a population of neurons in Nengo, followed by an implementation of the same on Loihi. This study compares LQR control in the NEF using $7$ control and $7$ neuromorphic performance metrics, followed by a comparison with other conventional spiking and non-spiking controllers.
title Benchmarking Spiking Neurons for Linear Quadratic Regulator Control of Multi-linked Pole on a Cart: from Single Neuron to Ensemble
topic Systems and Control
url https://arxiv.org/abs/2507.03621