Autonomous Reinforcement Learning Robot Control with Intel's Loihi 2 Neuromorphic Hardware

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Stewart, Kenneth, Leontie, Roxana, Chapin, Samantha, Hays, Joe, Shrestha, Sumit Bam, Henshaw, Carl Glen
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914178880503808
author Stewart, Kenneth
Leontie, Roxana
Chapin, Samantha
Hays, Joe
Shrestha, Sumit Bam
Henshaw, Carl Glen
author_facet Stewart, Kenneth
Leontie, Roxana
Chapin, Samantha
Hays, Joe
Shrestha, Sumit Bam
Henshaw, Carl Glen
contents We present an end-to-end pipeline for deploying reinforcement learning (RL) trained Artificial Neural Networks (ANNs) on neuromorphic hardware by converting them into spiking Sigma-Delta Neural Networks (SDNNs). We demonstrate that an ANN policy trained entirely in simulation can be transformed into an SDNN compatible with Intel's Loihi 2 architecture, enabling low-latency and energy-efficient inference. As a test case, we use an RL policy for controlling the Astrobee free-flying robot, similar to a previously hardware in space-validated controller. The policy, trained with Rectified Linear Units (ReLUs), is converted to an SDNN and deployed on Intel's Loihi 2, then evaluated in NVIDIA's Omniverse Isaac Lab simulation environment for closed-loop control of Astrobee's motion. We compare execution performance between GPU and Loihi 2. The results highlight the feasibility of using neuromorphic platforms for robotic control and establish a pathway toward energy-efficient, real-time neuromorphic computation in future space and terrestrial robotics applications.
format Preprint
id arxiv_https___arxiv_org_abs_2512_03911
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Autonomous Reinforcement Learning Robot Control with Intel's Loihi 2 Neuromorphic Hardware
Stewart, Kenneth
Leontie, Roxana
Chapin, Samantha
Hays, Joe
Shrestha, Sumit Bam
Henshaw, Carl Glen
Robotics
Artificial Intelligence
Machine Learning
We present an end-to-end pipeline for deploying reinforcement learning (RL) trained Artificial Neural Networks (ANNs) on neuromorphic hardware by converting them into spiking Sigma-Delta Neural Networks (SDNNs). We demonstrate that an ANN policy trained entirely in simulation can be transformed into an SDNN compatible with Intel's Loihi 2 architecture, enabling low-latency and energy-efficient inference. As a test case, we use an RL policy for controlling the Astrobee free-flying robot, similar to a previously hardware in space-validated controller. The policy, trained with Rectified Linear Units (ReLUs), is converted to an SDNN and deployed on Intel's Loihi 2, then evaluated in NVIDIA's Omniverse Isaac Lab simulation environment for closed-loop control of Astrobee's motion. We compare execution performance between GPU and Loihi 2. The results highlight the feasibility of using neuromorphic platforms for robotic control and establish a pathway toward energy-efficient, real-time neuromorphic computation in future space and terrestrial robotics applications.
title Autonomous Reinforcement Learning Robot Control with Intel's Loihi 2 Neuromorphic Hardware
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2512.03911