A Neural Network Mode for PX4 on Embedded Flight Controllers

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hegre, Sindre M., Rehberg, Welf, Kulkarni, Mihir, Alexis, Kostas
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909598232870912
author Hegre, Sindre M.
Rehberg, Welf
Kulkarni, Mihir
Alexis, Kostas
author_facet Hegre, Sindre M.
Rehberg, Welf
Kulkarni, Mihir
Alexis, Kostas
contents This paper contributes an open-sourced implementation of a neural-network based controller framework within the PX4 stack. We develop a custom module for inference on the microcontroller while retaining all of the functionality of the PX4 autopilot. Policies trained in the Aerial Gym Simulator are converted to the TensorFlow Lite format and then built together with PX4 and flashed to the flight controller. The policies substitute the control-cascade within PX4 to offer an end-to-end position-setpoint tracking controller directly providing normalized motor RPM setpoints. Experiments conducted in simulation and the real-world show similar tracking performance. We thus provide a flight-ready pipeline for testing neural control policies in the real world. The pipeline simplifies the deployment of neural networks on embedded flight controller hardware thereby accelerating research on learning-based control. Both the Aerial Gym Simulator and the PX4 module are open-sourced at https://github.com/ntnu-arl/aerial_gym_simulator and https://github.com/SindreMHegre/PX4-Autopilot-public/tree/for_paper. Video: https://youtu.be/lY1OKz_UOqM?si=VtzL243BAY3lblTJ.
format Preprint
id arxiv_https___arxiv_org_abs_2505_00432
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Neural Network Mode for PX4 on Embedded Flight Controllers
Hegre, Sindre M.
Rehberg, Welf
Kulkarni, Mihir
Alexis, Kostas
Robotics
This paper contributes an open-sourced implementation of a neural-network based controller framework within the PX4 stack. We develop a custom module for inference on the microcontroller while retaining all of the functionality of the PX4 autopilot. Policies trained in the Aerial Gym Simulator are converted to the TensorFlow Lite format and then built together with PX4 and flashed to the flight controller. The policies substitute the control-cascade within PX4 to offer an end-to-end position-setpoint tracking controller directly providing normalized motor RPM setpoints. Experiments conducted in simulation and the real-world show similar tracking performance. We thus provide a flight-ready pipeline for testing neural control policies in the real world. The pipeline simplifies the deployment of neural networks on embedded flight controller hardware thereby accelerating research on learning-based control. Both the Aerial Gym Simulator and the PX4 module are open-sourced at https://github.com/ntnu-arl/aerial_gym_simulator and https://github.com/SindreMHegre/PX4-Autopilot-public/tree/for_paper. Video: https://youtu.be/lY1OKz_UOqM?si=VtzL243BAY3lblTJ.
title A Neural Network Mode for PX4 on Embedded Flight Controllers
topic Robotics
url https://arxiv.org/abs/2505.00432