Adversarial Reinforcement Learning for Robust Control of Fixed-Wing Aircraft under Model Uncertainty

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Marquis, Dennis J., Wilhelm, Blake, Muniraj, Devaprakash, Farhood, Mazen
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918163762905088
author Marquis, Dennis J.
Wilhelm, Blake
Muniraj, Devaprakash
Farhood, Mazen
author_facet Marquis, Dennis J.
Wilhelm, Blake
Muniraj, Devaprakash
Farhood, Mazen
contents This paper presents a reinforcement learning-based path-following controller for a fixed-wing small uncrewed aircraft system (sUAS) that is robust to uncertainties in the aerodynamic model of the sUAS. The controller is trained using the Robust Adversarial Reinforcement Learning framework, where an adversary perturbs the environment (aerodynamic model) to expose the agent (sUAS) to demanding scenarios. In our formulation, the adversary introduces rate-bounded perturbations to the aerodynamic model coefficients. We demonstrate that adversarial training improves robustness compared to controllers trained using stochastic model uncertainty. The learned controller is also benchmarked against a switched uncertain initial condition controller. The effectiveness of the approach is validated through high-fidelity simulations using a realistic six-degree-of-freedom fixed-wing aircraft model, showing accurate and robust path-following performance under a variety of uncertain aerodynamic conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2510_16650
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adversarial Reinforcement Learning for Robust Control of Fixed-Wing Aircraft under Model Uncertainty
Marquis, Dennis J.
Wilhelm, Blake
Muniraj, Devaprakash
Farhood, Mazen
Optimization and Control
Systems and Control
This paper presents a reinforcement learning-based path-following controller for a fixed-wing small uncrewed aircraft system (sUAS) that is robust to uncertainties in the aerodynamic model of the sUAS. The controller is trained using the Robust Adversarial Reinforcement Learning framework, where an adversary perturbs the environment (aerodynamic model) to expose the agent (sUAS) to demanding scenarios. In our formulation, the adversary introduces rate-bounded perturbations to the aerodynamic model coefficients. We demonstrate that adversarial training improves robustness compared to controllers trained using stochastic model uncertainty. The learned controller is also benchmarked against a switched uncertain initial condition controller. The effectiveness of the approach is validated through high-fidelity simulations using a realistic six-degree-of-freedom fixed-wing aircraft model, showing accurate and robust path-following performance under a variety of uncertain aerodynamic conditions.
title Adversarial Reinforcement Learning for Robust Control of Fixed-Wing Aircraft under Model Uncertainty
topic Optimization and Control
Systems and Control
url https://arxiv.org/abs/2510.16650