Equivariant Reinforcement Learning Frameworks for Quadrotor Low-Level Control

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yu, Beomyeol, Lee, Taeyoung
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917940023001088
author Yu, Beomyeol
Lee, Taeyoung
author_facet Yu, Beomyeol
Lee, Taeyoung
contents Improving sampling efficiency and generalization capability is critical for the successful data-driven control of quadrotor unmanned aerial vehicles (UAVs) that are inherently unstable. While various reinforcement learning (RL) approaches have been applied to autonomous quadrotor flight, they often require extensive training data, posing multiple challenges and safety risks in practice. To address these issues, we propose data-efficient, equivariant monolithic and modular RL frameworks for quadrotor low-level control. Specifically, by identifying the rotational and reflectional symmetries in quadrotor dynamics and encoding these symmetries into equivariant network models, we remove redundancies of learning in the state-action space. This approach enables the optimal control action learned in one configuration to automatically generalize into other configurations via symmetry, thereby enhancing data efficiency. Experimental results demonstrate that our equivariant approaches significantly outperform their non-equivariant counterparts in terms of learning efficiency and flight performance.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20500
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Equivariant Reinforcement Learning Frameworks for Quadrotor Low-Level Control
Yu, Beomyeol
Lee, Taeyoung
Robotics
Optimization and Control
Improving sampling efficiency and generalization capability is critical for the successful data-driven control of quadrotor unmanned aerial vehicles (UAVs) that are inherently unstable. While various reinforcement learning (RL) approaches have been applied to autonomous quadrotor flight, they often require extensive training data, posing multiple challenges and safety risks in practice. To address these issues, we propose data-efficient, equivariant monolithic and modular RL frameworks for quadrotor low-level control. Specifically, by identifying the rotational and reflectional symmetries in quadrotor dynamics and encoding these symmetries into equivariant network models, we remove redundancies of learning in the state-action space. This approach enables the optimal control action learned in one configuration to automatically generalize into other configurations via symmetry, thereby enhancing data efficiency. Experimental results demonstrate that our equivariant approaches significantly outperform their non-equivariant counterparts in terms of learning efficiency and flight performance.
title Equivariant Reinforcement Learning Frameworks for Quadrotor Low-Level Control
topic Robotics
Optimization and Control
url https://arxiv.org/abs/2502.20500