Stable and Safe Human-aligned Reinforcement Learning through Neural Ordinary Differential Equations
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913355653971968 |
|---|---|
| author | Zhao, Liqun Miao, Keyan Gatsis, Konstantinos Papachristodoulou, Antonis |
| author_facet | Zhao, Liqun Miao, Keyan Gatsis, Konstantinos Papachristodoulou, Antonis |
| contents | Reinforcement learning (RL) excels in applications such as video games, but ensuring safety as well as the ability to achieve the specified goals remains challenging when using RL for real-world problems, such as human-aligned tasks where human safety is paramount. This paper provides safety and stability definitions for such human-aligned tasks, and then proposes an algorithm that leverages neural ordinary differential equations (NODEs) to predict human and robot movements and integrates the control barrier function (CBF) and control Lyapunov function (CLF) with the actor-critic method to help to maintain the safety and stability for human-aligned tasks. Simulation results show that the algorithm helps the controlled robot to reach the desired goal state with fewer safety violations and better sample efficiency compared to other methods in a human-aligned task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_13148 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Stable and Safe Human-aligned Reinforcement Learning through Neural Ordinary Differential Equations Zhao, Liqun Miao, Keyan Gatsis, Konstantinos Papachristodoulou, Antonis Machine Learning Robotics Systems and Control Reinforcement learning (RL) excels in applications such as video games, but ensuring safety as well as the ability to achieve the specified goals remains challenging when using RL for real-world problems, such as human-aligned tasks where human safety is paramount. This paper provides safety and stability definitions for such human-aligned tasks, and then proposes an algorithm that leverages neural ordinary differential equations (NODEs) to predict human and robot movements and integrates the control barrier function (CBF) and control Lyapunov function (CLF) with the actor-critic method to help to maintain the safety and stability for human-aligned tasks. Simulation results show that the algorithm helps the controlled robot to reach the desired goal state with fewer safety violations and better sample efficiency compared to other methods in a human-aligned task. |
| title | Stable and Safe Human-aligned Reinforcement Learning through Neural Ordinary Differential Equations |
| topic | Machine Learning Robotics Systems and Control |
| url | https://arxiv.org/abs/2401.13148 |