Reinforcement learning to maximise wind turbine energy generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Soler, Daniel, Mariño, Oscar, Huergo, David, de Frutos, Martín, Ferrer, Esteban
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910335311544320
author Soler, Daniel
Mariño, Oscar
Huergo, David
de Frutos, Martín
Ferrer, Esteban
author_facet Soler, Daniel
Mariño, Oscar
Huergo, David
de Frutos, Martín
Ferrer, Esteban
contents We propose a reinforcement learning strategy to control wind turbine energy generation by actively changing the rotor speed, the rotor yaw angle and the blade pitch angle. A double deep Q-learning with a prioritized experience replay agent is coupled with a blade element momentum model and is trained to allow control for changing winds. The agent is trained to decide the best control (speed, yaw, pitch) for simple steady winds and is subsequently challenged with real dynamic turbulent winds, showing good performance. The double deep Q- learning is compared with a classic value iteration reinforcement learning control and both strategies outperform a classic PID control in all environments. Furthermore, the reinforcement learning approach is well suited to changing environments including turbulent/gusty winds, showing great adaptability. Finally, we compare all control strategies with real winds and compute the annual energy production. In this case, the double deep Q-learning algorithm also outperforms classic methodologies.
format Preprint
id arxiv_https___arxiv_org_abs_2402_11384
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reinforcement learning to maximise wind turbine energy generation
Soler, Daniel
Mariño, Oscar
Huergo, David
de Frutos, Martín
Ferrer, Esteban
Machine Learning
Mathematical Physics
Optimization and Control
We propose a reinforcement learning strategy to control wind turbine energy generation by actively changing the rotor speed, the rotor yaw angle and the blade pitch angle. A double deep Q-learning with a prioritized experience replay agent is coupled with a blade element momentum model and is trained to allow control for changing winds. The agent is trained to decide the best control (speed, yaw, pitch) for simple steady winds and is subsequently challenged with real dynamic turbulent winds, showing good performance. The double deep Q- learning is compared with a classic value iteration reinforcement learning control and both strategies outperform a classic PID control in all environments. Furthermore, the reinforcement learning approach is well suited to changing environments including turbulent/gusty winds, showing great adaptability. Finally, we compare all control strategies with real winds and compute the annual energy production. In this case, the double deep Q-learning algorithm also outperforms classic methodologies.
title Reinforcement learning to maximise wind turbine energy generation
topic Machine Learning
Mathematical Physics
Optimization and Control
url https://arxiv.org/abs/2402.11384