Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917607343390720 |
|---|---|
| author | Chen, Xiaodi Zhang, Meng Wu, Zhengguang Wu, Ligang Guan, Xiaohong |
| author_facet | Chen, Xiaodi Zhang, Meng Wu, Zhengguang Wu, Ligang Guan, Xiaohong |
| contents | Load frequency control (LFC) is widely employed in power systems to stabilize frequency fluctuation and guarantee power quality. However, most existing LFC methods rely on accurate power system modeling and usually ignore the nonlinear characteristics of the system, limiting controllers' performance. To solve these problems, this paper proposes a model-free LFC method for nonlinear power systems based on deep deterministic policy gradient (DDPG) framework. The proposed method establishes an emulator network to emulate power system dynamics. After defining the action-value function, the emulator network is applied for control actions evaluation instead of the critic network. Then the actor network controller is effectively optimized by estimating the policy gradient based on zeroth-order optimization (ZOO) and backpropagation algorithm. Simulation results and corresponding comparisons demonstrate the designed controller can generate appropriate control actions and has strong adaptability for nonlinear power systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_04374 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning Chen, Xiaodi Zhang, Meng Wu, Zhengguang Wu, Ligang Guan, Xiaohong Systems and Control Artificial Intelligence Load frequency control (LFC) is widely employed in power systems to stabilize frequency fluctuation and guarantee power quality. However, most existing LFC methods rely on accurate power system modeling and usually ignore the nonlinear characteristics of the system, limiting controllers' performance. To solve these problems, this paper proposes a model-free LFC method for nonlinear power systems based on deep deterministic policy gradient (DDPG) framework. The proposed method establishes an emulator network to emulate power system dynamics. After defining the action-value function, the emulator network is applied for control actions evaluation instead of the critic network. Then the actor network controller is effectively optimized by estimating the policy gradient based on zeroth-order optimization (ZOO) and backpropagation algorithm. Simulation results and corresponding comparisons demonstrate the designed controller can generate appropriate control actions and has strong adaptability for nonlinear power systems. |
| title | Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning |
| topic | Systems and Control Artificial Intelligence |
| url | https://arxiv.org/abs/2403.04374 |