Deep-Reinforcement-Learning-Based Adaptive State-Feedback Control for Inter-Area Oscillation Damping with Continuous Eigenvalue Configurations

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liang, Siyuan, Huo, Long, Qin, Wenyu, Chen, Xin, Sun, Peiyuan
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912461309870080
author Liang, Siyuan
Huo, Long
Qin, Wenyu
Chen, Xin
Sun, Peiyuan
author_facet Liang, Siyuan
Huo, Long
Qin, Wenyu
Chen, Xin
Sun, Peiyuan
contents Controlling inter-area oscillation (IAO) across wide areas is crucial for the stability of modern power systems. Recent advances in deep learning, combined with the extensive deployment of phasor measurement units (PMUs) and generator sensors, have catalyzed the development of data-driven IAO damping controllers. In this paper, a novel IAO damping control framework is presented by modeling the control problem as a Markov Decision Process (MDP) and solving it through deep reinforcement learning (DRL). The DRL-based controller is trained in the state space with continuous eigenvalue configurations. To optimize control performance and cost-efficiency, only a subset of generators, identified by global participation factors, are selected for control. In addition, a switching control strategy (SCS) is introduced that effectively integrates the DRL-based controller with power system stabilizers (PSSs) to enhance overall performance. The simulation results on the IEEE 39-bus New England power system show that the proposed method outperforms two benchmark methods regarding the transient response. The DRL-based controller trained on the linear state-space environment can be directly tested in the nonlinear differential-algebraic environment. The robustness of the proposed method against communication delays has been thoroughly investigated.
format Preprint
id arxiv_https___arxiv_org_abs_2301_09321
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Deep-Reinforcement-Learning-Based Adaptive State-Feedback Control for Inter-Area Oscillation Damping with Continuous Eigenvalue Configurations
Liang, Siyuan
Huo, Long
Qin, Wenyu
Chen, Xin
Sun, Peiyuan
Systems and Control
Controlling inter-area oscillation (IAO) across wide areas is crucial for the stability of modern power systems. Recent advances in deep learning, combined with the extensive deployment of phasor measurement units (PMUs) and generator sensors, have catalyzed the development of data-driven IAO damping controllers. In this paper, a novel IAO damping control framework is presented by modeling the control problem as a Markov Decision Process (MDP) and solving it through deep reinforcement learning (DRL). The DRL-based controller is trained in the state space with continuous eigenvalue configurations. To optimize control performance and cost-efficiency, only a subset of generators, identified by global participation factors, are selected for control. In addition, a switching control strategy (SCS) is introduced that effectively integrates the DRL-based controller with power system stabilizers (PSSs) to enhance overall performance. The simulation results on the IEEE 39-bus New England power system show that the proposed method outperforms two benchmark methods regarding the transient response. The DRL-based controller trained on the linear state-space environment can be directly tested in the nonlinear differential-algebraic environment. The robustness of the proposed method against communication delays has been thoroughly investigated.
title Deep-Reinforcement-Learning-Based Adaptive State-Feedback Control for Inter-Area Oscillation Damping with Continuous Eigenvalue Configurations
topic Systems and Control
url https://arxiv.org/abs/2301.09321