Cooperative Energy Scheduling of Multi-Microgrids Based on Risk-Sensitive Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Rongxiang, Li, Bo, Li, Jinghua, Song, Yuguang, Zhu, Ziqing, Yang, Wentao, Li, Zhengmao, Pouresmaeil, Edris, Kim, Joshua Y.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908721953636352
author Zhang, Rongxiang
Li, Bo
Li, Jinghua
Song, Yuguang
Zhu, Ziqing
Yang, Wentao
Li, Zhengmao
Pouresmaeil, Edris
Kim, Joshua Y.
author_facet Zhang, Rongxiang
Li, Bo
Li, Jinghua
Song, Yuguang
Zhu, Ziqing
Yang, Wentao
Li, Zhengmao
Pouresmaeil, Edris
Kim, Joshua Y.
contents With the rapid development of distributed renewable energy, multi-microgrids play an increasingly important role in improving the flexibility and reliability of energy supply. Reinforcement learning has shown great potential in coordination strategies due to its model-free nature. Current methods lack explicit quantification of the relationship between individual and joint risk values, resulting in obscured credit assignment. Moreover, they often depend on explicit communication, which becomes inefficient as system complexity grows. To address these challenges, this paper proposes a risk-sensitive reinforcement learning framework with shared memory (RRL-SM) for multi-microgrid scheduling. Specifically, a risk-sensitive value factorization scheme is proposed to quantify the relationship between individual and joint risk values by leveraging distributional modeling and attention-based representations, thereby aligning local decisions with global risk objectives. An implicit shared-memory coordination mechanism is implemented through a global memory space to enhance the overall efficiency of decentralized decision-making. Collectively, the integrated approach delivers more reliable cooperative scheduling under renewable energy uncertainty. Simulation results show that RRL-SM reduces load-shedding risk by 84.5%, demonstrating a favorable balance between reliability and economic performance.
format Preprint
id arxiv_https___arxiv_org_abs_2512_17246
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cooperative Energy Scheduling of Multi-Microgrids Based on Risk-Sensitive Reinforcement Learning
Zhang, Rongxiang
Li, Bo
Li, Jinghua
Song, Yuguang
Zhu, Ziqing
Yang, Wentao
Li, Zhengmao
Pouresmaeil, Edris
Kim, Joshua Y.
Systems and Control
With the rapid development of distributed renewable energy, multi-microgrids play an increasingly important role in improving the flexibility and reliability of energy supply. Reinforcement learning has shown great potential in coordination strategies due to its model-free nature. Current methods lack explicit quantification of the relationship between individual and joint risk values, resulting in obscured credit assignment. Moreover, they often depend on explicit communication, which becomes inefficient as system complexity grows. To address these challenges, this paper proposes a risk-sensitive reinforcement learning framework with shared memory (RRL-SM) for multi-microgrid scheduling. Specifically, a risk-sensitive value factorization scheme is proposed to quantify the relationship between individual and joint risk values by leveraging distributional modeling and attention-based representations, thereby aligning local decisions with global risk objectives. An implicit shared-memory coordination mechanism is implemented through a global memory space to enhance the overall efficiency of decentralized decision-making. Collectively, the integrated approach delivers more reliable cooperative scheduling under renewable energy uncertainty. Simulation results show that RRL-SM reduces load-shedding risk by 84.5%, demonstrating a favorable balance between reliability and economic performance.
title Cooperative Energy Scheduling of Multi-Microgrids Based on Risk-Sensitive Reinforcement Learning
topic Systems and Control
url https://arxiv.org/abs/2512.17246