Saved in:
Bibliographic Details
Main Authors: Zhou, Mi, Li, Jiazhi, Mortazavi, Masood, Yan, Ning, Abdallah, Chaouki
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2312.04767
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916491346051072
author Zhou, Mi
Li, Jiazhi
Mortazavi, Masood
Yan, Ning
Abdallah, Chaouki
author_facet Zhou, Mi
Li, Jiazhi
Mortazavi, Masood
Yan, Ning
Abdallah, Chaouki
contents In this article, a \underline{S}tate-dependent \underline{M}ulti-\underline{A}gent \underline{D}eep \underline{D}eterministic \underline{P}olicy \underline{G}radient (\textbf{SMADDPG}) method is proposed in order to learn an optimal control policy for regionally switched systems. We observe good performance of this method and explain it in a rigorous mathematical language using some simplifying assumptions in order to motivate the ideas and to apply them to some canonical examples. Using reinforcement learning, the performance of the switched learning-based multi-agent method is compared with the vanilla DDPG in two customized demonstrative environments with one and two-dimensional state spaces.
format Preprint
id arxiv_https___arxiv_org_abs_2312_04767
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Finite Horizon Multi-Agent Reinforcement Learning in Solving Optimal Control of State-Dependent Switched Systems
Zhou, Mi
Li, Jiazhi
Mortazavi, Masood
Yan, Ning
Abdallah, Chaouki
Systems and Control
In this article, a \underline{S}tate-dependent \underline{M}ulti-\underline{A}gent \underline{D}eep \underline{D}eterministic \underline{P}olicy \underline{G}radient (\textbf{SMADDPG}) method is proposed in order to learn an optimal control policy for regionally switched systems. We observe good performance of this method and explain it in a rigorous mathematical language using some simplifying assumptions in order to motivate the ideas and to apply them to some canonical examples. Using reinforcement learning, the performance of the switched learning-based multi-agent method is compared with the vanilla DDPG in two customized demonstrative environments with one and two-dimensional state spaces.
title Finite Horizon Multi-Agent Reinforcement Learning in Solving Optimal Control of State-Dependent Switched Systems
topic Systems and Control
url https://arxiv.org/abs/2312.04767