Self-optimization in distributed manufacturing systems using Modular State-based Stackelberg Games

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yuwono, Steve, Hussain, Ahmar Kamal, Schwung, Dorothea, Schwung, Andreas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913568012632064
author Yuwono, Steve
Hussain, Ahmar Kamal
Schwung, Dorothea
Schwung, Andreas
author_facet Yuwono, Steve
Hussain, Ahmar Kamal
Schwung, Dorothea
Schwung, Andreas
contents In this study, we introduce Modular State-based Stackelberg Games (Mod-SbSG), a novel game structure developed for distributed self-learning in modular manufacturing systems. Mod-SbSG enhances cooperative decision-making among self-learning agents within production systems by integrating State-based Potential Games (SbPG) with Stackelberg games. This hierarchical structure assigns more important modules of the manufacturing system a first-mover advantage, while less important modules respond optimally to the leaders' decisions. This decision-making process differs from typical multi-agent learning algorithms in manufacturing systems, where decisions are made simultaneously. We provide convergence guarantees for the novel game structure and design learning algorithms to account for the hierarchical game structure. We further analyse the effects of single-leader/multiple-follower and multiple-leader/multiple-follower scenarios within a Mod-SbSG. To assess its effectiveness, we implement and test Mod-SbSG in an industrial control setting using two laboratory-scale testbeds featuring sequential and serial-parallel processes. The proposed approach delivers promising results compared to the vanilla SbPG, which reduces overflow by 97.1%, and in some cases, prevents overflow entirely. Additionally, it decreases power consumption by 5-13% while satisfying the production demand, which significantly improves potential (global objective) values.
format Preprint
id arxiv_https___arxiv_org_abs_2410_22912
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-optimization in distributed manufacturing systems using Modular State-based Stackelberg Games
Yuwono, Steve
Hussain, Ahmar Kamal
Schwung, Dorothea
Schwung, Andreas
Artificial Intelligence
Computer Science and Game Theory
Machine Learning
In this study, we introduce Modular State-based Stackelberg Games (Mod-SbSG), a novel game structure developed for distributed self-learning in modular manufacturing systems. Mod-SbSG enhances cooperative decision-making among self-learning agents within production systems by integrating State-based Potential Games (SbPG) with Stackelberg games. This hierarchical structure assigns more important modules of the manufacturing system a first-mover advantage, while less important modules respond optimally to the leaders' decisions. This decision-making process differs from typical multi-agent learning algorithms in manufacturing systems, where decisions are made simultaneously. We provide convergence guarantees for the novel game structure and design learning algorithms to account for the hierarchical game structure. We further analyse the effects of single-leader/multiple-follower and multiple-leader/multiple-follower scenarios within a Mod-SbSG. To assess its effectiveness, we implement and test Mod-SbSG in an industrial control setting using two laboratory-scale testbeds featuring sequential and serial-parallel processes. The proposed approach delivers promising results compared to the vanilla SbPG, which reduces overflow by 97.1%, and in some cases, prevents overflow entirely. Additionally, it decreases power consumption by 5-13% while satisfying the production demand, which significantly improves potential (global objective) values.
title Self-optimization in distributed manufacturing systems using Modular State-based Stackelberg Games
topic Artificial Intelligence
Computer Science and Game Theory
Machine Learning
url https://arxiv.org/abs/2410.22912