Transfer learning of state-based potential games for process optimization in decentralized manufacturing systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yuwono, Steve, Schwung, Dorothea, Schwung, Andreas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917175786209280
author Yuwono, Steve
Schwung, Dorothea
Schwung, Andreas
author_facet Yuwono, Steve
Schwung, Dorothea
Schwung, Andreas
contents This paper presents a novel online transfer learning approach in state-based potential games (TL-SbPGs) for distributed self-optimization in manufacturing systems. The approach targets practical industrial scenarios where knowledge sharing among similar players enhances learning in large-scale and decentralized environments. TL-SbPGs enable players to reuse learned policies from others, which improves learning outcomes and accelerates convergence. To accomplish this goal, we develop transfer learning concepts and similarity criteria for players, which offer two distinct settings: (a) predefined similarities between players and (b) dynamically inferred similarities between players during training. The applicability of the SbPG framework to transfer learning is formally established. Furthermore, we present a method to optimize the timing and weighting of knowledge transfer. Experimental results from a laboratory-scale testbed show that TL-SbPGs improve production efficiency and reduce power consumption compared to vanilla SbPGs.
format Preprint
id arxiv_https___arxiv_org_abs_2408_05992
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Transfer learning of state-based potential games for process optimization in decentralized manufacturing systems
Yuwono, Steve
Schwung, Dorothea
Schwung, Andreas
Machine Learning
Artificial Intelligence
Computer Science and Game Theory
This paper presents a novel online transfer learning approach in state-based potential games (TL-SbPGs) for distributed self-optimization in manufacturing systems. The approach targets practical industrial scenarios where knowledge sharing among similar players enhances learning in large-scale and decentralized environments. TL-SbPGs enable players to reuse learned policies from others, which improves learning outcomes and accelerates convergence. To accomplish this goal, we develop transfer learning concepts and similarity criteria for players, which offer two distinct settings: (a) predefined similarities between players and (b) dynamically inferred similarities between players during training. The applicability of the SbPG framework to transfer learning is formally established. Furthermore, we present a method to optimize the timing and weighting of knowledge transfer. Experimental results from a laboratory-scale testbed show that TL-SbPGs improve production efficiency and reduce power consumption compared to vanilla SbPGs.
title Transfer learning of state-based potential games for process optimization in decentralized manufacturing systems
topic Machine Learning
Artificial Intelligence
Computer Science and Game Theory
url https://arxiv.org/abs/2408.05992