HRL-TSCH: A Hierarchical Reinforcement Learning-based TSCH Scheduler for IIoT

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jurado-Lasso, F. Fernando, Orfanidis, Charalampos, Jurado, J. F., Fafoutis, Xenofon
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929339513176064
author Jurado-Lasso, F. Fernando
Orfanidis, Charalampos
Jurado, J. F.
Fafoutis, Xenofon
author_facet Jurado-Lasso, F. Fernando
Orfanidis, Charalampos
Jurado, J. F.
Fafoutis, Xenofon
contents The Industrial Internet of Things (IIoT) demands adaptable Networked Embedded Systems (NES) for optimal performance. Combined with recent advances in Artificial Intelligence (AI), tailored solutions can be developed to meet specific application requirements. This study introduces HRL-TSCH, an approach rooted in Hierarchical Reinforcement Learning (HRL), to devise Time Slotted Channel Hopping (TSCH) schedules provisioning IIoT demand. HRL-TSCH employs dual policies: one at a higher level for TSCH schedule link management, and another at a lower level for timeslot and channel assignments. The proposed RL agents address a multi-objective problem, optimizing throughput, power efficiency, and network delay based on predefined application requirements. Simulation experiments demonstrate HRL-TSCH superiority over existing state-of-art approaches, effectively achieving an optimal balance between throughput, power consumption, and delay, thereby enhancing IIoT network performance.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10368
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HRL-TSCH: A Hierarchical Reinforcement Learning-based TSCH Scheduler for IIoT
Jurado-Lasso, F. Fernando
Orfanidis, Charalampos
Jurado, J. F.
Fafoutis, Xenofon
Networking and Internet Architecture
The Industrial Internet of Things (IIoT) demands adaptable Networked Embedded Systems (NES) for optimal performance. Combined with recent advances in Artificial Intelligence (AI), tailored solutions can be developed to meet specific application requirements. This study introduces HRL-TSCH, an approach rooted in Hierarchical Reinforcement Learning (HRL), to devise Time Slotted Channel Hopping (TSCH) schedules provisioning IIoT demand. HRL-TSCH employs dual policies: one at a higher level for TSCH schedule link management, and another at a lower level for timeslot and channel assignments. The proposed RL agents address a multi-objective problem, optimizing throughput, power efficiency, and network delay based on predefined application requirements. Simulation experiments demonstrate HRL-TSCH superiority over existing state-of-art approaches, effectively achieving an optimal balance between throughput, power consumption, and delay, thereby enhancing IIoT network performance.
title HRL-TSCH: A Hierarchical Reinforcement Learning-based TSCH Scheduler for IIoT
topic Networking and Internet Architecture
url https://arxiv.org/abs/2401.10368