Lyapunov-guided Multi-Agent Reinforcement Learning for Delay-Sensitive Wireless Scheduling
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929576275345408 |
|---|---|
| author | Zhang, Cheng Wei, Lan Fan, Ji Liu, Zening Huang, Yongming |
| author_facet | Zhang, Cheng Wei, Lan Fan, Ji Liu, Zening Huang, Yongming |
| contents | In this paper, a two-stage intelligent scheduler is proposed to minimize the packet-level delay jitter while guaranteeing delay bound. Firstly, Lyapunov technology is employed to transform the delay-violation constraint into a sequential slot-level queue stability problem. Secondly, a hierarchical scheme is proposed to solve the resource allocation between multiple base stations and users, where the multi-agent reinforcement learning (MARL) gives the user priority and the number of scheduled packets, while the underlying scheduler allocates the resource. Our proposed scheme achieves lower delay jitter and delay violation rate than the Round-Robin Earliest Deadline First algorithm and MARL with delay violation penalty. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_01766 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Lyapunov-guided Multi-Agent Reinforcement Learning for Delay-Sensitive Wireless Scheduling Zhang, Cheng Wei, Lan Fan, Ji Liu, Zening Huang, Yongming Information Theory In this paper, a two-stage intelligent scheduler is proposed to minimize the packet-level delay jitter while guaranteeing delay bound. Firstly, Lyapunov technology is employed to transform the delay-violation constraint into a sequential slot-level queue stability problem. Secondly, a hierarchical scheme is proposed to solve the resource allocation between multiple base stations and users, where the multi-agent reinforcement learning (MARL) gives the user priority and the number of scheduled packets, while the underlying scheduler allocates the resource. Our proposed scheme achieves lower delay jitter and delay violation rate than the Round-Robin Earliest Deadline First algorithm and MARL with delay violation penalty. |
| title | Lyapunov-guided Multi-Agent Reinforcement Learning for Delay-Sensitive Wireless Scheduling |
| topic | Information Theory |
| url | https://arxiv.org/abs/2411.01766 |