Multi-Modal Transformer and Reinforcement Learning-based Beam Management

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ghassemi, Mohammad, Zhang, Han, Afana, Ali, Sediq, Akram Bin, Erol-Kantarci, Melike
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929561097207808
author Ghassemi, Mohammad
Zhang, Han
Afana, Ali
Sediq, Akram Bin
Erol-Kantarci, Melike
author_facet Ghassemi, Mohammad
Zhang, Han
Afana, Ali
Sediq, Akram Bin
Erol-Kantarci, Melike
contents Beam management is an important technique to improve signal strength and reduce interference in wireless communication systems. Recently, there has been increasing interest in using diverse sensing modalities for beam management. However, it remains a big challenge to process multi-modal data efficiently and extract useful information. On the other hand, the recently emerging multi-modal transformer (MMT) is a promising technique that can process multi-modal data by capturing long-range dependencies. While MMT is highly effective in handling multi-modal data and providing robust beam management, integrating reinforcement learning (RL) further enhances their adaptability in dynamic environments. In this work, we propose a two-step beam management method by combining MMT with RL for dynamic beam index prediction. In the first step, we divide available beam indices into several groups and leverage MMT to process diverse data modalities to predict the optimal beam group. In the second step, we employ RL for fast beam decision-making within each group, which in return maximizes throughput. Our proposed framework is tested on a 6G dataset. In this testing scenario, it achieves higher beam prediction accuracy and system throughput compared to both the MMT-only based method and the RL-only based method.
format Preprint
id arxiv_https___arxiv_org_abs_2410_19859
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-Modal Transformer and Reinforcement Learning-based Beam Management
Ghassemi, Mohammad
Zhang, Han
Afana, Ali
Sediq, Akram Bin
Erol-Kantarci, Melike
Signal Processing
Artificial Intelligence
Beam management is an important technique to improve signal strength and reduce interference in wireless communication systems. Recently, there has been increasing interest in using diverse sensing modalities for beam management. However, it remains a big challenge to process multi-modal data efficiently and extract useful information. On the other hand, the recently emerging multi-modal transformer (MMT) is a promising technique that can process multi-modal data by capturing long-range dependencies. While MMT is highly effective in handling multi-modal data and providing robust beam management, integrating reinforcement learning (RL) further enhances their adaptability in dynamic environments. In this work, we propose a two-step beam management method by combining MMT with RL for dynamic beam index prediction. In the first step, we divide available beam indices into several groups and leverage MMT to process diverse data modalities to predict the optimal beam group. In the second step, we employ RL for fast beam decision-making within each group, which in return maximizes throughput. Our proposed framework is tested on a 6G dataset. In this testing scenario, it achieves higher beam prediction accuracy and system throughput compared to both the MMT-only based method and the RL-only based method.
title Multi-Modal Transformer and Reinforcement Learning-based Beam Management
topic Signal Processing
Artificial Intelligence
url https://arxiv.org/abs/2410.19859