Foundation Model-Aided Deep Reinforcement Learning for RIS-Assisted Wireless Communication

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ghassemi, Mohammad, Mobarak, Sara Farrag, Zhang, Han, Afana, Ali, Sediq, Akram Bin, Erol-Kantarci, Melike
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909646100365312
author Ghassemi, Mohammad
Mobarak, Sara Farrag
Zhang, Han
Afana, Ali
Sediq, Akram Bin
Erol-Kantarci, Melike
author_facet Ghassemi, Mohammad
Mobarak, Sara Farrag
Zhang, Han
Afana, Ali
Sediq, Akram Bin
Erol-Kantarci, Melike
contents Reconfigurable intelligent surfaces (RIS) have emerged as a promising technology for enhancing wireless communication by dynamically controlling signal propagation in the environment. However, their efficient deployment relies on accurate channel state information (CSI), which leads to high channel estimation overhead due to their passive nature and the large number of reflective elements. In this work, we solve this challenge by proposing a novel framework that leverages a pre-trained open-source foundation model (FM) named large wireless model (LWM) to process wireless channels and generate versatile and contextualized channel embeddings. These embeddings are then used for the joint optimization of the BS beamforming and RIS configurations. To be more specific, for joint optimization, we design a deep reinforcement learning (DRL) model to automatically select the BS beamforming vector and RIS phase-shift matrix, aiming to maximize the spectral efficiency (SE). This work shows that a pre-trained FM for radio signal understanding can be fine-tuned and integrated with DRL for effective decision-making in wireless networks. It highlights the potential of modality-specific FMs in real-world network optimization. According to the simulation results, the proposed method outperforms the DRL-based approach and beam sweeping-based approach, achieving 9.89% and 43.66% higher SE, respectively.
format Preprint
id arxiv_https___arxiv_org_abs_2506_09855
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Foundation Model-Aided Deep Reinforcement Learning for RIS-Assisted Wireless Communication
Ghassemi, Mohammad
Mobarak, Sara Farrag
Zhang, Han
Afana, Ali
Sediq, Akram Bin
Erol-Kantarci, Melike
Signal Processing
Reconfigurable intelligent surfaces (RIS) have emerged as a promising technology for enhancing wireless communication by dynamically controlling signal propagation in the environment. However, their efficient deployment relies on accurate channel state information (CSI), which leads to high channel estimation overhead due to their passive nature and the large number of reflective elements. In this work, we solve this challenge by proposing a novel framework that leverages a pre-trained open-source foundation model (FM) named large wireless model (LWM) to process wireless channels and generate versatile and contextualized channel embeddings. These embeddings are then used for the joint optimization of the BS beamforming and RIS configurations. To be more specific, for joint optimization, we design a deep reinforcement learning (DRL) model to automatically select the BS beamforming vector and RIS phase-shift matrix, aiming to maximize the spectral efficiency (SE). This work shows that a pre-trained FM for radio signal understanding can be fine-tuned and integrated with DRL for effective decision-making in wireless networks. It highlights the potential of modality-specific FMs in real-world network optimization. According to the simulation results, the proposed method outperforms the DRL-based approach and beam sweeping-based approach, achieving 9.89% and 43.66% higher SE, respectively.
title Foundation Model-Aided Deep Reinforcement Learning for RIS-Assisted Wireless Communication
topic Signal Processing
url https://arxiv.org/abs/2506.09855