Saved in:
Bibliographic Details
Main Authors: Dao, Duc Nguyen, Kokkeler, André B. J., Zhang, Haibin, Miao, Yang
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.25496
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908619084136448
author Dao, Duc Nguyen
Kokkeler, André B. J.
Zhang, Haibin
Miao, Yang
author_facet Dao, Duc Nguyen
Kokkeler, André B. J.
Zhang, Haibin
Miao, Yang
contents Integrated Sensing and Communication (ISAC) is a key enabler in 6G networks, where sensing and communication capabilities are designed to complement and enhance each other. One of the main challenges in ISAC lies in resource allocation, which becomes computationally demanding in dynamic environments requiring real-time adaptation. In this paper, we propose a Deep Reinforcement Learning (DRL)-based approach for dynamic beamforming and power allocation in ISAC systems. The DRL agent interacts with the environment and learns optimal strategies through trial and error, guided by predefined rewards. Simulation results show that the DRL-based solution converges within 2000 episodes and achieves up to 80\% of the spectral efficiency of a semidefinite relaxation (SDR) benchmark. More importantly, it offers a significant improvement in runtime performance, achieving decision times of around 20 ms compared to 4500 ms for the SDR method. Furthermore, compared with a Deep Q-Network (DQN) benchmark employing discrete beamforming, the proposed approach achieves approximately 30\% higher sum-rate with comparable runtime. These results highlight the potential of DRL for enabling real-time, high-performance ISAC in dynamic scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2510_25496
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dynamic Beamforming and Power Allocation in ISAC via Deep Reinforcement Learning
Dao, Duc Nguyen
Kokkeler, André B. J.
Zhang, Haibin
Miao, Yang
Signal Processing
Integrated Sensing and Communication (ISAC) is a key enabler in 6G networks, where sensing and communication capabilities are designed to complement and enhance each other. One of the main challenges in ISAC lies in resource allocation, which becomes computationally demanding in dynamic environments requiring real-time adaptation. In this paper, we propose a Deep Reinforcement Learning (DRL)-based approach for dynamic beamforming and power allocation in ISAC systems. The DRL agent interacts with the environment and learns optimal strategies through trial and error, guided by predefined rewards. Simulation results show that the DRL-based solution converges within 2000 episodes and achieves up to 80\% of the spectral efficiency of a semidefinite relaxation (SDR) benchmark. More importantly, it offers a significant improvement in runtime performance, achieving decision times of around 20 ms compared to 4500 ms for the SDR method. Furthermore, compared with a Deep Q-Network (DQN) benchmark employing discrete beamforming, the proposed approach achieves approximately 30\% higher sum-rate with comparable runtime. These results highlight the potential of DRL for enabling real-time, high-performance ISAC in dynamic scenarios.
title Dynamic Beamforming and Power Allocation in ISAC via Deep Reinforcement Learning
topic Signal Processing
url https://arxiv.org/abs/2510.25496