Multi-User Beamforming with Deep Reinforcement Learning in Sensing-Aided Communication
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913828501979136 |
|---|---|
| author | Wang, Xiyu Berardinelli, Gilberto Cheng, Hei Victor Popovski, Petar Adeogun, Ramoni |
| author_facet | Wang, Xiyu Berardinelli, Gilberto Cheng, Hei Victor Popovski, Petar Adeogun, Ramoni |
| contents | Mobile users are prone to experience beam failure due to beam drifting in millimeter wave (mmWave) communications. Sensing can help alleviate beam drifting with timely beam changes and low overhead since it does not need user feedback. This work studies the problem of optimizing sensing-aided communication by dynamically managing beams allocated to mobile users. A multi-beam scheme is introduced, which allocates multiple beams to the users that need an update on the angle of departure (AoD) estimates and a single beam to the users that have satisfied AoD estimation precision. A deep reinforcement learning (DRL) assisted method is developed to optimize the beam allocation policy, relying only upon the sensing echoes. For comparison, a heuristic AoD-based method using approximated Cramér-Rao lower bound (CRLB) for allocation is also presented. Both methods require neither user feedback nor prior state evolution information. Results show that the DRL-assisted method achieves a considerable gain in throughput than the conventional beam sweeping method and the AoD-based method, and it is robust to different user speeds. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_05956 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Multi-User Beamforming with Deep Reinforcement Learning in Sensing-Aided Communication Wang, Xiyu Berardinelli, Gilberto Cheng, Hei Victor Popovski, Petar Adeogun, Ramoni Signal Processing Machine Learning Networking and Internet Architecture Mobile users are prone to experience beam failure due to beam drifting in millimeter wave (mmWave) communications. Sensing can help alleviate beam drifting with timely beam changes and low overhead since it does not need user feedback. This work studies the problem of optimizing sensing-aided communication by dynamically managing beams allocated to mobile users. A multi-beam scheme is introduced, which allocates multiple beams to the users that need an update on the angle of departure (AoD) estimates and a single beam to the users that have satisfied AoD estimation precision. A deep reinforcement learning (DRL) assisted method is developed to optimize the beam allocation policy, relying only upon the sensing echoes. For comparison, a heuristic AoD-based method using approximated Cramér-Rao lower bound (CRLB) for allocation is also presented. Both methods require neither user feedback nor prior state evolution information. Results show that the DRL-assisted method achieves a considerable gain in throughput than the conventional beam sweeping method and the AoD-based method, and it is robust to different user speeds. |
| title | Multi-User Beamforming with Deep Reinforcement Learning in Sensing-Aided Communication |
| topic | Signal Processing Machine Learning Networking and Internet Architecture |
| url | https://arxiv.org/abs/2505.05956 |