Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.10432 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908424779857920 |
|---|---|
| author | Zheng, Can He, Jiguang Cai, Guofa Yu, Zitong Kang, Chung G. |
| author_facet | Zheng, Can He, Jiguang Cai, Guofa Yu, Zitong Kang, Chung G. |
| contents | In this paper, we propose BeamLLM, a vision-aided millimeter-wave (mmWave) beam prediction framework leveraging large language models (LLMs) to address the challenges of high training overhead and latency in mmWave communication systems. By combining computer vision (CV) with LLMs' cross-modal reasoning capabilities, the framework extracts user equipment (UE) positional features from RGB images and aligns visual-temporal features with LLMs' semantic space through reprogramming techniques. Evaluated on a realistic vehicle-to-infrastructure (V2I) scenario, the proposed method achieves 61.01% top-1 accuracy and 97.39% top-3 accuracy in standard prediction tasks, significantly outperforming traditional deep learning models. In few-shot prediction scenarios, the performance degradation is limited to 12.56% (top-1) and 5.55% (top-3) from time sample 1 to 10, demonstrating superior prediction capability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10432 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Models Zheng, Can He, Jiguang Cai, Guofa Yu, Zitong Kang, Chung G. Machine Learning Computation and Language In this paper, we propose BeamLLM, a vision-aided millimeter-wave (mmWave) beam prediction framework leveraging large language models (LLMs) to address the challenges of high training overhead and latency in mmWave communication systems. By combining computer vision (CV) with LLMs' cross-modal reasoning capabilities, the framework extracts user equipment (UE) positional features from RGB images and aligns visual-temporal features with LLMs' semantic space through reprogramming techniques. Evaluated on a realistic vehicle-to-infrastructure (V2I) scenario, the proposed method achieves 61.01% top-1 accuracy and 97.39% top-3 accuracy in standard prediction tasks, significantly outperforming traditional deep learning models. In few-shot prediction scenarios, the performance degradation is limited to 12.56% (top-1) and 5.55% (top-3) from time sample 1 to 10, demonstrating superior prediction capability. |
| title | BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Models |
| topic | Machine Learning Computation and Language |
| url | https://arxiv.org/abs/2503.10432 |