Saved in:
Bibliographic Details
Main Authors: Nazar, Ahmad M., Celik, Abdulkadir, Selim, Mohamed Y., Abdallah, Asmaa, Qiao, Daji, Eltawil, Ahmed M.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.15769
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908459092410368
author Nazar, Ahmad M.
Celik, Abdulkadir
Selim, Mohamed Y.
Abdallah, Asmaa
Qiao, Daji
Eltawil, Ahmed M.
author_facet Nazar, Ahmad M.
Celik, Abdulkadir
Selim, Mohamed Y.
Abdallah, Asmaa
Qiao, Daji
Eltawil, Ahmed M.
contents Vehicular communication systems operating in the millimeter wave (mmWave) band are highly susceptible to signal blockage from dynamic obstacles such as vehicles, pedestrians, and infrastructure. To address this challenge, we propose a proactive blockage prediction framework that utilizes multi-modal sensing, including camera, GPS, LiDAR, and radar inputs in an infrastructure-to-vehicle (I2V) setting. This approach uses modality-specific deep learning models to process each sensor stream independently and fuses their outputs using a softmax-weighted ensemble strategy based on validation performance. Our evaluations, for up to 1.5s in advance, show that the camera-only model achieves the best standalone trade-off with an F1-score of 97.1% and an inference time of 89.8ms. A camera+radar configuration further improves accuracy to 97.2% F1 at 95.7ms. Our results display the effectiveness and efficiency of multi-modal sensing for mmWave blockage prediction and provide a pathway for proactive wireless communication in dynamic environments.
format Preprint
id arxiv_https___arxiv_org_abs_2507_15769
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networks
Nazar, Ahmad M.
Celik, Abdulkadir
Selim, Mohamed Y.
Abdallah, Asmaa
Qiao, Daji
Eltawil, Ahmed M.
Machine Learning
Vehicular communication systems operating in the millimeter wave (mmWave) band are highly susceptible to signal blockage from dynamic obstacles such as vehicles, pedestrians, and infrastructure. To address this challenge, we propose a proactive blockage prediction framework that utilizes multi-modal sensing, including camera, GPS, LiDAR, and radar inputs in an infrastructure-to-vehicle (I2V) setting. This approach uses modality-specific deep learning models to process each sensor stream independently and fuses their outputs using a softmax-weighted ensemble strategy based on validation performance. Our evaluations, for up to 1.5s in advance, show that the camera-only model achieves the best standalone trade-off with an F1-score of 97.1% and an inference time of 89.8ms. A camera+radar configuration further improves accuracy to 97.2% F1 at 95.7ms. Our results display the effectiveness and efficiency of multi-modal sensing for mmWave blockage prediction and provide a pathway for proactive wireless communication in dynamic environments.
title Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networks
topic Machine Learning
url https://arxiv.org/abs/2507.15769