Multimodal-Wireless: A Large-Scale Dataset for Sensing and Communication

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mao, Tianhao, Liang, Le, Yang, Jie, Ye, Hao, Jin, Shi, Li, Geoffrey Ye
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917265668046848
author Mao, Tianhao
Liang, Le
Yang, Jie
Ye, Hao
Jin, Shi
Li, Geoffrey Ye
author_facet Mao, Tianhao
Liang, Le
Yang, Jie
Ye, Hao
Jin, Shi
Li, Geoffrey Ye
contents This paper presents Multimodal-Wireless, a large-scale open-source dataset for multimodal sensing and communication research. The dataset is generated through an integrated and customizable data pipeline built upon the CARLA simulator and Sionna framework, and features high-resolution communication channel state information (CSI) fully synchronized with five other sensor modalities, namely LiDAR, RGB and depth camera, inertial measurement unit (IMU) and radar, all sampled at 100 Hz. It contains approximately 160,000 frames collected across four virtual towns, sixteen communication scenarios, and three weather conditions. This paper provides a comprehensive overview of the dataset, outlining its key features, overall framework, and technical implementation details. In addition, it explores potential research applications concerning communication and collaborative perception, exemplified by beam prediction using a multimodal large language model. The dataset is open in https://le-liang.github.io/mmw/.
format Preprint
id arxiv_https___arxiv_org_abs_2511_03220
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multimodal-Wireless: A Large-Scale Dataset for Sensing and Communication
Mao, Tianhao
Liang, Le
Yang, Jie
Ye, Hao
Jin, Shi
Li, Geoffrey Ye
Signal Processing
This paper presents Multimodal-Wireless, a large-scale open-source dataset for multimodal sensing and communication research. The dataset is generated through an integrated and customizable data pipeline built upon the CARLA simulator and Sionna framework, and features high-resolution communication channel state information (CSI) fully synchronized with five other sensor modalities, namely LiDAR, RGB and depth camera, inertial measurement unit (IMU) and radar, all sampled at 100 Hz. It contains approximately 160,000 frames collected across four virtual towns, sixteen communication scenarios, and three weather conditions. This paper provides a comprehensive overview of the dataset, outlining its key features, overall framework, and technical implementation details. In addition, it explores potential research applications concerning communication and collaborative perception, exemplified by beam prediction using a multimodal large language model. The dataset is open in https://le-liang.github.io/mmw/.
title Multimodal-Wireless: A Large-Scale Dataset for Sensing and Communication
topic Signal Processing
url https://arxiv.org/abs/2511.03220