Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Lu, Mingyi, Liu, Guowei, Liang, Le, Guo, Chongtao, Ye, Hao, Jin, Shi
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2511.20000
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912727711088640
author Lu, Mingyi
Liu, Guowei
Liang, Le
Guo, Chongtao
Ye, Hao
Jin, Shi
author_facet Lu, Mingyi
Liu, Guowei
Liang, Le
Guo, Chongtao
Ye, Hao
Jin, Shi
contents Collaborative perception, an emerging paradigm in autonomous driving, has been introduced to mitigate the limitations of single-vehicle systems, such as limited sensor range and occlusion. To improve the robustness of inter-vehicle data sharing, semantic communication has recently further been integrated into collaborative perception systems to enhance overall performance. However, practical deployment of such systems is challenged by the heterogeneity of sensors across different connected autonomous vehicles (CAVs). This diversity in perceptual data complicates the design of a unified communication framework and impedes the effective fusion of shared information. To address this challenge, we propose a novel cross-modal semantic communication (CMSC) framework to facilitate effective collaboration among CAVs with disparate sensor configurations. Specifically, the framework first transforms heterogeneous perceptual features from different sensor modalities into a unified and standardized semantic space. Subsequently, encoding, transmission, and decoding are performed within this semantic space, enabling seamless and effective information fusion. Extensive experiments demonstrate that CMSC achieves significantly stronger perception performance than existing methods, particularly in low signal-to-noise ratio (SNR) regimes.
format Preprint
id arxiv_https___arxiv_org_abs_2511_20000
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cross-Modal Semantic Communication for Heterogeneous Collaborative Perception
Lu, Mingyi
Liu, Guowei
Liang, Le
Guo, Chongtao
Ye, Hao
Jin, Shi
Signal Processing
Collaborative perception, an emerging paradigm in autonomous driving, has been introduced to mitigate the limitations of single-vehicle systems, such as limited sensor range and occlusion. To improve the robustness of inter-vehicle data sharing, semantic communication has recently further been integrated into collaborative perception systems to enhance overall performance. However, practical deployment of such systems is challenged by the heterogeneity of sensors across different connected autonomous vehicles (CAVs). This diversity in perceptual data complicates the design of a unified communication framework and impedes the effective fusion of shared information. To address this challenge, we propose a novel cross-modal semantic communication (CMSC) framework to facilitate effective collaboration among CAVs with disparate sensor configurations. Specifically, the framework first transforms heterogeneous perceptual features from different sensor modalities into a unified and standardized semantic space. Subsequently, encoding, transmission, and decoding are performed within this semantic space, enabling seamless and effective information fusion. Extensive experiments demonstrate that CMSC achieves significantly stronger perception performance than existing methods, particularly in low signal-to-noise ratio (SNR) regimes.
title Cross-Modal Semantic Communication for Heterogeneous Collaborative Perception
topic Signal Processing
url https://arxiv.org/abs/2511.20000