Importance-Aware Source-Channel Coding for Multi-Modal Task-Oriented Semantic Communication

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ma, Yi, Xu, Chunmei, Liu, Zhenyu, Zhang, Siqi, Tafazolli, Rahim
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909506026340352
author Ma, Yi
Xu, Chunmei
Liu, Zhenyu
Zhang, Siqi
Tafazolli, Rahim
author_facet Ma, Yi
Xu, Chunmei
Liu, Zhenyu
Zhang, Siqi
Tafazolli, Rahim
contents This paper explores the concept of information importance in multi-modal task-oriented semantic communication systems, emphasizing the need for high accuracy and efficiency to fulfill task-specific objectives. At the transmitter, generative AI (GenAI) is employed to partition visual data objects into semantic segments, each representing distinct, task-relevant information. These segments are subsequently encoded into tokens, enabling precise and adaptive transmission control. Building on this frame work, we present importance-aware source and channel coding strategies that dynamically adjust to varying levels of significance at the segment, token, and bit levels. The proposed strategies prioritize high fidelity for essential information while permitting controlled distortion for less critical elements, optimizing overall resource utilization. Furthermore, we address the source-channel coding challenge in semantic multiuser systems, particularly in multicast scenarios, where segment importance varies among receivers. To tackle these challenges, we propose solutions such as rate-splitting coded progressive transmission, ensuring flexibility and robustness in task-specific semantic communication.
format Preprint
id arxiv_https___arxiv_org_abs_2502_16194
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Importance-Aware Source-Channel Coding for Multi-Modal Task-Oriented Semantic Communication
Ma, Yi
Xu, Chunmei
Liu, Zhenyu
Zhang, Siqi
Tafazolli, Rahim
Signal Processing
This paper explores the concept of information importance in multi-modal task-oriented semantic communication systems, emphasizing the need for high accuracy and efficiency to fulfill task-specific objectives. At the transmitter, generative AI (GenAI) is employed to partition visual data objects into semantic segments, each representing distinct, task-relevant information. These segments are subsequently encoded into tokens, enabling precise and adaptive transmission control. Building on this frame work, we present importance-aware source and channel coding strategies that dynamically adjust to varying levels of significance at the segment, token, and bit levels. The proposed strategies prioritize high fidelity for essential information while permitting controlled distortion for less critical elements, optimizing overall resource utilization. Furthermore, we address the source-channel coding challenge in semantic multiuser systems, particularly in multicast scenarios, where segment importance varies among receivers. To tackle these challenges, we propose solutions such as rate-splitting coded progressive transmission, ensuring flexibility and robustness in task-specific semantic communication.
title Importance-Aware Source-Channel Coding for Multi-Modal Task-Oriented Semantic Communication
topic Signal Processing
url https://arxiv.org/abs/2502.16194