Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Guo, Jie, Chen, Hao, Song, Bin, Chi, Yuhao, Yuen, Chau, Yu, Fei Richard, Li, Geoffrey Ye, Niyato, Dusit
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910302520475648
author Guo, Jie
Chen, Hao
Song, Bin
Chi, Yuhao
Yuen, Chau
Yu, Fei Richard
Li, Geoffrey Ye
Niyato, Dusit
author_facet Guo, Jie
Chen, Hao
Song, Bin
Chi, Yuhao
Yuen, Chau
Yu, Fei Richard
Li, Geoffrey Ye
Niyato, Dusit
contents In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic relays and the adaptive adjustment capability of edge intelligence can be integrated to improve task performance. Specifically, we propose the key techniques in the framework, such as semantic alignment and complement, a semantic relay scheme for deep joint source-channel relay coding, and collaborative device-server optimization and inference. Furthermore, a multimodal classification task is used as an example to demonstrate the benefits of the proposed DTCN over existing methods. Numerical results validate that DTCN can significantly improve the accuracy of classification tasks, even in harsh communication scenarios (e.g., low signal-to-noise regime), thanks to multimodal semantic relay and edge intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2401_09904
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence
Guo, Jie
Chen, Hao
Song, Bin
Chi, Yuhao
Yuen, Chau
Yu, Fei Richard
Li, Geoffrey Ye
Niyato, Dusit
Signal Processing
In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic relays and the adaptive adjustment capability of edge intelligence can be integrated to improve task performance. Specifically, we propose the key techniques in the framework, such as semantic alignment and complement, a semantic relay scheme for deep joint source-channel relay coding, and collaborative device-server optimization and inference. Furthermore, a multimodal classification task is used as an example to demonstrate the benefits of the proposed DTCN over existing methods. Numerical results validate that DTCN can significantly improve the accuracy of classification tasks, even in harsh communication scenarios (e.g., low signal-to-noise regime), thanks to multimodal semantic relay and edge intelligence.
title Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence
topic Signal Processing
url https://arxiv.org/abs/2401.09904