Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929462383214592 |
|---|---|
| author | Qiao, Li Mashhadi, Mahdi Boloursaz Gao, Zhen Foh, Chuan Heng Xiao, Pei Bennis, Mehdi |
| author_facet | Qiao, Li Mashhadi, Mahdi Boloursaz Gao, Zhen Foh, Chuan Heng Xiao, Pei Bennis, Mehdi |
| contents | Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic communications at extremely low data rates in future wireless networks. In this paper, we develop a latency-aware semantic communications framework with pre-trained generative models. The transmitter performs multi-modal semantic decomposition on the input signal and transmits each semantic stream with the appropriate coding and communication schemes based on the intent. For the prompt, we adopt a re-transmission-based scheme to ensure reliable transmission, and for the other semantic modalities we use an adaptive modulation/coding scheme to achieve robustness to the changing wireless channel. Furthermore, we design a semantic and latency-aware scheme to allocate transmission power to different semantic modalities based on their importance subjected to semantic quality constraints. At the receiver, a pre-trained generative model synthesizes a high fidelity signal using the received multi-stream semantics. Simulation results demonstrate ultra-low-rate, low-latency, and channel-adaptive semantic communications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_17256 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models Qiao, Li Mashhadi, Mahdi Boloursaz Gao, Zhen Foh, Chuan Heng Xiao, Pei Bennis, Mehdi Information Theory Computer Vision and Pattern Recognition Multimedia Signal Processing Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic communications at extremely low data rates in future wireless networks. In this paper, we develop a latency-aware semantic communications framework with pre-trained generative models. The transmitter performs multi-modal semantic decomposition on the input signal and transmits each semantic stream with the appropriate coding and communication schemes based on the intent. For the prompt, we adopt a re-transmission-based scheme to ensure reliable transmission, and for the other semantic modalities we use an adaptive modulation/coding scheme to achieve robustness to the changing wireless channel. Furthermore, we design a semantic and latency-aware scheme to allocate transmission power to different semantic modalities based on their importance subjected to semantic quality constraints. At the receiver, a pre-trained generative model synthesizes a high fidelity signal using the received multi-stream semantics. Simulation results demonstrate ultra-low-rate, low-latency, and channel-adaptive semantic communications. |
| title | Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models |
| topic | Information Theory Computer Vision and Pattern Recognition Multimedia Signal Processing |
| url | https://arxiv.org/abs/2403.17256 |