Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916079602761728 |
|---|---|
| author | Li, Dongxu Huang, Jianhao Huang, Chuan Qin, Xiaoqi Zhang, Han Zhang, Ping |
| author_facet | Li, Dongxu Huang, Jianhao Huang, Chuan Qin, Xiaoqi Zhang, Han Zhang, Ping |
| contents | This paper studies the fundamental limit of semantic communications over the discrete memoryless channel. We consider the scenario to send a semantic source consisting of an observation state and its corresponding semantic state, both of which are recovered at the receiver. To derive the performance limitation, we adopt the semantic rate-distortion function (SRDF) to study the relationship among the minimum compression rate, observation distortion, semantic distortion, and channel capacity. For the case with unknown semantic source distribution, while only a set of the source samples is available, we propose a neural-network-based method by leveraging the generative networks to learn the semantic source distribution. Furthermore, for a special case where the semantic state is a deterministic function of the observation, we design a cascade neural network to estimate the SRDF. For the case with perfectly known semantic source distribution, we propose a general Blahut-Arimoto algorithm to effectively compute the SRDF. Finally, experimental results validate our proposed algorithms for the scenarios with ideal Gaussian semantic source and some practical datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_01176 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion Li, Dongxu Huang, Jianhao Huang, Chuan Qin, Xiaoqi Zhang, Han Zhang, Ping Information Theory Machine Learning Signal Processing This paper studies the fundamental limit of semantic communications over the discrete memoryless channel. We consider the scenario to send a semantic source consisting of an observation state and its corresponding semantic state, both of which are recovered at the receiver. To derive the performance limitation, we adopt the semantic rate-distortion function (SRDF) to study the relationship among the minimum compression rate, observation distortion, semantic distortion, and channel capacity. For the case with unknown semantic source distribution, while only a set of the source samples is available, we propose a neural-network-based method by leveraging the generative networks to learn the semantic source distribution. Furthermore, for a special case where the semantic state is a deterministic function of the observation, we design a cascade neural network to estimate the SRDF. For the case with perfectly known semantic source distribution, we propose a general Blahut-Arimoto algorithm to effectively compute the SRDF. Finally, experimental results validate our proposed algorithms for the scenarios with ideal Gaussian semantic source and some practical datasets. |
| title | Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion |
| topic | Information Theory Machine Learning Signal Processing |
| url | https://arxiv.org/abs/2401.01176 |