Semantic-Aware Multi-Terminal Coding for Gaussian Mixture Sources

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Shi, Yuxuan, Shao, Shuo, Wu, Yongpeng, Chen, Jun, Zhang, Wenjun
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913325472808960
author Shi, Yuxuan
Shao, Shuo
Wu, Yongpeng
Chen, Jun
Zhang, Wenjun
author_facet Shi, Yuxuan
Shao, Shuo
Wu, Yongpeng
Chen, Jun
Zhang, Wenjun
contents A novel distributed source coding model which named semantic-aware multi-terminal (MT) source coding is proposed and investigated in the paper, where multiple agents independently encode an imperceptible semantic source, while both semantic and observations are reconstructed within their respective fidelity criteria. We start from a generalized single-letter characterization of sum rate-distortion region of this problem. Furthermore, we propose a mixed MSE-Log loss framework for this model and specifically depict the rate-distortion bounds when sources are Gaussian mixture distributed. For this case, we first present a relative tight outer bound and explore the activeness of semantic and observation distortion constraints, in which we find that good observation reconstruction will not incur too much semantic errors, but not vice versa. Moreover, we provide a practical coding scheme functioning as an achievable regime of inner bound with the performance analysis and simulation results, which verifies the feasibility of the idea "detect and compress" for Gaussian mixture sources. Our results provide theoretical instructions on the fundamental limits and can be used to guide the practical semantic-aware coding designs for multi-user scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2303_06391
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Semantic-Aware Multi-Terminal Coding for Gaussian Mixture Sources
Shi, Yuxuan
Shao, Shuo
Wu, Yongpeng
Chen, Jun
Zhang, Wenjun
Information Theory
A novel distributed source coding model which named semantic-aware multi-terminal (MT) source coding is proposed and investigated in the paper, where multiple agents independently encode an imperceptible semantic source, while both semantic and observations are reconstructed within their respective fidelity criteria. We start from a generalized single-letter characterization of sum rate-distortion region of this problem. Furthermore, we propose a mixed MSE-Log loss framework for this model and specifically depict the rate-distortion bounds when sources are Gaussian mixture distributed. For this case, we first present a relative tight outer bound and explore the activeness of semantic and observation distortion constraints, in which we find that good observation reconstruction will not incur too much semantic errors, but not vice versa. Moreover, we provide a practical coding scheme functioning as an achievable regime of inner bound with the performance analysis and simulation results, which verifies the feasibility of the idea "detect and compress" for Gaussian mixture sources. Our results provide theoretical instructions on the fundamental limits and can be used to guide the practical semantic-aware coding designs for multi-user scenarios.
title Semantic-Aware Multi-Terminal Coding for Gaussian Mixture Sources
topic Information Theory
url https://arxiv.org/abs/2303.06391