Robust Deep Joint Source Channel Coding for Task-Oriented Semantic Communications

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Park, Taewoo, Hong, Eunhye, Jeon, Yo-Seb, Lee, Namyoon, Kim, Yongjune
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916654380744704
author Park, Taewoo
Hong, Eunhye
Jeon, Yo-Seb
Lee, Namyoon
Kim, Yongjune
author_facet Park, Taewoo
Hong, Eunhye
Jeon, Yo-Seb
Lee, Namyoon
Kim, Yongjune
contents Semantic communications based on deep joint source-channel coding (JSCC) aim to improve communication efficiency by transmitting only task-relevant information. However, ensuring robustness to the stochasticity of communication channels remains a key challenge in learning-based JSCC. In this paper, we propose a novel regularization technique for learning-based JSCC to enhance robustness against channel noise. The proposed method utilizes the Kullback-Leibler (KL) divergence as a regularizer term in the training loss, measuring the discrepancy between two posterior distributions: one under noisy channel conditions (noisy posterior) and one for a noise-free system (noise-free posterior). Reducing this KL divergence mitigates the impact of channel noise on task performance by keeping the noisy posterior close to the noise-free posterior. We further show that the expectation of the KL divergence given the encoded representation can be analytically approximated using the Fisher information matrix and the covariance matrix of the channel noise. Notably, the proposed regularization is architecture-agnostic, making it broadly applicable to general semantic communication systems over noisy channels. Our experimental results validate that the proposed regularization consistently improves task performance across diverse semantic communication systems and channel conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2503_12907
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust Deep Joint Source Channel Coding for Task-Oriented Semantic Communications
Park, Taewoo
Hong, Eunhye
Jeon, Yo-Seb
Lee, Namyoon
Kim, Yongjune
Signal Processing
Information Theory
Semantic communications based on deep joint source-channel coding (JSCC) aim to improve communication efficiency by transmitting only task-relevant information. However, ensuring robustness to the stochasticity of communication channels remains a key challenge in learning-based JSCC. In this paper, we propose a novel regularization technique for learning-based JSCC to enhance robustness against channel noise. The proposed method utilizes the Kullback-Leibler (KL) divergence as a regularizer term in the training loss, measuring the discrepancy between two posterior distributions: one under noisy channel conditions (noisy posterior) and one for a noise-free system (noise-free posterior). Reducing this KL divergence mitigates the impact of channel noise on task performance by keeping the noisy posterior close to the noise-free posterior. We further show that the expectation of the KL divergence given the encoded representation can be analytically approximated using the Fisher information matrix and the covariance matrix of the channel noise. Notably, the proposed regularization is architecture-agnostic, making it broadly applicable to general semantic communication systems over noisy channels. Our experimental results validate that the proposed regularization consistently improves task performance across diverse semantic communication systems and channel conditions.
title Robust Deep Joint Source Channel Coding for Task-Oriented Semantic Communications
topic Signal Processing
Information Theory
url https://arxiv.org/abs/2503.12907