Federated Learning Enhanced by Feature Reconstruction for Semantic Communication Module Updates of Agents

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huh, Yoon, Kim, Bumjun, Choi, Wan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917280285196288
author Huh, Yoon
Kim, Bumjun
Choi, Wan
author_facet Huh, Yoon
Kim, Bumjun
Choi, Wan
contents Recent advancements in semantic communication have primarily focused on image transmission, where neural network-based joint source-channel coding modules play a central role. However, such systems often experience semantic communication errors due to mismatched knowledge bases between agents and performance degradation from outdated models, necessitating regular model updates. To address these challenges in vector quantization (VQ)-based image semantic communication systems, we propose FedSFR, a novel federated learning framework that incorporates semantic feature reconstruction (FR). FedSFR introduces an FR step at the parameter server and allows a subset of clients to transmit compact feature vectors in lieu of sending full local model updates, thereby improving training stability and communication efficiency. To enable effective FR learning, we design a loss function tailored for VQ-based image semantic communication and demonstrate its validity as a surrogate for image reconstruction error. We further establish a rigorous convergence analysis of FedSFR. Experimental results on two benchmark datasets validate the superiority of FedSFR over existing baselines, especially in capacity-constrained settings, confirming both its effectiveness and robustness.
format Preprint
id arxiv_https___arxiv_org_abs_2508_03248
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Federated Learning Enhanced by Feature Reconstruction for Semantic Communication Module Updates of Agents
Huh, Yoon
Kim, Bumjun
Choi, Wan
Signal Processing
Recent advancements in semantic communication have primarily focused on image transmission, where neural network-based joint source-channel coding modules play a central role. However, such systems often experience semantic communication errors due to mismatched knowledge bases between agents and performance degradation from outdated models, necessitating regular model updates. To address these challenges in vector quantization (VQ)-based image semantic communication systems, we propose FedSFR, a novel federated learning framework that incorporates semantic feature reconstruction (FR). FedSFR introduces an FR step at the parameter server and allows a subset of clients to transmit compact feature vectors in lieu of sending full local model updates, thereby improving training stability and communication efficiency. To enable effective FR learning, we design a loss function tailored for VQ-based image semantic communication and demonstrate its validity as a surrogate for image reconstruction error. We further establish a rigorous convergence analysis of FedSFR. Experimental results on two benchmark datasets validate the superiority of FedSFR over existing baselines, especially in capacity-constrained settings, confirming both its effectiveness and robustness.
title Federated Learning Enhanced by Feature Reconstruction for Semantic Communication Module Updates of Agents
topic Signal Processing
url https://arxiv.org/abs/2508.03248