Lightweight Diffusion Models for Resource-Constrained Semantic Communication

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pignata, Giovanni, Grassucci, Eleonora, Cicchetti, Giordano, Comminiello, Danilo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916014284865536
author Pignata, Giovanni
Grassucci, Eleonora
Cicchetti, Giordano
Comminiello, Danilo
author_facet Pignata, Giovanni
Grassucci, Eleonora
Cicchetti, Giordano
Comminiello, Danilo
contents Recently, generative semantic communication models have proliferated as they are revolutionizing semantic communication frameworks, improving their performance, and opening the way to novel applications. Despite their impressive ability to regenerate content from the compressed semantic information received, generative models pose crucial challenges for communication systems in terms of high memory footprints and heavy computational load. In this paper, we present a novel Quantized GEnerative Semantic COmmunication framework, Q-GESCO. The core method of Q-GESCO is a quantized semantic diffusion model capable of regenerating transmitted images from the received semantic maps while simultaneously reducing computational load and memory footprint thanks to the proposed post-training quantization technique. Q-GESCO is robust to different channel noises and obtains comparable performance to the full precision counterpart in different scenarios saving up to 75% memory and 79% floating point operations. This allows resource-constrained devices to exploit the generative capabilities of Q-GESCO, widening the range of applications and systems for generative semantic communication frameworks. The code is available at https://github.com/ispamm/Q-GESCO.
format Preprint
id arxiv_https___arxiv_org_abs_2410_02491
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Lightweight Diffusion Models for Resource-Constrained Semantic Communication
Pignata, Giovanni
Grassucci, Eleonora
Cicchetti, Giordano
Comminiello, Danilo
Signal Processing
Recently, generative semantic communication models have proliferated as they are revolutionizing semantic communication frameworks, improving their performance, and opening the way to novel applications. Despite their impressive ability to regenerate content from the compressed semantic information received, generative models pose crucial challenges for communication systems in terms of high memory footprints and heavy computational load. In this paper, we present a novel Quantized GEnerative Semantic COmmunication framework, Q-GESCO. The core method of Q-GESCO is a quantized semantic diffusion model capable of regenerating transmitted images from the received semantic maps while simultaneously reducing computational load and memory footprint thanks to the proposed post-training quantization technique. Q-GESCO is robust to different channel noises and obtains comparable performance to the full precision counterpart in different scenarios saving up to 75% memory and 79% floating point operations. This allows resource-constrained devices to exploit the generative capabilities of Q-GESCO, widening the range of applications and systems for generative semantic communication frameworks. The code is available at https://github.com/ispamm/Q-GESCO.
title Lightweight Diffusion Models for Resource-Constrained Semantic Communication
topic Signal Processing
url https://arxiv.org/abs/2410.02491