Efficient and Robust Semantic Image Communication via Stable Cascade

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khalid, Bilal, Freire, Pedro, Turitsyn, Sergei K., Prilepsky, Jaroslaw E.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915406243954688
author Khalid, Bilal
Freire, Pedro
Turitsyn, Sergei K.
Prilepsky, Jaroslaw E.
author_facet Khalid, Bilal
Freire, Pedro
Turitsyn, Sergei K.
Prilepsky, Jaroslaw E.
contents Diffusion Model (DM) based Semantic Image Communication (SIC) systems face significant challenges, such as slow inference speed and generation randomness, that limit their reliability and practicality. To overcome these issues, we propose a novel SIC framework inspired by Stable Cascade, where extremely compact latent image embeddings are used as conditioning to the diffusion process. Our approach drastically reduces the data transmission overhead, compressing the transmitted embedding to just 0.29% of the original image size. It outperforms three benchmark approaches - the diffusion SIC model conditioned on segmentation maps (GESCO), the recent Stable Diffusion (SD)-based SIC framework (Img2Img-SC), and the conventional JPEG2000 + LDPC coding - by achieving superior reconstruction quality under noisy channel conditions, as validated across multiple metrics. Notably, it also delivers significant computational efficiency, enabling over 3x faster reconstruction for 512 x 512 images and more than 16x faster for 1024 x 1024 images as compared to the approach adopted in Img2Img-SC.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17416
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Efficient and Robust Semantic Image Communication via Stable Cascade
Khalid, Bilal
Freire, Pedro
Turitsyn, Sergei K.
Prilepsky, Jaroslaw E.
Image and Video Processing
Diffusion Model (DM) based Semantic Image Communication (SIC) systems face significant challenges, such as slow inference speed and generation randomness, that limit their reliability and practicality. To overcome these issues, we propose a novel SIC framework inspired by Stable Cascade, where extremely compact latent image embeddings are used as conditioning to the diffusion process. Our approach drastically reduces the data transmission overhead, compressing the transmitted embedding to just 0.29% of the original image size. It outperforms three benchmark approaches - the diffusion SIC model conditioned on segmentation maps (GESCO), the recent Stable Diffusion (SD)-based SIC framework (Img2Img-SC), and the conventional JPEG2000 + LDPC coding - by achieving superior reconstruction quality under noisy channel conditions, as validated across multiple metrics. Notably, it also delivers significant computational efficiency, enabling over 3x faster reconstruction for 512 x 512 images and more than 16x faster for 1024 x 1024 images as compared to the approach adopted in Img2Img-SC.
title Efficient and Robust Semantic Image Communication via Stable Cascade
topic Image and Video Processing
url https://arxiv.org/abs/2507.17416