High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912035570188288 |
|---|---|
| author | Yilmaz, Selim F. Niu, Xueyan Bai, Bo Han, Wei Deng, Lei Gunduz, Deniz |
| author_facet | Yilmaz, Selim F. Niu, Xueyan Bai, Bo Han, Wei Deng, Lei Gunduz, Deniz |
| contents | We consider the image transmission problem over a noisy wireless channel via deep learning-based joint source-channel coding (DeepJSCC) along with a denoising diffusion probabilistic model (DDPM) at the receiver. Specifically, we are interested in the perception-distortion trade-off in the practical finite block length regime, in which separate source and channel coding can be highly suboptimal. We introduce a novel scheme, where the conventional DeepJSCC encoder targets transmitting a lower resolution version of the image, which later can be refined thanks to the generative model available at the receiver. In particular, we utilize the range-null space decomposition of the target image; DeepJSCC transmits the range-space of the image, while DDPM progressively refines its null space contents. Through extensive experiments, we demonstrate significant improvements in distortion and perceptual quality of reconstructed images compared to standard DeepJSCC and the state-of-the-art generative learning-based method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_15889 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Models Yilmaz, Selim F. Niu, Xueyan Bai, Bo Han, Wei Deng, Lei Gunduz, Deniz Image and Video Processing Computer Vision and Pattern Recognition Information Theory Machine Learning Multimedia We consider the image transmission problem over a noisy wireless channel via deep learning-based joint source-channel coding (DeepJSCC) along with a denoising diffusion probabilistic model (DDPM) at the receiver. Specifically, we are interested in the perception-distortion trade-off in the practical finite block length regime, in which separate source and channel coding can be highly suboptimal. We introduce a novel scheme, where the conventional DeepJSCC encoder targets transmitting a lower resolution version of the image, which later can be refined thanks to the generative model available at the receiver. In particular, we utilize the range-null space decomposition of the target image; DeepJSCC transmits the range-space of the image, while DDPM progressively refines its null space contents. Through extensive experiments, we demonstrate significant improvements in distortion and perceptual quality of reconstructed images compared to standard DeepJSCC and the state-of-the-art generative learning-based method. |
| title | High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Models |
| topic | Image and Video Processing Computer Vision and Pattern Recognition Information Theory Machine Learning Multimedia |
| url | https://arxiv.org/abs/2309.15889 |