Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.17536 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914985384345600 |
|---|---|
| author | Ding, Jiarun Jiang, Peiwen Wen, Chao-Kai Jin, Shi |
| author_facet | Ding, Jiarun Jiang, Peiwen Wen, Chao-Kai Jin, Shi |
| contents | The rapid development of artificial intelligence has significantly advanced semantic communications, particularly in wireless image transmission. However, most existing approaches struggle to precisely distinguish and prioritize image content, and they do not sufficiently incorporate semantic priorities into system design. In this study, we propose an adaptive wireless image semantic transmission scheme called ASCViT-JSCC, which utilizes vision transformer-based joint source-channel coding (JSCC). This scheme prioritizes different image regions based on their importance, identified through object and feature point detection. Unimportant background sections are masked, enabling them to be recovered at the receiver, while the freed resources are allocated to enhance object protection via the JSCC network. We also integrate quantization modules to enable compatibility with quadrature amplitude modulation, commonly used in modern wireless communications. To address frequency-selective fading channels, we introduce CSIPA-Net, which allocates power based on channel information, further improving performance. Notably, we conduct over-the-air testing on a prototype platform composed of a software-defined radio and embedded graphics processing unit systems, validating our methods. Both simulations and real-world measurements demonstrate that ASCViT-JSCC effectively prioritizes object protection according to channel conditions, significantly enhancing image reconstruction quality, especially in challenging channel environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_17536 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation Ding, Jiarun Jiang, Peiwen Wen, Chao-Kai Jin, Shi Image and Video Processing The rapid development of artificial intelligence has significantly advanced semantic communications, particularly in wireless image transmission. However, most existing approaches struggle to precisely distinguish and prioritize image content, and they do not sufficiently incorporate semantic priorities into system design. In this study, we propose an adaptive wireless image semantic transmission scheme called ASCViT-JSCC, which utilizes vision transformer-based joint source-channel coding (JSCC). This scheme prioritizes different image regions based on their importance, identified through object and feature point detection. Unimportant background sections are masked, enabling them to be recovered at the receiver, while the freed resources are allocated to enhance object protection via the JSCC network. We also integrate quantization modules to enable compatibility with quadrature amplitude modulation, commonly used in modern wireless communications. To address frequency-selective fading channels, we introduce CSIPA-Net, which allocates power based on channel information, further improving performance. Notably, we conduct over-the-air testing on a prototype platform composed of a software-defined radio and embedded graphics processing unit systems, validating our methods. Both simulations and real-world measurements demonstrate that ASCViT-JSCC effectively prioritizes object protection according to channel conditions, significantly enhancing image reconstruction quality, especially in challenging channel environments. |
| title | Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation |
| topic | Image and Video Processing |
| url | https://arxiv.org/abs/2410.17536 |