A Wireless AI-Generated Content (AIGC) Provisioning Framework Empowered by Semantic Communication
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910688538001408 |
|---|---|
| author | Cheng, Runze Sun, Yao Niyato, Dusit Zhang, Lan Zhang, Lei Imran, Muhammad Ali |
| author_facet | Cheng, Runze Sun, Yao Niyato, Dusit Zhang, Lan Zhang, Lei Imran, Muhammad Ali |
| contents | With the significant advances in AI-generated content (AIGC) and the proliferation of mobile devices, providing high-quality AIGC services via wireless networks is becoming the future direction. However, the primary challenges of AIGC services provisioning in wireless networks lie in unstable channels, limited bandwidth resources, and unevenly distributed computational resources. To this end, this paper proposes a semantic communication (SemCom)-empowered AIGC (SemAIGC) generation and transmission framework, where only semantic information of the content rather than all the binary bits should be generated and transmitted by using SemCom. Specifically, SemAIGC integrates diffusion models within the semantic encoder and decoder to design a workload-adjustable transceiver thereby allowing adjustment of computational resource utilization in edge and local. In addition, a Resource-aware wOrklOad Trade-off (ROOT) scheme is devised to intelligently make workload adaptation decisions for the transceiver, thus efficiently generating, transmitting, and fine-tuning content as per dynamic wireless channel conditions and service requirements. Simulations verify the superiority of our proposed SemAIGC framework in terms of latency and content quality compared to conventional approaches. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_17705 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | A Wireless AI-Generated Content (AIGC) Provisioning Framework Empowered by Semantic Communication Cheng, Runze Sun, Yao Niyato, Dusit Zhang, Lan Zhang, Lei Imran, Muhammad Ali Networking and Internet Architecture Artificial Intelligence Machine Learning Image and Video Processing With the significant advances in AI-generated content (AIGC) and the proliferation of mobile devices, providing high-quality AIGC services via wireless networks is becoming the future direction. However, the primary challenges of AIGC services provisioning in wireless networks lie in unstable channels, limited bandwidth resources, and unevenly distributed computational resources. To this end, this paper proposes a semantic communication (SemCom)-empowered AIGC (SemAIGC) generation and transmission framework, where only semantic information of the content rather than all the binary bits should be generated and transmitted by using SemCom. Specifically, SemAIGC integrates diffusion models within the semantic encoder and decoder to design a workload-adjustable transceiver thereby allowing adjustment of computational resource utilization in edge and local. In addition, a Resource-aware wOrklOad Trade-off (ROOT) scheme is devised to intelligently make workload adaptation decisions for the transceiver, thus efficiently generating, transmitting, and fine-tuning content as per dynamic wireless channel conditions and service requirements. Simulations verify the superiority of our proposed SemAIGC framework in terms of latency and content quality compared to conventional approaches. |
| title | A Wireless AI-Generated Content (AIGC) Provisioning Framework Empowered by Semantic Communication |
| topic | Networking and Internet Architecture Artificial Intelligence Machine Learning Image and Video Processing |
| url | https://arxiv.org/abs/2310.17705 |