Deep Generative Modeling Reshapes Compression and Transmission: From Efficiency to Resiliency
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916281929695232 |
|---|---|
| author | Dai, Jincheng Qin, Xiaoqi Wang, Sixian Xu, Lexi Niu, Kai Zhang, Ping |
| author_facet | Dai, Jincheng Qin, Xiaoqi Wang, Sixian Xu, Lexi Niu, Kai Zhang, Ping |
| contents | Information theory and machine learning are inextricably linked and have even been referred to as "two sides of the same coin". One particularly elegant connection is the essential equivalence between probabilistic generative modeling and data compression or transmission. In this article, we reveal the dual-functionality of deep generative models that reshapes both data compression for efficiency and transmission error concealment for resiliency. We present how the contextual predictive capabilities of powerful generative models can be well positioned to be strong compressors and estimators. In this sense, we advocate for viewing the deep generative modeling problem through the lens of end-to-end communications, and evaluate the compression and error restoration capabilities of foundation generative models. We show that the kernel of many large generative models is powerful predictor that can capture complex relationships among semantic latent variables, and the communication viewpoints provide novel insights into semantic feature tokenization, contextual learning, and usage of deep generative models. In summary, our article highlights the essential connections of generative AI to source and channel coding techniques, and motivates researchers to make further explorations in this emerging topic. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_06446 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Deep Generative Modeling Reshapes Compression and Transmission: From Efficiency to Resiliency Dai, Jincheng Qin, Xiaoqi Wang, Sixian Xu, Lexi Niu, Kai Zhang, Ping Information Theory Machine Learning Multimedia Information theory and machine learning are inextricably linked and have even been referred to as "two sides of the same coin". One particularly elegant connection is the essential equivalence between probabilistic generative modeling and data compression or transmission. In this article, we reveal the dual-functionality of deep generative models that reshapes both data compression for efficiency and transmission error concealment for resiliency. We present how the contextual predictive capabilities of powerful generative models can be well positioned to be strong compressors and estimators. In this sense, we advocate for viewing the deep generative modeling problem through the lens of end-to-end communications, and evaluate the compression and error restoration capabilities of foundation generative models. We show that the kernel of many large generative models is powerful predictor that can capture complex relationships among semantic latent variables, and the communication viewpoints provide novel insights into semantic feature tokenization, contextual learning, and usage of deep generative models. In summary, our article highlights the essential connections of generative AI to source and channel coding techniques, and motivates researchers to make further explorations in this emerging topic. |
| title | Deep Generative Modeling Reshapes Compression and Transmission: From Efficiency to Resiliency |
| topic | Information Theory Machine Learning Multimedia |
| url | https://arxiv.org/abs/2406.06446 |