Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.10036 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910487640276992 |
|---|---|
| author | Chen, Jun Fang, Yong Khisti, Ashish Ozgur, Ayfer Shlezinger, Nir Tian, Chao |
| author_facet | Chen, Jun Fang, Yong Khisti, Ashish Ozgur, Ayfer Shlezinger, Nir Tian, Chao |
| contents | This survey articles focuses on emerging connections between the fields of machine learning and data compression. While fundamental limits of classical (lossy) data compression are established using rate-distortion theory, the connections to machine learning have resulted in new theoretical analysis and application areas. We survey recent works on task-based and goal-oriented compression, the rate-distortion-perception theory and compression for estimation and inference. Deep learning based approaches also provide natural data-driven algorithmic approaches to compression. We survey recent works on applying deep learning techniques to task-based or goal-oriented compression, as well as image and video compression. We also discuss the potential use of large language models for text compression. We finally provide some directions for future research in this promising field. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_10036 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Information Compression in the AI Era: Recent Advances and Future Challenges Chen, Jun Fang, Yong Khisti, Ashish Ozgur, Ayfer Shlezinger, Nir Tian, Chao Information Theory This survey articles focuses on emerging connections between the fields of machine learning and data compression. While fundamental limits of classical (lossy) data compression are established using rate-distortion theory, the connections to machine learning have resulted in new theoretical analysis and application areas. We survey recent works on task-based and goal-oriented compression, the rate-distortion-perception theory and compression for estimation and inference. Deep learning based approaches also provide natural data-driven algorithmic approaches to compression. We survey recent works on applying deep learning techniques to task-based or goal-oriented compression, as well as image and video compression. We also discuss the potential use of large language models for text compression. We finally provide some directions for future research in this promising field. |
| title | Information Compression in the AI Era: Recent Advances and Future Challenges |
| topic | Information Theory |
| url | https://arxiv.org/abs/2406.10036 |