What Operations can be Performed Directly on Compressed Arrays, and with What Error?
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916289691254784 |
|---|---|
| author | Agarwal, Tripti Dam, Harvey Khalifa, Dorra Ben Martel, Matthieu Sadayappan, P. Gopalakrishnan, Ganesh |
| author_facet | Agarwal, Tripti Dam, Harvey Khalifa, Dorra Ben Martel, Matthieu Sadayappan, P. Gopalakrishnan, Ganesh |
| contents | In response to the rapidly escalating costs of computing with large matrices and tensors caused by data movement, several lossy compression methods have been developed to significantly reduce data volumes. Unfortunately, all these methods require the data to be decompressed before further computations are done. In this work, we develop a lossy compressor that allows a dozen fairly fundamental operations directly on compressed data while offering good compression ratios and modest errors. We implement a new compressor PyBlaz based on the familiar GPU-powered PyTorch framework, and evaluate it on three non-trivial applications, choosing different number systems for internal representation. Our results demonstrate that the compressed-domain operations achieve good scalability with problem sizes while incurring errors well within acceptable limits. To our best knowledge, this is the first such lossy compressor that supports compressed-domain operations while achieving acceptable performance as well as error. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_11209 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | What Operations can be Performed Directly on Compressed Arrays, and with What Error? Agarwal, Tripti Dam, Harvey Khalifa, Dorra Ben Martel, Matthieu Sadayappan, P. Gopalakrishnan, Ganesh Distributed, Parallel, and Cluster Computing Machine Learning In response to the rapidly escalating costs of computing with large matrices and tensors caused by data movement, several lossy compression methods have been developed to significantly reduce data volumes. Unfortunately, all these methods require the data to be decompressed before further computations are done. In this work, we develop a lossy compressor that allows a dozen fairly fundamental operations directly on compressed data while offering good compression ratios and modest errors. We implement a new compressor PyBlaz based on the familiar GPU-powered PyTorch framework, and evaluate it on three non-trivial applications, choosing different number systems for internal representation. Our results demonstrate that the compressed-domain operations achieve good scalability with problem sizes while incurring errors well within acceptable limits. To our best knowledge, this is the first such lossy compressor that supports compressed-domain operations while achieving acceptable performance as well as error. |
| title | What Operations can be Performed Directly on Compressed Arrays, and with What Error? |
| topic | Distributed, Parallel, and Cluster Computing Machine Learning |
| url | https://arxiv.org/abs/2406.11209 |