Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.04267 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917791564562432 |
|---|---|
| author | Wang, Daoce Grosset, Pascal Pulido, Jesus Athawale, Tushar M. Tian, Jiannan Zhao, Kai Lukić, Zarija Huebl, Axel Wang, Zhe Ahrens, James Tao, Dingwen |
| author_facet | Wang, Daoce Grosset, Pascal Pulido, Jesus Athawale, Tushar M. Tian, Jiannan Zhao, Kai Lukić, Zarija Huebl, Axel Wang, Zhe Ahrens, James Tao, Dingwen |
| contents | Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all applications. Furthermore, integrating lossy compression with multi-resolution techniques to further boost storage efficiency encounters significant barriers. To this end, we introduce an innovative workflow that facilitates high-quality multi-resolution data compression for both uniform and AMR simulations. Initially, to extend the usability of multi-resolution techniques, our workflow employs a compression-oriented Region of Interest (ROI) extraction method, transforming uniform data into a multi-resolution format. Subsequently, to bridge the gap between multi-resolution techniques and lossy compressors, we optimize three distinct compressors, ensuring their optimal performance on multi-resolution data. Lastly, we incorporate an advanced uncertainty visualization method into our workflow to understand the potential impacts of lossy compression. Experimental evaluation demonstrates that our workflow achieves significant compression quality improvements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_04267 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization Wang, Daoce Grosset, Pascal Pulido, Jesus Athawale, Tushar M. Tian, Jiannan Zhao, Kai Lukić, Zarija Huebl, Axel Wang, Zhe Ahrens, James Tao, Dingwen Distributed, Parallel, and Cluster Computing Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all applications. Furthermore, integrating lossy compression with multi-resolution techniques to further boost storage efficiency encounters significant barriers. To this end, we introduce an innovative workflow that facilitates high-quality multi-resolution data compression for both uniform and AMR simulations. Initially, to extend the usability of multi-resolution techniques, our workflow employs a compression-oriented Region of Interest (ROI) extraction method, transforming uniform data into a multi-resolution format. Subsequently, to bridge the gap between multi-resolution techniques and lossy compressors, we optimize three distinct compressors, ensuring their optimal performance on multi-resolution data. Lastly, we incorporate an advanced uncertainty visualization method into our workflow to understand the potential impacts of lossy compression. Experimental evaluation demonstrates that our workflow achieves significant compression quality improvements. |
| title | A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2407.04267 |