Cascaded Prediction and Asynchronous Execution of Iterative Algorithms on Heterogeneous Platforms
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912120477581312 |
|---|---|
| author | Gao, Jianhua Liu, Bingjie Wang, Yizhuo Ji, Weixing Huang, Hua |
| author_facet | Gao, Jianhua Liu, Bingjie Wang, Yizhuo Ji, Weixing Huang, Hua |
| contents | Owing to the diverse scales and varying distributions of sparse matrices arising from practical problems, a multitude of choices are present in the design and implementation of sparse matrix-vector multiplication (SpMV). Researchers have proposed many machine learning-based optimization methods for SpMV. However, these efforts only support one area of sparse matrix format selection, SpMV algorithm selection, or parameter configuration, and rarely consider a large amount of time overhead associated with feature extraction, model inference, and compression format conversion. This paper introduces a machine learning-based cascaded prediction method for SpMV computations that spans various computing stages and hierarchies. Besides, an asynchronous and concurrent computing model has been designed and implemented for runtime model prediction and iterative algorithm solving on heterogeneous computing platforms. It not only offers comprehensive support for the iterative algorithm-solving process leveraging machine learning technology, but also effectively mitigates the preprocessing overheads. Experimental results demonstrate that the cascaded prediction introduced in this paper accelerates SpMV by 1.33x on average, and the iterative algorithm, enhanced by cascaded prediction and asynchronous execution, optimizes by 2.55x on average. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_10143 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Cascaded Prediction and Asynchronous Execution of Iterative Algorithms on Heterogeneous Platforms Gao, Jianhua Liu, Bingjie Wang, Yizhuo Ji, Weixing Huang, Hua Distributed, Parallel, and Cluster Computing Mathematical Software 68-02, 68W10, 65F50 A.1; D.1.3; G.1.3 Owing to the diverse scales and varying distributions of sparse matrices arising from practical problems, a multitude of choices are present in the design and implementation of sparse matrix-vector multiplication (SpMV). Researchers have proposed many machine learning-based optimization methods for SpMV. However, these efforts only support one area of sparse matrix format selection, SpMV algorithm selection, or parameter configuration, and rarely consider a large amount of time overhead associated with feature extraction, model inference, and compression format conversion. This paper introduces a machine learning-based cascaded prediction method for SpMV computations that spans various computing stages and hierarchies. Besides, an asynchronous and concurrent computing model has been designed and implemented for runtime model prediction and iterative algorithm solving on heterogeneous computing platforms. It not only offers comprehensive support for the iterative algorithm-solving process leveraging machine learning technology, but also effectively mitigates the preprocessing overheads. Experimental results demonstrate that the cascaded prediction introduced in this paper accelerates SpMV by 1.33x on average, and the iterative algorithm, enhanced by cascaded prediction and asynchronous execution, optimizes by 2.55x on average. |
| title | Cascaded Prediction and Asynchronous Execution of Iterative Algorithms on Heterogeneous Platforms |
| topic | Distributed, Parallel, and Cluster Computing Mathematical Software 68-02, 68W10, 65F50 A.1; D.1.3; G.1.3 |
| url | https://arxiv.org/abs/2411.10143 |