Near Data Processing in Taurus Database
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912449090813952 |
|---|---|
| author | Lin, Shu Marathe, Arunprasad P. Larson, Per-Ȧke Chen, Chong Sun, Calvin Lee, Paul Yu, Weidong |
| author_facet | Lin, Shu Marathe, Arunprasad P. Larson, Per-Ȧke Chen, Chong Sun, Calvin Lee, Paul Yu, Weidong |
| contents | Huawei's cloud-native database system GaussDB for MySQL (also known as Taurus) stores data in a separate storage layer consisting of a pool of storage servers. Each server has considerable compute power making it possible to push data reduction operations (selection, projection, and aggregation) close to storage. This paper describes the design and implementation of near data processing (NDP) in Taurus. NDP has several benefits: it reduces the amount of data shipped over the network; frees up CPU capacity in the compute layer; and reduces query run time, thereby enabling higher system throughput. Experiments with the TPCH benchmark (100 GB) showed that 18 out of 22 queries benefited from NDP; data shipped was reduced by 63 percent; and CPU time by 50 percent. On Q15 the impact was even higher: data shipped was reduced by 98 percent; CPU time by 91 percent; and run time by 80 percent. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_20010 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Near Data Processing in Taurus Database Lin, Shu Marathe, Arunprasad P. Larson, Per-Ȧke Chen, Chong Sun, Calvin Lee, Paul Yu, Weidong Databases H.2.4 Huawei's cloud-native database system GaussDB for MySQL (also known as Taurus) stores data in a separate storage layer consisting of a pool of storage servers. Each server has considerable compute power making it possible to push data reduction operations (selection, projection, and aggregation) close to storage. This paper describes the design and implementation of near data processing (NDP) in Taurus. NDP has several benefits: it reduces the amount of data shipped over the network; frees up CPU capacity in the compute layer; and reduces query run time, thereby enabling higher system throughput. Experiments with the TPCH benchmark (100 GB) showed that 18 out of 22 queries benefited from NDP; data shipped was reduced by 63 percent; and CPU time by 50 percent. On Q15 the impact was even higher: data shipped was reduced by 98 percent; CPU time by 91 percent; and run time by 80 percent. |
| title | Near Data Processing in Taurus Database |
| topic | Databases H.2.4 |
| url | https://arxiv.org/abs/2506.20010 |