TSUE: A Two-Stage Data Update Method for an Erasure Coded Cluster File System
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912344397840384 |
|---|---|
| author | Wei, Zheng Xing, Jing Gu, Yida Huang, Wenjing Dai, Dong Tan, Guangming Tao, Dingwen |
| author_facet | Wei, Zheng Xing, Jing Gu, Yida Huang, Wenjing Dai, Dong Tan, Guangming Tao, Dingwen |
| contents | Compared to replication-based storage systems, erasure-coded storage incurs significantly higher overhead during data updates. To address this issue, various parity logging methods have been pro- posed. Nevertheless, due to the long update path and substantial amount of random I/O involved in erasure code update processes, the resulting long latency and low throughput often fail to meet the requirements of high performance applications. To this end, we propose a two-stage data update method called TSUE. TSUE divides the update process into a synchronous stage that records updates in a data log, and an asynchronous stage that recycles the log in real-time. TSUE effectively reduces update latency by transforming random I/O into sequential I/O, and it significantly reduces recycle overhead by utilizing a three-layer log and the spatio-temporal locality of access patterns. In SSDs cluster, TSUE significantly im- proves update performance, achieving improvements of 7.6X under Ali-Cloud trace, 5X under Ten-Cloud trace, while it also extends the SSD's lifespan by up to 13X through reducing the frequencies of reads/writes and of erase operations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_17598 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TSUE: A Two-Stage Data Update Method for an Erasure Coded Cluster File System Wei, Zheng Xing, Jing Gu, Yida Huang, Wenjing Dai, Dong Tan, Guangming Tao, Dingwen Distributed, Parallel, and Cluster Computing Compared to replication-based storage systems, erasure-coded storage incurs significantly higher overhead during data updates. To address this issue, various parity logging methods have been pro- posed. Nevertheless, due to the long update path and substantial amount of random I/O involved in erasure code update processes, the resulting long latency and low throughput often fail to meet the requirements of high performance applications. To this end, we propose a two-stage data update method called TSUE. TSUE divides the update process into a synchronous stage that records updates in a data log, and an asynchronous stage that recycles the log in real-time. TSUE effectively reduces update latency by transforming random I/O into sequential I/O, and it significantly reduces recycle overhead by utilizing a three-layer log and the spatio-temporal locality of access patterns. In SSDs cluster, TSUE significantly im- proves update performance, achieving improvements of 7.6X under Ali-Cloud trace, 5X under Ten-Cloud trace, while it also extends the SSD's lifespan by up to 13X through reducing the frequencies of reads/writes and of erase operations. |
| title | TSUE: A Two-Stage Data Update Method for an Erasure Coded Cluster File System |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2504.17598 |