NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910129615536128 |
|---|---|
| author | Zhao, Zhanhao Gao, Haotian Xing, Naili Zeng, Lingze Zhang, Meihui Chen, Gang Rigger, Manuel Ooi, Beng Chin |
| author_facet | Zhao, Zhanhao Gao, Haotian Xing, Naili Zeng, Lingze Zhang, Meihui Chen, Gang Rigger, Manuel Ooi, Beng Chin |
| contents | Learned database components, which deeply integrate machine learning into their design, have been extensively studied in recent years. Given the dynamism of databases, where data and workloads continuously drift, it is crucial for learned database components to remain effective and efficient in the face of data and workload drift. Robustness, therefore, is a key factor in assessing their practical applicability. Although recent works examine learned database components under specific drift, they fail to enable systematic performance evaluations across a broad range of drift or under customized drift as needed. This paper presents NeurBench, a new benchmark suite that supports evaluating learned database components under measurable and controllable data and workload drift. We quantify diverse types of drift by introducing a key concept called the drift factor. Building on this formulation, we propose a drift-aware data and workload generation framework that effectively simulates real-world drift while preserving inherent correlations. Experimental results demonstrate the effectiveness of NeurBench in generating realistic data and workload drift, while providing insights into the performance of representative learned database components under different drift scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_13822 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling Zhao, Zhanhao Gao, Haotian Xing, Naili Zeng, Lingze Zhang, Meihui Chen, Gang Rigger, Manuel Ooi, Beng Chin Databases Learned database components, which deeply integrate machine learning into their design, have been extensively studied in recent years. Given the dynamism of databases, where data and workloads continuously drift, it is crucial for learned database components to remain effective and efficient in the face of data and workload drift. Robustness, therefore, is a key factor in assessing their practical applicability. Although recent works examine learned database components under specific drift, they fail to enable systematic performance evaluations across a broad range of drift or under customized drift as needed. This paper presents NeurBench, a new benchmark suite that supports evaluating learned database components under measurable and controllable data and workload drift. We quantify diverse types of drift by introducing a key concept called the drift factor. Building on this formulation, we propose a drift-aware data and workload generation framework that effectively simulates real-world drift while preserving inherent correlations. Experimental results demonstrate the effectiveness of NeurBench in generating realistic data and workload drift, while providing insights into the performance of representative learned database components under different drift scenarios. |
| title | NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling |
| topic | Databases |
| url | https://arxiv.org/abs/2503.13822 |