Bespoke OLAP: Synthesizing Workload-Specific One-size-fits-one Database Engines

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wehrstein, Johannes, Eckmann, Timo, Jasny, Matthias, Binnig, Carsten
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918366744150016
author Wehrstein, Johannes
Eckmann, Timo
Jasny, Matthias
Binnig, Carsten
author_facet Wehrstein, Johannes
Eckmann, Timo
Jasny, Matthias
Binnig, Carsten
contents Modern OLAP engines are designed to support arbitrary analytical workloads, but this generality incurs structural overhead, including runtime schema interpretation, indirection layers, and abstraction boundaries, even in highly optimized systems. An engine specialized to a fixed workload can eliminate these costs and exploit workload-specific data structures and execution algorithms for substantially higher performance. Historically, constructing such bespoke engines has been economically impractical due to the high manual engineering effort. Recent advances in LLM-based code synthesis challenge this tradeoff by enabling automated system generation. However, naively prompting an LLM to produce a database engine does not yield a correct or efficient design, as effective synthesis requires systematic performance feedback, structured refinement, and careful management of deep architectural interdependencies. We present Bespoke OLAP, a fully autonomous synthesis pipeline for constructing high-performance database engines tightly tailored to a given workload. Our approach integrates iterative performance evaluation and automated validation to guide synthesis from storage to query execution. We demonstrate that Bespoke OLAP can generate a workload-specific engine from scratch within minutes to hours, achieving order-of-magnitude speedups over modern general-purpose systems such as DuckDB.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02001
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Bespoke OLAP: Synthesizing Workload-Specific One-size-fits-one Database Engines
Wehrstein, Johannes
Eckmann, Timo
Jasny, Matthias
Binnig, Carsten
Databases
Modern OLAP engines are designed to support arbitrary analytical workloads, but this generality incurs structural overhead, including runtime schema interpretation, indirection layers, and abstraction boundaries, even in highly optimized systems. An engine specialized to a fixed workload can eliminate these costs and exploit workload-specific data structures and execution algorithms for substantially higher performance. Historically, constructing such bespoke engines has been economically impractical due to the high manual engineering effort. Recent advances in LLM-based code synthesis challenge this tradeoff by enabling automated system generation. However, naively prompting an LLM to produce a database engine does not yield a correct or efficient design, as effective synthesis requires systematic performance feedback, structured refinement, and careful management of deep architectural interdependencies. We present Bespoke OLAP, a fully autonomous synthesis pipeline for constructing high-performance database engines tightly tailored to a given workload. Our approach integrates iterative performance evaluation and automated validation to guide synthesis from storage to query execution. We demonstrate that Bespoke OLAP can generate a workload-specific engine from scratch within minutes to hours, achieving order-of-magnitude speedups over modern general-purpose systems such as DuckDB.
title Bespoke OLAP: Synthesizing Workload-Specific One-size-fits-one Database Engines
topic Databases
url https://arxiv.org/abs/2603.02001