Serverless Query Processing with Flexible Performance SLAs and Prices

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bian, Haoqiong, Geng, Dongyang, Chai, Yunpeng, Ailamaki, Anastasia
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912164854366208
author Bian, Haoqiong
Geng, Dongyang
Chai, Yunpeng
Ailamaki, Anastasia
author_facet Bian, Haoqiong
Geng, Dongyang
Chai, Yunpeng
Ailamaki, Anastasia
contents Serverless query processing has become increasingly popular due to its auto-scaling, high elasticity, and pay-as-you-go pricing. It allows cloud data warehouse (or lakehouse) users to focus on data analysis without the burden of managing systems and resources. Accordingly, in serverless query services, users become more concerned about cost-efficiency under acceptable performance than performance under fixed resources. This poses new challenges for serverless query engine design in providing flexible performance service-level agreements (SLAs) and cost-efficiency (i.e., prices). In this paper, we first define the problem of flexible performance SLAs and prices in serverless query processing and discuss its significance. Then, we envision the challenges and solutions for solving this problem and the opportunities it raises for other database research. Finally, we present PixelsDB, an open-source prototype with three service levels supported by dedicated architectural designs. Evaluations show that PixelsDB reduces resource costs by 65.5\% for near-real-world workloads generated by Cloud Analytics Benchmark (CAB) while not violating the pending time guarantees.
format Preprint
id arxiv_https___arxiv_org_abs_2409_01388
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Serverless Query Processing with Flexible Performance SLAs and Prices
Bian, Haoqiong
Geng, Dongyang
Chai, Yunpeng
Ailamaki, Anastasia
Databases
Serverless query processing has become increasingly popular due to its auto-scaling, high elasticity, and pay-as-you-go pricing. It allows cloud data warehouse (or lakehouse) users to focus on data analysis without the burden of managing systems and resources. Accordingly, in serverless query services, users become more concerned about cost-efficiency under acceptable performance than performance under fixed resources. This poses new challenges for serverless query engine design in providing flexible performance service-level agreements (SLAs) and cost-efficiency (i.e., prices). In this paper, we first define the problem of flexible performance SLAs and prices in serverless query processing and discuss its significance. Then, we envision the challenges and solutions for solving this problem and the opportunities it raises for other database research. Finally, we present PixelsDB, an open-source prototype with three service levels supported by dedicated architectural designs. Evaluations show that PixelsDB reduces resource costs by 65.5\% for near-real-world workloads generated by Cloud Analytics Benchmark (CAB) while not violating the pending time guarantees.
title Serverless Query Processing with Flexible Performance SLAs and Prices
topic Databases
url https://arxiv.org/abs/2409.01388