Parallel Query Processing with Heterogeneous Machines

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Frisk, Simon, Koutris, Paraschos
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913729705148416
author Frisk, Simon
Koutris, Paraschos
author_facet Frisk, Simon
Koutris, Paraschos
contents We study the problem of computing a full Conjunctive Query in parallel using $p$ heterogeneous machines. Our computational model is similar to the MPC model, but each machine has its own cost function mapping from the number of bits it receives to a cost. An optimal algorithm should minimize the maximum cost across all machines. We consider algorithms over a single communication round and give a lower bound and matching upper bound for databases where each relation has the same cardinality. We do this for both linear cost functions like in previous work, but also for more general cost functions. For databases with relations of different cardinalities, we also find a lower bound, and give matching upper bounds for specific queries like the cartesian product, the join, the star query, and the triangle query. Our approach is inspired by the HyperCube algorithm, but there are additional challenges involved when machines have heterogeneous cost functions.
format Preprint
id arxiv_https___arxiv_org_abs_2501_08896
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Parallel Query Processing with Heterogeneous Machines
Frisk, Simon
Koutris, Paraschos
Databases
We study the problem of computing a full Conjunctive Query in parallel using $p$ heterogeneous machines. Our computational model is similar to the MPC model, but each machine has its own cost function mapping from the number of bits it receives to a cost. An optimal algorithm should minimize the maximum cost across all machines. We consider algorithms over a single communication round and give a lower bound and matching upper bound for databases where each relation has the same cardinality. We do this for both linear cost functions like in previous work, but also for more general cost functions. For databases with relations of different cardinalities, we also find a lower bound, and give matching upper bounds for specific queries like the cartesian product, the join, the star query, and the triangle query. Our approach is inspired by the HyperCube algorithm, but there are additional challenges involved when machines have heterogeneous cost functions.
title Parallel Query Processing with Heterogeneous Machines
topic Databases
url https://arxiv.org/abs/2501.08896