ExaLogLog: Space-Efficient and Practical Approximate Distinct Counting up to the Exa-Scale

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Ertl, Otmar
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915174257000448
author Ertl, Otmar
author_facet Ertl, Otmar
contents This work introduces ExaLogLog, a new data structure for approximate distinct counting, which has the same practical properties as the popular HyperLogLog algorithm. It is commutative, idempotent, mergeable, reducible, has a constant-time insert operation, and supports distinct counts up to the exa-scale. At the same time, as theoretically derived and experimentally verified, it requires 43% less space to achieve the same estimation error.
format Preprint
id arxiv_https___arxiv_org_abs_2402_13726
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ExaLogLog: Space-Efficient and Practical Approximate Distinct Counting up to the Exa-Scale
Ertl, Otmar
Data Structures and Algorithms
Databases
This work introduces ExaLogLog, a new data structure for approximate distinct counting, which has the same practical properties as the popular HyperLogLog algorithm. It is commutative, idempotent, mergeable, reducible, has a constant-time insert operation, and supports distinct counts up to the exa-scale. At the same time, as theoretically derived and experimentally verified, it requires 43% less space to achieve the same estimation error.
title ExaLogLog: Space-Efficient and Practical Approximate Distinct Counting up to the Exa-Scale
topic Data Structures and Algorithms
Databases
url https://arxiv.org/abs/2402.13726