Bingo: Radix-based Bias Factorization for Random Walk on Dynamic Graphs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Pinhuan, Huan, Chengying, Wang, Zhibin, Tian, Chen, Ji, Yuede, Liu, Hang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909579118379008
author Wang, Pinhuan
Huan, Chengying
Wang, Zhibin
Tian, Chen
Ji, Yuede
Liu, Hang
author_facet Wang, Pinhuan
Huan, Chengying
Wang, Zhibin
Tian, Chen
Ji, Yuede
Liu, Hang
contents Random walks are a primary means for extracting information from large-scale graphs. While most real-world graphs are inherently dynamic, state-of-the-art random walk engines failed to efficiently support such a critical use case. This paper takes the initiative to build a general random walk engine for dynamically changing graphs with two key principles: (i) This system should support both low-latency streaming updates and high-throughput batched updates. (ii) This system should achieve fast sampling speed while maintaining acceptable space consumption to support dynamic graph updates. Upholding both standards, we introduce Bingo, a GPU-based random walk engine for dynamically changing graphs. First, we propose a novel radix-based bias factorization algorithm to support constant time sampling complexity while supporting fast streaming updates. Second, we present a group-adaption design to reduce space consumption dramatically. Third, we incorporate GPU-aware designs to support high-throughput batched graph updates on massively parallel platforms. Together, Bingo outperforms existing efforts across various applications, settings, and datasets, achieving up to a 271.11x speedup compared to the state-of-the-art efforts.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10233
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bingo: Radix-based Bias Factorization for Random Walk on Dynamic Graphs
Wang, Pinhuan
Huan, Chengying
Wang, Zhibin
Tian, Chen
Ji, Yuede
Liu, Hang
Distributed, Parallel, and Cluster Computing
Random walks are a primary means for extracting information from large-scale graphs. While most real-world graphs are inherently dynamic, state-of-the-art random walk engines failed to efficiently support such a critical use case. This paper takes the initiative to build a general random walk engine for dynamically changing graphs with two key principles: (i) This system should support both low-latency streaming updates and high-throughput batched updates. (ii) This system should achieve fast sampling speed while maintaining acceptable space consumption to support dynamic graph updates. Upholding both standards, we introduce Bingo, a GPU-based random walk engine for dynamically changing graphs. First, we propose a novel radix-based bias factorization algorithm to support constant time sampling complexity while supporting fast streaming updates. Second, we present a group-adaption design to reduce space consumption dramatically. Third, we incorporate GPU-aware designs to support high-throughput batched graph updates on massively parallel platforms. Together, Bingo outperforms existing efforts across various applications, settings, and datasets, achieving up to a 271.11x speedup compared to the state-of-the-art efforts.
title Bingo: Radix-based Bias Factorization for Random Walk on Dynamic Graphs
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2504.10233