BEACON: A Benchmark for Efficient and Accurate Counting of Subgraphs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Najafi, Mohammad Matin, Zhu, Xianju, Kosyfaki, Chrysanthi, Lakshmanan, Laks V. S., Cheng, Reynold
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912329316171776
author Najafi, Mohammad Matin
Zhu, Xianju
Kosyfaki, Chrysanthi
Lakshmanan, Laks V. S.
Cheng, Reynold
author_facet Najafi, Mohammad Matin
Zhu, Xianju
Kosyfaki, Chrysanthi
Lakshmanan, Laks V. S.
Cheng, Reynold
contents Subgraph counting the task of determining the number of instances of a query pattern within a large graph lies at the heart of many critical applications, from analyzing financial networks and transportation systems to understanding biological interactions. Despite decades of work yielding efficient algorithmic (AL) solutions and, more recently, machine learning (ML) approaches, a clear comparative understanding is elusive. This gap stems from the absence of a unified evaluation framework, standardized datasets, and accessible ground truths, all of which hinder systematic analysis and fair benchmarking. To overcome these barriers, we introduce BEACON: a comprehensive benchmark designed to rigorously evaluate both AL and ML-based subgraph counting methods. BEACON provides a standardized dataset with verified ground truths, an integrated evaluation environment, and a public leaderboard, enabling reproducible and transparent comparisons across diverse approaches. Our extensive experiments reveal that while AL methods excel in efficiently counting subgraphs on very large graphs, they struggle with complex patterns (e.g., those exceeding six nodes). In contrast, ML methods are capable of handling larger patterns but demand massive graph data inputs and often yield suboptimal accuracy on small, dense graphs. These insights not only highlight the unique strengths and limitations of each approach but also pave the way for future advancements in subgraph counting techniques. Overall, BEACON represents a significant step towards unifying and accelerating research in subgraph counting, encouraging innovative solutions and fostering a deeper understanding of the trade-offs between algorithmic and machine learning paradigms.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10948
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BEACON: A Benchmark for Efficient and Accurate Counting of Subgraphs
Najafi, Mohammad Matin
Zhu, Xianju
Kosyfaki, Chrysanthi
Lakshmanan, Laks V. S.
Cheng, Reynold
Data Structures and Algorithms
Artificial Intelligence
Databases
Social and Information Networks
Subgraph counting the task of determining the number of instances of a query pattern within a large graph lies at the heart of many critical applications, from analyzing financial networks and transportation systems to understanding biological interactions. Despite decades of work yielding efficient algorithmic (AL) solutions and, more recently, machine learning (ML) approaches, a clear comparative understanding is elusive. This gap stems from the absence of a unified evaluation framework, standardized datasets, and accessible ground truths, all of which hinder systematic analysis and fair benchmarking. To overcome these barriers, we introduce BEACON: a comprehensive benchmark designed to rigorously evaluate both AL and ML-based subgraph counting methods. BEACON provides a standardized dataset with verified ground truths, an integrated evaluation environment, and a public leaderboard, enabling reproducible and transparent comparisons across diverse approaches. Our extensive experiments reveal that while AL methods excel in efficiently counting subgraphs on very large graphs, they struggle with complex patterns (e.g., those exceeding six nodes). In contrast, ML methods are capable of handling larger patterns but demand massive graph data inputs and often yield suboptimal accuracy on small, dense graphs. These insights not only highlight the unique strengths and limitations of each approach but also pave the way for future advancements in subgraph counting techniques. Overall, BEACON represents a significant step towards unifying and accelerating research in subgraph counting, encouraging innovative solutions and fostering a deeper understanding of the trade-offs between algorithmic and machine learning paradigms.
title BEACON: A Benchmark for Efficient and Accurate Counting of Subgraphs
topic Data Structures and Algorithms
Artificial Intelligence
Databases
Social and Information Networks
url https://arxiv.org/abs/2504.10948