A generalized hypothesis test for community structure in networks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yanchenko, Eric, Sengupta, Srijan
Format: Preprint
Publié: 2021
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917664522240000
author Yanchenko, Eric
Sengupta, Srijan
author_facet Yanchenko, Eric
Sengupta, Srijan
contents Researchers theorize that many real-world networks exhibit community structure where within-community edges are more likely than between-community edges. While numerous methods exist to cluster nodes into different communities, less work has addressed this question: given some network, does it exhibit statistically meaningful community structure? We answer this question in a principled manner by framing it as a statistical hypothesis test in terms of a general and model-agnostic community structure parameter. Leveraging this parameter, we propose a simple and interpretable test statistic used to formulate two separate hypothesis testing frameworks. The first is an asymptotic test against a baseline value of the parameter while the second tests against a baseline model using bootstrap-based thresholds. We prove theoretical properties of these tests and demonstrate how the proposed method yields rich insights into real-world data sets.
format Preprint
id arxiv_https___arxiv_org_abs_2107_06093
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle A generalized hypothesis test for community structure in networks
Yanchenko, Eric
Sengupta, Srijan
Social and Information Networks
Methodology
Researchers theorize that many real-world networks exhibit community structure where within-community edges are more likely than between-community edges. While numerous methods exist to cluster nodes into different communities, less work has addressed this question: given some network, does it exhibit statistically meaningful community structure? We answer this question in a principled manner by framing it as a statistical hypothesis test in terms of a general and model-agnostic community structure parameter. Leveraging this parameter, we propose a simple and interpretable test statistic used to formulate two separate hypothesis testing frameworks. The first is an asymptotic test against a baseline value of the parameter while the second tests against a baseline model using bootstrap-based thresholds. We prove theoretical properties of these tests and demonstrate how the proposed method yields rich insights into real-world data sets.
title A generalized hypothesis test for community structure in networks
topic Social and Information Networks
Methodology
url https://arxiv.org/abs/2107.06093