Higher-order accurate two-sample network inference and network hashing

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Shao, Meijia, Xia, Dong, Zhang, Yuan, Wu, Qiong, Chen, Shuo
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910314909401088
author Shao, Meijia
Xia, Dong
Zhang, Yuan
Wu, Qiong
Chen, Shuo
author_facet Shao, Meijia
Xia, Dong
Zhang, Yuan
Wu, Qiong
Chen, Shuo
contents Two-sample hypothesis testing for network comparison presents many significant challenges, including: leveraging repeated network observations and known node registration, but without requiring them to operate; relaxing strong structural assumptions; achieving finite-sample higher-order accuracy; handling different network sizes and sparsity levels; fast computation and memory parsimony; controlling false discovery rate (FDR) in multiple testing; and theoretical understandings, particularly regarding finite-sample accuracy and minimax optimality. In this paper, we develop a comprehensive toolbox, featuring a novel main method and its variants, all accompanied by strong theoretical guarantees, to address these challenges. Our method outperforms existing tools in speed and accuracy, and it is proved power-optimal. Our algorithms are user-friendly and versatile in handling various data structures (single or repeated network observations; known or unknown node registration). We also develop an innovative framework for offline hashing and fast querying as a very useful tool for large network databases. We showcase the effectiveness of our method through comprehensive simulations and applications to two real-world datasets, which revealed intriguing new structures.
format Preprint
id arxiv_https___arxiv_org_abs_2208_07573
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Higher-order accurate two-sample network inference and network hashing
Shao, Meijia
Xia, Dong
Zhang, Yuan
Wu, Qiong
Chen, Shuo
Methodology
Statistics Theory
Machine Learning
Two-sample hypothesis testing for network comparison presents many significant challenges, including: leveraging repeated network observations and known node registration, but without requiring them to operate; relaxing strong structural assumptions; achieving finite-sample higher-order accuracy; handling different network sizes and sparsity levels; fast computation and memory parsimony; controlling false discovery rate (FDR) in multiple testing; and theoretical understandings, particularly regarding finite-sample accuracy and minimax optimality. In this paper, we develop a comprehensive toolbox, featuring a novel main method and its variants, all accompanied by strong theoretical guarantees, to address these challenges. Our method outperforms existing tools in speed and accuracy, and it is proved power-optimal. Our algorithms are user-friendly and versatile in handling various data structures (single or repeated network observations; known or unknown node registration). We also develop an innovative framework for offline hashing and fast querying as a very useful tool for large network databases. We showcase the effectiveness of our method through comprehensive simulations and applications to two real-world datasets, which revealed intriguing new structures.
title Higher-order accurate two-sample network inference and network hashing
topic Methodology
Statistics Theory
Machine Learning
url https://arxiv.org/abs/2208.07573