Saved in:
Bibliographic Details
Main Authors: Lin, Junhong, Guo, Xiaojie, Zhang, Shuaicheng, Zhu, Yada, Shun, Julian
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.10916
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912409821642752
author Lin, Junhong
Guo, Xiaojie
Zhang, Shuaicheng
Zhu, Yada
Shun, Julian
author_facet Lin, Junhong
Guo, Xiaojie
Zhang, Shuaicheng
Zhu, Yada
Shun, Julian
contents Graph mining has become crucial in fields such as social science, finance, and cybersecurity. Many large-scale real-world networks exhibit both heterogeneity, where multiple node and edge types exist in the graph, and heterophily, where connected nodes may have dissimilar labels and attributes. However, existing benchmarks primarily focus on either heterophilic homogeneous graphs or homophilic heterogeneous graphs, leaving a significant gap in understanding how models perform on graphs with both heterogeneity and heterophily. To bridge this gap, we introduce H2GB, a large-scale node-classification graph benchmark that brings together the complexities of both the heterophily and heterogeneity properties of real-world graphs. H2GB encompasses 9 real-world datasets spanning 5 diverse domains, 28 baseline models, and a unified benchmarking library with a standardized data loader, evaluator, unified modeling framework, and an extensible framework for reproducibility. We establish a standardized workflow supporting both model selection and development, enabling researchers to easily benchmark graph learning methods. Extensive experiments across 28 baselines reveal that current methods struggle with heterophilic and heterogeneous graphs, underscoring the need for improved approaches. Finally, we present a new variant of the model, H2G-former, developed following our standardized workflow, that excels at this challenging benchmark. Both the benchmark and the framework are publicly available at Github and PyPI, with documentation hosted at https://junhongmit.github.io/H2GB.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10916
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle When Heterophily Meets Heterogeneity: Challenges and a New Large-Scale Graph Benchmark
Lin, Junhong
Guo, Xiaojie
Zhang, Shuaicheng
Zhu, Yada
Shun, Julian
Machine Learning
Social and Information Networks
Graph mining has become crucial in fields such as social science, finance, and cybersecurity. Many large-scale real-world networks exhibit both heterogeneity, where multiple node and edge types exist in the graph, and heterophily, where connected nodes may have dissimilar labels and attributes. However, existing benchmarks primarily focus on either heterophilic homogeneous graphs or homophilic heterogeneous graphs, leaving a significant gap in understanding how models perform on graphs with both heterogeneity and heterophily. To bridge this gap, we introduce H2GB, a large-scale node-classification graph benchmark that brings together the complexities of both the heterophily and heterogeneity properties of real-world graphs. H2GB encompasses 9 real-world datasets spanning 5 diverse domains, 28 baseline models, and a unified benchmarking library with a standardized data loader, evaluator, unified modeling framework, and an extensible framework for reproducibility. We establish a standardized workflow supporting both model selection and development, enabling researchers to easily benchmark graph learning methods. Extensive experiments across 28 baselines reveal that current methods struggle with heterophilic and heterogeneous graphs, underscoring the need for improved approaches. Finally, we present a new variant of the model, H2G-former, developed following our standardized workflow, that excels at this challenging benchmark. Both the benchmark and the framework are publicly available at Github and PyPI, with documentation hosted at https://junhongmit.github.io/H2GB.
title When Heterophily Meets Heterogeneity: Challenges and a New Large-Scale Graph Benchmark
topic Machine Learning
Social and Information Networks
url https://arxiv.org/abs/2407.10916