Saved in:
Bibliographic Details
Main Authors: Chen, Xiang, Yue, Kun, Liu, Wenjie, Zhang, Zhenyu, Duan, Liang
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.08287
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911259520139264
author Chen, Xiang
Yue, Kun
Liu, Wenjie
Zhang, Zhenyu
Duan, Liang
author_facet Chen, Xiang
Yue, Kun
Liu, Wenjie
Zhang, Zhenyu
Duan, Liang
contents Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message passing mechanism of GNN and the quadratic computational complexity of contrastive loss over positive and negative node pairs. To address these issues, we propose an efficient GCL framework that transforms the input graph into a compact network of interconnected node sets while preserving structural information across communities. We firstly introduce a kernelized graph community contrastive loss with linear complexity, enabling effective information transfer among node sets to capture hierarchical structural information of the graph. We then incorporate a knowledge distillation technique into the decoupled GNN architecture to accelerate inference while maintaining strong generalization performance. Extensive experiments on sixteen real-world datasets of varying scales demonstrate that our method outperforms state-of-the-art GCL baselines in both effectiveness and scalability.
format Preprint
id arxiv_https___arxiv_org_abs_2511_08287
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dual-Kernel Graph Community Contrastive Learning
Chen, Xiang
Yue, Kun
Liu, Wenjie
Zhang, Zhenyu
Duan, Liang
Machine Learning
Artificial Intelligence
Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message passing mechanism of GNN and the quadratic computational complexity of contrastive loss over positive and negative node pairs. To address these issues, we propose an efficient GCL framework that transforms the input graph into a compact network of interconnected node sets while preserving structural information across communities. We firstly introduce a kernelized graph community contrastive loss with linear complexity, enabling effective information transfer among node sets to capture hierarchical structural information of the graph. We then incorporate a knowledge distillation technique into the decoupled GNN architecture to accelerate inference while maintaining strong generalization performance. Extensive experiments on sixteen real-world datasets of varying scales demonstrate that our method outperforms state-of-the-art GCL baselines in both effectiveness and scalability.
title Dual-Kernel Graph Community Contrastive Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2511.08287