Towards Graph Contrastive Learning: A Survey and Beyond

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ju, Wei, Wang, Yifan, Qin, Yifang, Mao, Zhengyang, Xiao, Zhiping, Luo, Junyu, Yang, Junwei, Gu, Yiyang, Wang, Dongjie, Long, Qingqing, Yi, Siyu, Luo, Xiao, Zhang, Ming
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909207157014528
author Ju, Wei
Wang, Yifan
Qin, Yifang
Mao, Zhengyang
Xiao, Zhiping
Luo, Junyu
Yang, Junwei
Gu, Yiyang
Wang, Dongjie
Long, Qingqing
Yi, Siyu
Luo, Xiao
Zhang, Ming
author_facet Ju, Wei
Wang, Yifan
Qin, Yifang
Mao, Zhengyang
Xiao, Zhiping
Luo, Junyu
Yang, Junwei
Gu, Yiyang
Wang, Dongjie
Long, Qingqing
Yi, Siyu
Luo, Xiao
Zhang, Ming
contents In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address this challenge, self-supervised learning (SSL) on graphs has gained increasing attention and has made significant progress. SSL enables machine learning models to produce informative representations from unlabeled graph data, reducing the reliance on expensive labeled data. While SSL on graphs has witnessed widespread adoption, one critical component, Graph Contrastive Learning (GCL), has not been thoroughly investigated in the existing literature. Thus, this survey aims to fill this gap by offering a dedicated survey on GCL. We provide a comprehensive overview of the fundamental principles of GCL, including data augmentation strategies, contrastive modes, and contrastive optimization objectives. Furthermore, we explore the extensions of GCL to other aspects of data-efficient graph learning, such as weakly supervised learning, transfer learning, and related scenarios. We also discuss practical applications spanning domains such as drug discovery, genomics analysis, recommender systems, and finally outline the challenges and potential future directions in this field.
format Preprint
id arxiv_https___arxiv_org_abs_2405_11868
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Graph Contrastive Learning: A Survey and Beyond
Ju, Wei
Wang, Yifan
Qin, Yifang
Mao, Zhengyang
Xiao, Zhiping
Luo, Junyu
Yang, Junwei
Gu, Yiyang
Wang, Dongjie
Long, Qingqing
Yi, Siyu
Luo, Xiao
Zhang, Ming
Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
Information Retrieval
Social and Information Networks
In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address this challenge, self-supervised learning (SSL) on graphs has gained increasing attention and has made significant progress. SSL enables machine learning models to produce informative representations from unlabeled graph data, reducing the reliance on expensive labeled data. While SSL on graphs has witnessed widespread adoption, one critical component, Graph Contrastive Learning (GCL), has not been thoroughly investigated in the existing literature. Thus, this survey aims to fill this gap by offering a dedicated survey on GCL. We provide a comprehensive overview of the fundamental principles of GCL, including data augmentation strategies, contrastive modes, and contrastive optimization objectives. Furthermore, we explore the extensions of GCL to other aspects of data-efficient graph learning, such as weakly supervised learning, transfer learning, and related scenarios. We also discuss practical applications spanning domains such as drug discovery, genomics analysis, recommender systems, and finally outline the challenges and potential future directions in this field.
title Towards Graph Contrastive Learning: A Survey and Beyond
topic Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
Information Retrieval
Social and Information Networks
url https://arxiv.org/abs/2405.11868