Graph Ranking Contrastive Learning: A Extremely Simple yet Efficient Method
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916168992817152 |
|---|---|
| author | Hu, Yulan Ouyang, Sheng Liu, Jingyu Chen, Ge Yang, Zhirui Wan, Junchen Zhang, Fuzheng Wang, Zhongyuan Liu, Yong |
| author_facet | Hu, Yulan Ouyang, Sheng Liu, Jingyu Chen, Ge Yang, Zhirui Wan, Junchen Zhang, Fuzheng Wang, Zhongyuan Liu, Yong |
| contents | Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques to obtain two views, where a node in one view acts as the anchor, the corresponding node in the other view serves as the positive sample, and all other nodes are regarded as negative samples. The goal is to minimize the distance between the anchor node and positive samples and maximize the distance to negative samples. However, due to the lack of label information during training, InfoNCE inevitably treats samples from the same class as negative samples, leading to the issue of false negative samples. This can impair the learned node representations and subsequently hinder performance in downstream tasks. While numerous methods have been proposed to mitigate the impact of false negatives, they still face various challenges. For instance, while increasing the number of negative samples can dilute the impact of false negatives, it concurrently increases computational burden. Thus, we propose GraphRank, a simple yet efficient graph contrastive learning method that addresses the problem of false negative samples by redefining the concept of negative samples to a certain extent, thereby avoiding the issue of false negative samples. The effectiveness of GraphRank is empirically validated through experiments on the node, edge, and graph level tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_14525 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Graph Ranking Contrastive Learning: A Extremely Simple yet Efficient Method Hu, Yulan Ouyang, Sheng Liu, Jingyu Chen, Ge Yang, Zhirui Wan, Junchen Zhang, Fuzheng Wang, Zhongyuan Liu, Yong Machine Learning Artificial Intelligence Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques to obtain two views, where a node in one view acts as the anchor, the corresponding node in the other view serves as the positive sample, and all other nodes are regarded as negative samples. The goal is to minimize the distance between the anchor node and positive samples and maximize the distance to negative samples. However, due to the lack of label information during training, InfoNCE inevitably treats samples from the same class as negative samples, leading to the issue of false negative samples. This can impair the learned node representations and subsequently hinder performance in downstream tasks. While numerous methods have been proposed to mitigate the impact of false negatives, they still face various challenges. For instance, while increasing the number of negative samples can dilute the impact of false negatives, it concurrently increases computational burden. Thus, we propose GraphRank, a simple yet efficient graph contrastive learning method that addresses the problem of false negative samples by redefining the concept of negative samples to a certain extent, thereby avoiding the issue of false negative samples. The effectiveness of GraphRank is empirically validated through experiments on the node, edge, and graph level tasks. |
| title | Graph Ranking Contrastive Learning: A Extremely Simple yet Efficient Method |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2310.14525 |