Discrepancy-Aware Graph Mask Auto-Encoder

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zheng, Ziyu, Yang, Yaming, Guan, Ziyu, Zhao, Wei, Lu, Weigang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912536796856320
author Zheng, Ziyu
Yang, Yaming
Guan, Ziyu
Zhao, Wei
Lu, Weigang
author_facet Zheng, Ziyu
Yang, Yaming
Guan, Ziyu
Zhao, Wei
Lu, Weigang
contents Masked Graph Auto-Encoder, a powerful graph self-supervised training paradigm, has recently shown superior performance in graph representation learning. Existing works typically rely on node contextual information to recover the masked information. However, they fail to generalize well to heterophilic graphs where connected nodes may be not similar, because they focus only on capturing the neighborhood information and ignoring the discrepancy information between different nodes, resulting in indistinguishable node representations. In this paper, to address this issue, we propose a Discrepancy-Aware Graph Mask Auto-Encoder (DGMAE). It obtains more distinguishable node representations by reconstructing the discrepancy information of neighboring nodes during the masking process. We conduct extensive experiments on 17 widely-used benchmark datasets. The results show that our DGMAE can effectively preserve the discrepancies of nodes in low-dimensional space. Moreover, DGMAE significantly outperforms state-of-the-art graph self-supervised learning methods on three graph analytic including tasks node classification, node clustering, and graph classification, demonstrating its remarkable superiority. The code of DGMAE is available at https://github.com/zhengziyu77/DGMAE.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19343
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Discrepancy-Aware Graph Mask Auto-Encoder
Zheng, Ziyu
Yang, Yaming
Guan, Ziyu
Zhao, Wei
Lu, Weigang
Machine Learning
Artificial Intelligence
Masked Graph Auto-Encoder, a powerful graph self-supervised training paradigm, has recently shown superior performance in graph representation learning. Existing works typically rely on node contextual information to recover the masked information. However, they fail to generalize well to heterophilic graphs where connected nodes may be not similar, because they focus only on capturing the neighborhood information and ignoring the discrepancy information between different nodes, resulting in indistinguishable node representations. In this paper, to address this issue, we propose a Discrepancy-Aware Graph Mask Auto-Encoder (DGMAE). It obtains more distinguishable node representations by reconstructing the discrepancy information of neighboring nodes during the masking process. We conduct extensive experiments on 17 widely-used benchmark datasets. The results show that our DGMAE can effectively preserve the discrepancies of nodes in low-dimensional space. Moreover, DGMAE significantly outperforms state-of-the-art graph self-supervised learning methods on three graph analytic including tasks node classification, node clustering, and graph classification, demonstrating its remarkable superiority. The code of DGMAE is available at https://github.com/zhengziyu77/DGMAE.
title Discrepancy-Aware Graph Mask Auto-Encoder
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2506.19343