Graph Similarity Regularized Softmax for Semi-Supervised Node Classification

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Yiming, Liu, Jun, Wan, Wei
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912037872861184
author Yang, Yiming
Liu, Jun
Wan, Wei
author_facet Yang, Yiming
Liu, Jun
Wan, Wei
contents Graph Neural Networks (GNNs) are powerful deep learning models designed for graph-structured data, demonstrating effectiveness across a wide range of applications.The softmax function is the most commonly used classifier for semi-supervised node classification. However, the softmax function lacks spatial information of the graph structure. In this paper, we propose a graph similarity regularized softmax for GNNs in semi-supervised node classification. By incorporating non-local total variation (TV) regularization into the softmax activation function, we can more effectively capture the spatial information inherent in graphs. The weights in the non-local gradient and divergence operators are determined based on the graph's adjacency matrix. We apply the proposed method into the architecture of GCN and GraphSAGE, testing them on citation and webpage linking datasets, respectively. Numerical experiments demonstrate its good performance in node classification and generalization capabilities. These results indicate that the graph similarity regularized softmax is effective on both assortative and disassortative graphs.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13544
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Graph Similarity Regularized Softmax for Semi-Supervised Node Classification
Yang, Yiming
Liu, Jun
Wan, Wei
Machine Learning
Optimization and Control
Graph Neural Networks (GNNs) are powerful deep learning models designed for graph-structured data, demonstrating effectiveness across a wide range of applications.The softmax function is the most commonly used classifier for semi-supervised node classification. However, the softmax function lacks spatial information of the graph structure. In this paper, we propose a graph similarity regularized softmax for GNNs in semi-supervised node classification. By incorporating non-local total variation (TV) regularization into the softmax activation function, we can more effectively capture the spatial information inherent in graphs. The weights in the non-local gradient and divergence operators are determined based on the graph's adjacency matrix. We apply the proposed method into the architecture of GCN and GraphSAGE, testing them on citation and webpage linking datasets, respectively. Numerical experiments demonstrate its good performance in node classification and generalization capabilities. These results indicate that the graph similarity regularized softmax is effective on both assortative and disassortative graphs.
title Graph Similarity Regularized Softmax for Semi-Supervised Node Classification
topic Machine Learning
Optimization and Control
url https://arxiv.org/abs/2409.13544