Normalize Then Propagate: Efficient Homophilous Regularization for Few-shot Semi-Supervised Node Classification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Baoming, Chen, MingCai, Song, Jianqing, Li, Shuangjie, Zhang, Jie, Wang, Chongjun
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913809583570944
author Zhang, Baoming
Chen, MingCai
Song, Jianqing
Li, Shuangjie
Zhang, Jie
Wang, Chongjun
author_facet Zhang, Baoming
Chen, MingCai
Song, Jianqing
Li, Shuangjie
Zhang, Jie
Wang, Chongjun
contents Graph Neural Networks (GNNs) have demonstrated remarkable ability in semi-supervised node classification. However, most existing GNNs rely heavily on a large amount of labeled data for training, which is labor-intensive and requires extensive domain knowledge. In this paper, we first analyze the restrictions of GNNs generalization from the perspective of supervision signals in the context of few-shot semi-supervised node classification. To address these challenges, we propose a novel algorithm named NormProp, which utilizes the homophily assumption of unlabeled nodes to generate additional supervision signals, thereby enhancing the generalization against label scarcity. The key idea is to efficiently capture both the class information and the consistency of aggregation during message passing, via decoupling the direction and Euclidean norm of node representations. Moreover, we conduct a theoretical analysis to determine the upper bound of Euclidean norm, and then propose homophilous regularization to constraint the consistency of unlabeled nodes. Extensive experiments demonstrate that NormProp achieve state-of-the-art performance under low-label rate scenarios with low computational complexity.
format Preprint
id arxiv_https___arxiv_org_abs_2501_08581
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Normalize Then Propagate: Efficient Homophilous Regularization for Few-shot Semi-Supervised Node Classification
Zhang, Baoming
Chen, MingCai
Song, Jianqing
Li, Shuangjie
Zhang, Jie
Wang, Chongjun
Machine Learning
Graph Neural Networks (GNNs) have demonstrated remarkable ability in semi-supervised node classification. However, most existing GNNs rely heavily on a large amount of labeled data for training, which is labor-intensive and requires extensive domain knowledge. In this paper, we first analyze the restrictions of GNNs generalization from the perspective of supervision signals in the context of few-shot semi-supervised node classification. To address these challenges, we propose a novel algorithm named NormProp, which utilizes the homophily assumption of unlabeled nodes to generate additional supervision signals, thereby enhancing the generalization against label scarcity. The key idea is to efficiently capture both the class information and the consistency of aggregation during message passing, via decoupling the direction and Euclidean norm of node representations. Moreover, we conduct a theoretical analysis to determine the upper bound of Euclidean norm, and then propose homophilous regularization to constraint the consistency of unlabeled nodes. Extensive experiments demonstrate that NormProp achieve state-of-the-art performance under low-label rate scenarios with low computational complexity.
title Normalize Then Propagate: Efficient Homophilous Regularization for Few-shot Semi-Supervised Node Classification
topic Machine Learning
url https://arxiv.org/abs/2501.08581