Exploiting Text Semantics for Few and Zero Shot Node Classification on Text-attributed Graph

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Yuxiang, Yan, Xiao, Jin, Shiyu, Xu, Quanqing, Hu, Chuang, Zhu, Yuanyuan, Du, Bo, Wu, Jia, Jiang, Jiawei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915286262743040
author Wang, Yuxiang
Yan, Xiao
Jin, Shiyu
Xu, Quanqing
Hu, Chuang
Zhu, Yuanyuan
Du, Bo
Wu, Jia
Jiang, Jiawei
author_facet Wang, Yuxiang
Yan, Xiao
Jin, Shiyu
Xu, Quanqing
Hu, Chuang
Zhu, Yuanyuan
Du, Bo
Wu, Jia
Jiang, Jiawei
contents Text-attributed graph (TAG) provides a text description for each graph node, and few- and zero-shot node classification on TAGs have many applications in fields such as academia and social networks. Existing work utilizes various graph-based augmentation techniques to train the node and text embeddings, while text-based augmentations are largely unexplored. In this paper, we propose Text Semantics Augmentation (TSA) to improve accuracy by introducing more text semantic supervision signals. Specifically, we design two augmentation techniques, i.e., positive semantics matching and negative semantics contrast, to provide more reference texts for each graph node or text description. Positive semantic matching retrieves texts with similar embeddings to match with a graph node. Negative semantic contrast adds a negative prompt to construct a text description with the opposite semantics, which is contrasted with the original node and text. We evaluate TSA on 5 datasets and compare with 13 state-of-the-art baselines. The results show that TSA consistently outperforms all baselines, and its accuracy improvements over the best-performing baseline are usually over 5%.
format Preprint
id arxiv_https___arxiv_org_abs_2505_08168
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploiting Text Semantics for Few and Zero Shot Node Classification on Text-attributed Graph
Wang, Yuxiang
Yan, Xiao
Jin, Shiyu
Xu, Quanqing
Hu, Chuang
Zhu, Yuanyuan
Du, Bo
Wu, Jia
Jiang, Jiawei
Computation and Language
Artificial Intelligence
Text-attributed graph (TAG) provides a text description for each graph node, and few- and zero-shot node classification on TAGs have many applications in fields such as academia and social networks. Existing work utilizes various graph-based augmentation techniques to train the node and text embeddings, while text-based augmentations are largely unexplored. In this paper, we propose Text Semantics Augmentation (TSA) to improve accuracy by introducing more text semantic supervision signals. Specifically, we design two augmentation techniques, i.e., positive semantics matching and negative semantics contrast, to provide more reference texts for each graph node or text description. Positive semantic matching retrieves texts with similar embeddings to match with a graph node. Negative semantic contrast adds a negative prompt to construct a text description with the opposite semantics, which is contrasted with the original node and text. We evaluate TSA on 5 datasets and compare with 13 state-of-the-art baselines. The results show that TSA consistently outperforms all baselines, and its accuracy improvements over the best-performing baseline are usually over 5%.
title Exploiting Text Semantics for Few and Zero Shot Node Classification on Text-attributed Graph
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2505.08168