HetCAN: A Heterogeneous Graph Cascade Attention Network with Dual-Level Awareness

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhao, Zeyuan, Ge, Qingqing, Cheng, Anfeng, Liu, Yiding, Li, Xiang, Wang, Shuaiqiang
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909223751778304
author Zhao, Zeyuan
Ge, Qingqing
Cheng, Anfeng
Liu, Yiding
Li, Xiang
Wang, Shuaiqiang
author_facet Zhao, Zeyuan
Ge, Qingqing
Cheng, Anfeng
Liu, Yiding
Li, Xiang
Wang, Shuaiqiang
contents Heterogeneous graph neural networks(HGNNs) have recently shown impressive capability in modeling heterogeneous graphs that are ubiquitous in real-world applications. Most existing methods for heterogeneous graphs mainly learn node embeddings by stacking multiple convolutional or attentional layers, which can be considered as capturing the high-order information from node-level aspect. However, different types of nodes in heterogeneous graphs have diverse features, it is also necessary to capture interactions among node features, namely the high-order information from feature-level aspect. In addition, most methods first align node features by mapping them into one same low-dimensional space, while they may lose some type information of nodes in this way. To address these problems, in this paper, we propose a novel Heterogeneous graph Cascade Attention Network (HetCAN) composed of multiple cascade blocks. Each cascade block includes two components, the type-aware encoder and the dimension-aware encoder. Specifically, the type-aware encoder compensates for the loss of node type information and aims to make full use of graph heterogeneity. The dimension-aware encoder is able to learn the feature-level high-order information by capturing the interactions among node features. With the assistance of these components, HetCAN can comprehensively encode information of node features, graph heterogeneity and graph structure in node embeddings. Extensive experiments demonstrate the superiority of HetCAN over advanced competitors and also exhibit its efficiency and robustness.
format Preprint
id arxiv_https___arxiv_org_abs_2311_03275
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle HetCAN: A Heterogeneous Graph Cascade Attention Network with Dual-Level Awareness
Zhao, Zeyuan
Ge, Qingqing
Cheng, Anfeng
Liu, Yiding
Li, Xiang
Wang, Shuaiqiang
Machine Learning
Social and Information Networks
Heterogeneous graph neural networks(HGNNs) have recently shown impressive capability in modeling heterogeneous graphs that are ubiquitous in real-world applications. Most existing methods for heterogeneous graphs mainly learn node embeddings by stacking multiple convolutional or attentional layers, which can be considered as capturing the high-order information from node-level aspect. However, different types of nodes in heterogeneous graphs have diverse features, it is also necessary to capture interactions among node features, namely the high-order information from feature-level aspect. In addition, most methods first align node features by mapping them into one same low-dimensional space, while they may lose some type information of nodes in this way. To address these problems, in this paper, we propose a novel Heterogeneous graph Cascade Attention Network (HetCAN) composed of multiple cascade blocks. Each cascade block includes two components, the type-aware encoder and the dimension-aware encoder. Specifically, the type-aware encoder compensates for the loss of node type information and aims to make full use of graph heterogeneity. The dimension-aware encoder is able to learn the feature-level high-order information by capturing the interactions among node features. With the assistance of these components, HetCAN can comprehensively encode information of node features, graph heterogeneity and graph structure in node embeddings. Extensive experiments demonstrate the superiority of HetCAN over advanced competitors and also exhibit its efficiency and robustness.
title HetCAN: A Heterogeneous Graph Cascade Attention Network with Dual-Level Awareness
topic Machine Learning
Social and Information Networks
url https://arxiv.org/abs/2311.03275