Towards Few-shot Self-explaining Graph Neural Networks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Peng, Jingyu, Liu, Qi, Yue, Linan, Zhang, Zaixi, Zhang, Kai, Sha, Yunhao
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909286746030080
author Peng, Jingyu
Liu, Qi
Yue, Linan
Zhang, Zaixi
Zhang, Kai
Sha, Yunhao
author_facet Peng, Jingyu
Liu, Qi
Yue, Linan
Zhang, Zaixi
Zhang, Kai
Sha, Yunhao
contents Recent advancements in Graph Neural Networks (GNNs) have spurred an upsurge of research dedicated to enhancing the explainability of GNNs, particularly in critical domains such as medicine. A promising approach is the self-explaining method, which outputs explanations along with predictions. However, existing self-explaining models require a large amount of training data, rendering them unavailable in few-shot scenarios. To address this challenge, in this paper, we propose a Meta-learned Self-Explaining GNN (MSE-GNN), a novel framework that generates explanations to support predictions in few-shot settings. MSE-GNN adopts a two-stage self-explaining structure, consisting of an explainer and a predictor. Specifically, the explainer first imitates the attention mechanism of humans to select the explanation subgraph, whereby attention is naturally paid to regions containing important characteristics. Subsequently, the predictor mimics the decision-making process, which makes predictions based on the generated explanation. Moreover, with a novel meta-training process and a designed mechanism that exploits task information, MSE-GNN can achieve remarkable performance on new few-shot tasks. Extensive experimental results on four datasets demonstrate that MSE-GNN can achieve superior performance on prediction tasks while generating high-quality explanations compared with existing methods. The code is publicly available at https://github.com/jypeng28/MSE-GNN.
format Preprint
id arxiv_https___arxiv_org_abs_2408_07340
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Few-shot Self-explaining Graph Neural Networks
Peng, Jingyu
Liu, Qi
Yue, Linan
Zhang, Zaixi
Zhang, Kai
Sha, Yunhao
Machine Learning
Artificial Intelligence
Recent advancements in Graph Neural Networks (GNNs) have spurred an upsurge of research dedicated to enhancing the explainability of GNNs, particularly in critical domains such as medicine. A promising approach is the self-explaining method, which outputs explanations along with predictions. However, existing self-explaining models require a large amount of training data, rendering them unavailable in few-shot scenarios. To address this challenge, in this paper, we propose a Meta-learned Self-Explaining GNN (MSE-GNN), a novel framework that generates explanations to support predictions in few-shot settings. MSE-GNN adopts a two-stage self-explaining structure, consisting of an explainer and a predictor. Specifically, the explainer first imitates the attention mechanism of humans to select the explanation subgraph, whereby attention is naturally paid to regions containing important characteristics. Subsequently, the predictor mimics the decision-making process, which makes predictions based on the generated explanation. Moreover, with a novel meta-training process and a designed mechanism that exploits task information, MSE-GNN can achieve remarkable performance on new few-shot tasks. Extensive experimental results on four datasets demonstrate that MSE-GNN can achieve superior performance on prediction tasks while generating high-quality explanations compared with existing methods. The code is publicly available at https://github.com/jypeng28/MSE-GNN.
title Towards Few-shot Self-explaining Graph Neural Networks
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2408.07340