Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Training

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Ting, Zhou, Zhixin, Luo, Rui
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913636915609600
author Wang, Ting
Zhou, Zhixin
Luo, Rui
author_facet Wang, Ting
Zhou, Zhixin
Luo, Rui
contents Graph Neural Networks (GNNs) has been widely used in a variety of fields because of their great potential in representing graph-structured data. However, lacking of rigorous uncertainty estimations limits their application in high-stakes. Conformal Prediction (CP) can produce statistically guaranteed uncertainty estimates by using the classifier's probability estimates to obtain prediction sets, which contains the true class with a user-specified probability. In this paper, we propose a Rank-based CP during training framework to GNNs (RCP-GNN) for reliable uncertainty estimates to enhance the trustworthiness of GNNs in the node classification scenario. By exploiting rank information of the classifier's outcome, prediction sets with desired coverage rate can be efficiently constructed. The strategy of CP during training with differentiable rank-based conformity loss function is further explored to adapt prediction sets according to network topology information. In this way, the composition of prediction sets can be guided by the goal of jointly reducing inefficiency and probability estimation errors. Extensive experiments on several real-world datasets show that our model achieves any pre-defined target marginal coverage while significantly reducing the inefficiency compared with state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2501_02767
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Training
Wang, Ting
Zhou, Zhixin
Luo, Rui
Machine Learning
Artificial Intelligence
Graph Neural Networks (GNNs) has been widely used in a variety of fields because of their great potential in representing graph-structured data. However, lacking of rigorous uncertainty estimations limits their application in high-stakes. Conformal Prediction (CP) can produce statistically guaranteed uncertainty estimates by using the classifier's probability estimates to obtain prediction sets, which contains the true class with a user-specified probability. In this paper, we propose a Rank-based CP during training framework to GNNs (RCP-GNN) for reliable uncertainty estimates to enhance the trustworthiness of GNNs in the node classification scenario. By exploiting rank information of the classifier's outcome, prediction sets with desired coverage rate can be efficiently constructed. The strategy of CP during training with differentiable rank-based conformity loss function is further explored to adapt prediction sets according to network topology information. In this way, the composition of prediction sets can be guided by the goal of jointly reducing inefficiency and probability estimation errors. Extensive experiments on several real-world datasets show that our model achieves any pre-defined target marginal coverage while significantly reducing the inefficiency compared with state-of-the-art methods.
title Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Training
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2501.02767