Training Robust Graph Neural Networks by Modeling Noise Dependencies

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: In, Yeonjun, Yoon, Kanghoon, Yun, Sukwon, Kim, Kibum, Kim, Sungchul, Park, Chanyoung
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914108458139648
author In, Yeonjun
Yoon, Kanghoon
Yun, Sukwon
Kim, Kibum
Kim, Sungchul
Park, Chanyoung
author_facet In, Yeonjun
Yoon, Kanghoon
Yun, Sukwon
Kim, Kibum
Kim, Sungchul
Park, Chanyoung
contents In real-world applications, node features in graphs often contain noise from various sources, leading to significant performance degradation in GNNs. Although several methods have been developed to enhance robustness, they rely on the unrealistic assumption that noise in node features is independent of the graph structure and node labels, thereby limiting their applicability. To this end, we introduce a more realistic noise scenario, dependency-aware noise on graphs (DANG), where noise in node features create a chain of noise dependencies that propagates to the graph structure and node labels. We propose a novel robust GNN, DA-GNN, which captures the causal relationships among variables in the data generating process (DGP) of DANG using variational inference. In addition, we present new benchmark datasets that simulate DANG in real-world applications, enabling more practical research on robust GNNs. Extensive experiments demonstrate that DA-GNN consistently outperforms existing baselines across various noise scenarios, including both DANG and conventional noise models commonly considered in this field. Our code is available at https://github.com/yeonjun-in/torch-DA-GNN.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19670
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Training Robust Graph Neural Networks by Modeling Noise Dependencies
In, Yeonjun
Yoon, Kanghoon
Yun, Sukwon
Kim, Kibum
Kim, Sungchul
Park, Chanyoung
Machine Learning
In real-world applications, node features in graphs often contain noise from various sources, leading to significant performance degradation in GNNs. Although several methods have been developed to enhance robustness, they rely on the unrealistic assumption that noise in node features is independent of the graph structure and node labels, thereby limiting their applicability. To this end, we introduce a more realistic noise scenario, dependency-aware noise on graphs (DANG), where noise in node features create a chain of noise dependencies that propagates to the graph structure and node labels. We propose a novel robust GNN, DA-GNN, which captures the causal relationships among variables in the data generating process (DGP) of DANG using variational inference. In addition, we present new benchmark datasets that simulate DANG in real-world applications, enabling more practical research on robust GNNs. Extensive experiments demonstrate that DA-GNN consistently outperforms existing baselines across various noise scenarios, including both DANG and conventional noise models commonly considered in this field. Our code is available at https://github.com/yeonjun-in/torch-DA-GNN.
title Training Robust Graph Neural Networks by Modeling Noise Dependencies
topic Machine Learning
url https://arxiv.org/abs/2502.19670