Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.12425 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910652714450944 |
|---|---|
| author | Xia, Kaiwen Wu, Huijun Li, Duanyu Xie, Min Wang, Ruibo Zhang, Wenzhe |
| author_facet | Xia, Kaiwen Wu, Huijun Li, Duanyu Xie, Min Wang, Ruibo Zhang, Wenzhe |
| contents | Graph Neural Networks (GNNs) excel at handling graph data but remain vulnerable to adversarial attacks. Existing defense methods typically rely on assumptions like graph sparsity and homophily to either preprocess the graph or guide structure learning. However, preprocessing methods often struggle to accurately distinguish between normal edges and adversarial perturbations, leading to suboptimal results due to the loss of valuable edge information. Robust graph neural network models train directly on graph data affected by adversarial perturbations, without preprocessing. This can cause the model to get stuck in poor local optima, negatively affecting its performance. To address these challenges, we propose Perseus, a novel adversarial defense method based on curriculum learning. Perseus assesses edge difficulty using global homophily and applies a curriculum learning strategy to adjust the learning order, guiding the model to learn the full graph structure while adaptively focusing on common data patterns. This approach mitigates the impact of adversarial perturbations. Experiments show that models trained with Perseus achieve superior performance and are significantly more robust to adversarial attacks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_12425 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Perseus: Leveraging Common Data Patterns with Curriculum Learning for More Robust Graph Neural Networks Xia, Kaiwen Wu, Huijun Li, Duanyu Xie, Min Wang, Ruibo Zhang, Wenzhe Machine Learning Graph Neural Networks (GNNs) excel at handling graph data but remain vulnerable to adversarial attacks. Existing defense methods typically rely on assumptions like graph sparsity and homophily to either preprocess the graph or guide structure learning. However, preprocessing methods often struggle to accurately distinguish between normal edges and adversarial perturbations, leading to suboptimal results due to the loss of valuable edge information. Robust graph neural network models train directly on graph data affected by adversarial perturbations, without preprocessing. This can cause the model to get stuck in poor local optima, negatively affecting its performance. To address these challenges, we propose Perseus, a novel adversarial defense method based on curriculum learning. Perseus assesses edge difficulty using global homophily and applies a curriculum learning strategy to adjust the learning order, guiding the model to learn the full graph structure while adaptively focusing on common data patterns. This approach mitigates the impact of adversarial perturbations. Experiments show that models trained with Perseus achieve superior performance and are significantly more robust to adversarial attacks. |
| title | Perseus: Leveraging Common Data Patterns with Curriculum Learning for More Robust Graph Neural Networks |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2410.12425 |