KCES: Training-Free Defense for Robust Graph Neural Networks via Kernel Complexity

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jia, Yaning, Deng, Shenyang, Ma, Chiyu, Yang, Yaoqing, Vosoughi, Soroush
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909652855291904
author Jia, Yaning
Deng, Shenyang
Ma, Chiyu
Yang, Yaoqing
Vosoughi, Soroush
author_facet Jia, Yaning
Deng, Shenyang
Ma, Chiyu
Yang, Yaoqing
Vosoughi, Soroush
contents Graph Neural Networks (GNNs) have achieved impressive success across a wide range of graph-based tasks, yet they remain highly vulnerable to small, imperceptible perturbations and adversarial attacks. Although numerous defense methods have been proposed to address these vulnerabilities, many rely on heuristic metrics, overfit to specific attack patterns, and suffer from high computational complexity. In this paper, we propose Kernel Complexity-Based Edge Sanitization (KCES), a training-free, model-agnostic defense framework. KCES leverages Graph Kernel Complexity (GKC), a novel metric derived from the graph's Gram matrix that characterizes GNN generalization via its test error bound. Building on GKC, we define a KC score for each edge, measuring the change in GKC when the edge is removed. Edges with high KC scores, typically introduced by adversarial perturbations, are pruned to mitigate their harmful effects, thereby enhancing GNNs' robustness. KCES can also be seamlessly integrated with existing defense strategies as a plug-and-play module without requiring training. Theoretical analysis and extensive experiments demonstrate that KCES consistently enhances GNN robustness, outperforms state-of-the-art baselines, and amplifies the effectiveness of existing defenses, offering a principled and efficient solution for securing GNNs.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11611
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle KCES: Training-Free Defense for Robust Graph Neural Networks via Kernel Complexity
Jia, Yaning
Deng, Shenyang
Ma, Chiyu
Yang, Yaoqing
Vosoughi, Soroush
Machine Learning
Graph Neural Networks (GNNs) have achieved impressive success across a wide range of graph-based tasks, yet they remain highly vulnerable to small, imperceptible perturbations and adversarial attacks. Although numerous defense methods have been proposed to address these vulnerabilities, many rely on heuristic metrics, overfit to specific attack patterns, and suffer from high computational complexity. In this paper, we propose Kernel Complexity-Based Edge Sanitization (KCES), a training-free, model-agnostic defense framework. KCES leverages Graph Kernel Complexity (GKC), a novel metric derived from the graph's Gram matrix that characterizes GNN generalization via its test error bound. Building on GKC, we define a KC score for each edge, measuring the change in GKC when the edge is removed. Edges with high KC scores, typically introduced by adversarial perturbations, are pruned to mitigate their harmful effects, thereby enhancing GNNs' robustness. KCES can also be seamlessly integrated with existing defense strategies as a plug-and-play module without requiring training. Theoretical analysis and extensive experiments demonstrate that KCES consistently enhances GNN robustness, outperforms state-of-the-art baselines, and amplifies the effectiveness of existing defenses, offering a principled and efficient solution for securing GNNs.
title KCES: Training-Free Defense for Robust Graph Neural Networks via Kernel Complexity
topic Machine Learning
url https://arxiv.org/abs/2506.11611