Model-Free Adversarial Purification via Coarse-To-Fine Tensor Network Representation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Guang, Nguyen, Duc Thien, Tao, Zerui, Slavakis, Konstantinos, Tanaka, Toshihisa, Zhao, Qibin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916629111111680
author Lin, Guang
Nguyen, Duc Thien
Tao, Zerui
Slavakis, Konstantinos
Tanaka, Toshihisa
Zhao, Qibin
author_facet Lin, Guang
Nguyen, Duc Thien
Tao, Zerui
Slavakis, Konstantinos
Tanaka, Toshihisa
Zhao, Qibin
contents Deep neural networks are known to be vulnerable to well-designed adversarial attacks. Although numerous defense strategies have been proposed, many are tailored to the specific attacks or tasks and often fail to generalize across diverse scenarios. In this paper, we propose Tensor Network Purification (TNP), a novel model-free adversarial purification method by a specially designed tensor network decomposition algorithm. TNP depends neither on the pre-trained generative model nor the specific dataset, resulting in strong robustness across diverse adversarial scenarios. To this end, the key challenge lies in relaxing Gaussian-noise assumptions of classical decompositions and accommodating the unknown distribution of adversarial perturbations. Unlike the low-rank representation of classical decompositions, TNP aims to reconstruct the unobserved clean examples from an adversarial example. Specifically, TNP leverages progressive downsampling and introduces a novel adversarial optimization objective to address the challenge of minimizing reconstruction error but without inadvertently restoring adversarial perturbations. Extensive experiments conducted on CIFAR-10, CIFAR-100, and ImageNet demonstrate that our method generalizes effectively across various norm threats, attack types, and tasks, providing a versatile and promising adversarial purification technique.
format Preprint
id arxiv_https___arxiv_org_abs_2502_17972
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Model-Free Adversarial Purification via Coarse-To-Fine Tensor Network Representation
Lin, Guang
Nguyen, Duc Thien
Tao, Zerui
Slavakis, Konstantinos
Tanaka, Toshihisa
Zhao, Qibin
Machine Learning
Deep neural networks are known to be vulnerable to well-designed adversarial attacks. Although numerous defense strategies have been proposed, many are tailored to the specific attacks or tasks and often fail to generalize across diverse scenarios. In this paper, we propose Tensor Network Purification (TNP), a novel model-free adversarial purification method by a specially designed tensor network decomposition algorithm. TNP depends neither on the pre-trained generative model nor the specific dataset, resulting in strong robustness across diverse adversarial scenarios. To this end, the key challenge lies in relaxing Gaussian-noise assumptions of classical decompositions and accommodating the unknown distribution of adversarial perturbations. Unlike the low-rank representation of classical decompositions, TNP aims to reconstruct the unobserved clean examples from an adversarial example. Specifically, TNP leverages progressive downsampling and introduces a novel adversarial optimization objective to address the challenge of minimizing reconstruction error but without inadvertently restoring adversarial perturbations. Extensive experiments conducted on CIFAR-10, CIFAR-100, and ImageNet demonstrate that our method generalizes effectively across various norm threats, attack types, and tasks, providing a versatile and promising adversarial purification technique.
title Model-Free Adversarial Purification via Coarse-To-Fine Tensor Network Representation
topic Machine Learning
url https://arxiv.org/abs/2502.17972