Class-Conditioned Transformation for Enhanced Robust Image Classification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Blau, Tsachi, Ganz, Roy, Baskin, Chaim, Elad, Michael, Bronstein, Alex M.
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916467711148032
author Blau, Tsachi
Ganz, Roy
Baskin, Chaim
Elad, Michael
Bronstein, Alex M.
author_facet Blau, Tsachi
Ganz, Roy
Baskin, Chaim
Elad, Michael
Bronstein, Alex M.
contents Robust classification methods predominantly concentrate on algorithms that address a specific threat model, resulting in ineffective defenses against other threat models. Real-world applications are exposed to this vulnerability, as malicious attackers might exploit alternative threat models. In this work, we propose a novel test-time threat model agnostic algorithm that enhances Adversarial-Trained (AT) models. Our method operates through COnditional image transformation and DIstance-based Prediction (CODIP) and includes two main steps: First, we transform the input image into each dataset class, where the input image might be either clean or attacked. Next, we make a prediction based on the shortest transformed distance. The conditional transformation utilizes the perceptually aligned gradients property possessed by AT models and, as a result, eliminates the need for additional models or additional training. Moreover, it allows users to choose the desired balance between clean and robust accuracy without training. The proposed method achieves state-of-the-art results demonstrated through extensive experiments on various models, AT methods, datasets, and attack types. Notably, applying CODIP leads to substantial robust accuracy improvement of up to $+23\%$, $+20\%$, $+26\%$, and $+22\%$ on CIFAR10, CIFAR100, ImageNet and Flowers datasets, respectively.
format Preprint
id arxiv_https___arxiv_org_abs_2303_15409
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Class-Conditioned Transformation for Enhanced Robust Image Classification
Blau, Tsachi
Ganz, Roy
Baskin, Chaim
Elad, Michael
Bronstein, Alex M.
Computer Vision and Pattern Recognition
Robust classification methods predominantly concentrate on algorithms that address a specific threat model, resulting in ineffective defenses against other threat models. Real-world applications are exposed to this vulnerability, as malicious attackers might exploit alternative threat models. In this work, we propose a novel test-time threat model agnostic algorithm that enhances Adversarial-Trained (AT) models. Our method operates through COnditional image transformation and DIstance-based Prediction (CODIP) and includes two main steps: First, we transform the input image into each dataset class, where the input image might be either clean or attacked. Next, we make a prediction based on the shortest transformed distance. The conditional transformation utilizes the perceptually aligned gradients property possessed by AT models and, as a result, eliminates the need for additional models or additional training. Moreover, it allows users to choose the desired balance between clean and robust accuracy without training. The proposed method achieves state-of-the-art results demonstrated through extensive experiments on various models, AT methods, datasets, and attack types. Notably, applying CODIP leads to substantial robust accuracy improvement of up to $+23\%$, $+20\%$, $+26\%$, and $+22\%$ on CIFAR10, CIFAR100, ImageNet and Flowers datasets, respectively.
title Class-Conditioned Transformation for Enhanced Robust Image Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2303.15409