Assessing Robustness via Score-Based Adversarial Image Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kollovieh, Marcel, Gosch, Lukas, Lienen, Marten, Scholten, Yan, Schwinn, Leo, Günnemann, Stephan
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917944146001920
author Kollovieh, Marcel
Gosch, Lukas
Lienen, Marten
Scholten, Yan
Schwinn, Leo
Günnemann, Stephan
author_facet Kollovieh, Marcel
Gosch, Lukas
Lienen, Marten
Scholten, Yan
Schwinn, Leo
Günnemann, Stephan
contents Most adversarial attacks and defenses focus on perturbations within small $\ell_p$-norm constraints. However, $\ell_p$ threat models cannot capture all relevant semantics-preserving perturbations, and hence, the scope of robustness evaluations is limited. In this work, we introduce Score-Based Adversarial Generation (ScoreAG), a novel framework that leverages the advancements in score-based generative models to generate unrestricted adversarial examples that overcome the limitations of $\ell_p$-norm constraints. Unlike traditional methods, ScoreAG maintains the core semantics of images while generating adversarial examples, either by transforming existing images or synthesizing new ones entirely from scratch. We further exploit the generative capability of ScoreAG to purify images, empirically enhancing the robustness of classifiers. Our extensive empirical evaluation demonstrates that ScoreAG improves upon the majority of state-of-the-art attacks and defenses across multiple benchmarks. This work highlights the importance of investigating adversarial examples bounded by semantics rather than $\ell_p$-norm constraints. ScoreAG represents an important step towards more encompassing robustness assessments.
format Preprint
id arxiv_https___arxiv_org_abs_2310_04285
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Assessing Robustness via Score-Based Adversarial Image Generation
Kollovieh, Marcel
Gosch, Lukas
Lienen, Marten
Scholten, Yan
Schwinn, Leo
Günnemann, Stephan
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Most adversarial attacks and defenses focus on perturbations within small $\ell_p$-norm constraints. However, $\ell_p$ threat models cannot capture all relevant semantics-preserving perturbations, and hence, the scope of robustness evaluations is limited. In this work, we introduce Score-Based Adversarial Generation (ScoreAG), a novel framework that leverages the advancements in score-based generative models to generate unrestricted adversarial examples that overcome the limitations of $\ell_p$-norm constraints. Unlike traditional methods, ScoreAG maintains the core semantics of images while generating adversarial examples, either by transforming existing images or synthesizing new ones entirely from scratch. We further exploit the generative capability of ScoreAG to purify images, empirically enhancing the robustness of classifiers. Our extensive empirical evaluation demonstrates that ScoreAG improves upon the majority of state-of-the-art attacks and defenses across multiple benchmarks. This work highlights the importance of investigating adversarial examples bounded by semantics rather than $\ell_p$-norm constraints. ScoreAG represents an important step towards more encompassing robustness assessments.
title Assessing Robustness via Score-Based Adversarial Image Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2310.04285