Exploring Layerwise Adversarial Robustness Through the Lens of t-SNE

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Valentim, Inês, Antunes, Nuno, Lourenço, Nuno
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929392241868800
author Valentim, Inês
Antunes, Nuno
Lourenço, Nuno
author_facet Valentim, Inês
Antunes, Nuno
Lourenço, Nuno
contents Adversarial examples, designed to trick Artificial Neural Networks (ANNs) into producing wrong outputs, highlight vulnerabilities in these models. Exploring these weaknesses is crucial for developing defenses, and so, we propose a method to assess the adversarial robustness of image-classifying ANNs. The t-distributed Stochastic Neighbor Embedding (t-SNE) technique is used for visual inspection, and a metric, which compares the clean and perturbed embeddings, helps pinpoint weak spots in the layers. Analyzing two ANNs on CIFAR-10, one designed by humans and another via NeuroEvolution, we found that differences between clean and perturbed representations emerge early on, in the feature extraction layers, affecting subsequent classification. The findings with our metric are supported by the visual analysis of the t-SNE maps.
format Preprint
id arxiv_https___arxiv_org_abs_2406_14073
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Exploring Layerwise Adversarial Robustness Through the Lens of t-SNE
Valentim, Inês
Antunes, Nuno
Lourenço, Nuno
Machine Learning
Artificial Intelligence
Neural and Evolutionary Computing
Adversarial examples, designed to trick Artificial Neural Networks (ANNs) into producing wrong outputs, highlight vulnerabilities in these models. Exploring these weaknesses is crucial for developing defenses, and so, we propose a method to assess the adversarial robustness of image-classifying ANNs. The t-distributed Stochastic Neighbor Embedding (t-SNE) technique is used for visual inspection, and a metric, which compares the clean and perturbed embeddings, helps pinpoint weak spots in the layers. Analyzing two ANNs on CIFAR-10, one designed by humans and another via NeuroEvolution, we found that differences between clean and perturbed representations emerge early on, in the feature extraction layers, affecting subsequent classification. The findings with our metric are supported by the visual analysis of the t-SNE maps.
title Exploring Layerwise Adversarial Robustness Through the Lens of t-SNE
topic Machine Learning
Artificial Intelligence
Neural and Evolutionary Computing
url https://arxiv.org/abs/2406.14073