MsMemoryGAN: A Multi-scale Memory GAN for Palm-vein Adversarial Purification

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Qin, Huafeng, Fu, Yuming, Zhang, Huiyan, El-Yacoubi, Mounim A., Gao, Xinbo, Song, Qun, Wang, Jun
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911996191965184
author Qin, Huafeng
Fu, Yuming
Zhang, Huiyan
El-Yacoubi, Mounim A.
Gao, Xinbo
Song, Qun
Wang, Jun
author_facet Qin, Huafeng
Fu, Yuming
Zhang, Huiyan
El-Yacoubi, Mounim A.
Gao, Xinbo
Song, Qun
Wang, Jun
contents Deep neural networks have recently achieved promising performance in the vein recognition task and have shown an increasing application trend, however, they are prone to adversarial perturbation attacks by adding imperceptible perturbations to the input, resulting in making incorrect recognition. To address this issue, we propose a novel defense model named MsMemoryGAN, which aims to filter the perturbations from adversarial samples before recognition. First, we design a multi-scale autoencoder to achieve high-quality reconstruction and two memory modules to learn the detailed patterns of normal samples at different scales. Second, we investigate a learnable metric in the memory module to retrieve the most relevant memory items to reconstruct the input image. Finally, the perceptional loss is combined with the pixel loss to further enhance the quality of the reconstructed image. During the training phase, the MsMemoryGAN learns to reconstruct the input by merely using fewer prototypical elements of the normal patterns recorded in the memory. At the testing stage, given an adversarial sample, the MsMemoryGAN retrieves its most relevant normal patterns in memory for the reconstruction. Perturbations in the adversarial sample are usually not reconstructed well, resulting in purifying the input from adversarial perturbations. We have conducted extensive experiments on two public vein datasets under different adversarial attack methods to evaluate the performance of the proposed approach. The experimental results show that our approach removes a wide variety of adversarial perturbations, allowing vein classifiers to achieve the highest recognition accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2408_10694
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MsMemoryGAN: A Multi-scale Memory GAN for Palm-vein Adversarial Purification
Qin, Huafeng
Fu, Yuming
Zhang, Huiyan
El-Yacoubi, Mounim A.
Gao, Xinbo
Song, Qun
Wang, Jun
Computer Vision and Pattern Recognition
Deep neural networks have recently achieved promising performance in the vein recognition task and have shown an increasing application trend, however, they are prone to adversarial perturbation attacks by adding imperceptible perturbations to the input, resulting in making incorrect recognition. To address this issue, we propose a novel defense model named MsMemoryGAN, which aims to filter the perturbations from adversarial samples before recognition. First, we design a multi-scale autoencoder to achieve high-quality reconstruction and two memory modules to learn the detailed patterns of normal samples at different scales. Second, we investigate a learnable metric in the memory module to retrieve the most relevant memory items to reconstruct the input image. Finally, the perceptional loss is combined with the pixel loss to further enhance the quality of the reconstructed image. During the training phase, the MsMemoryGAN learns to reconstruct the input by merely using fewer prototypical elements of the normal patterns recorded in the memory. At the testing stage, given an adversarial sample, the MsMemoryGAN retrieves its most relevant normal patterns in memory for the reconstruction. Perturbations in the adversarial sample are usually not reconstructed well, resulting in purifying the input from adversarial perturbations. We have conducted extensive experiments on two public vein datasets under different adversarial attack methods to evaluate the performance of the proposed approach. The experimental results show that our approach removes a wide variety of adversarial perturbations, allowing vein classifiers to achieve the highest recognition accuracy.
title MsMemoryGAN: A Multi-scale Memory GAN for Palm-vein Adversarial Purification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.10694