Semantic Deep Hiding for Robust Unlearnable Examples

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Meng, Ruohan, Yi, Chenyu, Yu, Yi, Yang, Siyuan, Shen, Bingquan, Kot, Alex C.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929399375331328
author Meng, Ruohan
Yi, Chenyu
Yu, Yi
Yang, Siyuan
Shen, Bingquan
Kot, Alex C.
author_facet Meng, Ruohan
Yi, Chenyu
Yu, Yi
Yang, Siyuan
Shen, Bingquan
Kot, Alex C.
contents Ensuring data privacy and protection has become paramount in the era of deep learning. Unlearnable examples are proposed to mislead the deep learning models and prevent data from unauthorized exploration by adding small perturbations to data. However, such perturbations (e.g., noise, texture, color change) predominantly impact low-level features, making them vulnerable to common countermeasures. In contrast, semantic images with intricate shapes have a wealth of high-level features, making them more resilient to countermeasures and potential for producing robust unlearnable examples. In this paper, we propose a Deep Hiding (DH) scheme that adaptively hides semantic images enriched with high-level features. We employ an Invertible Neural Network (INN) to invisibly integrate predefined images, inherently hiding them with deceptive perturbations. To enhance data unlearnability, we introduce a Latent Feature Concentration module, designed to work with the INN, regularizing the intra-class variance of these perturbations. To further boost the robustness of unlearnable examples, we design a Semantic Images Generation module that produces hidden semantic images. By utilizing similar semantic information, this module generates similar semantic images for samples within the same classes, thereby enlarging the inter-class distance and narrowing the intra-class distance. Extensive experiments on CIFAR-10, CIFAR-100, and an ImageNet subset, against 18 countermeasures, reveal that our proposed method exhibits outstanding robustness for unlearnable examples, demonstrating its efficacy in preventing unauthorized data exploitation.
format Preprint
id arxiv_https___arxiv_org_abs_2406_17349
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Semantic Deep Hiding for Robust Unlearnable Examples
Meng, Ruohan
Yi, Chenyu
Yu, Yi
Yang, Siyuan
Shen, Bingquan
Kot, Alex C.
Cryptography and Security
Computer Vision and Pattern Recognition
Ensuring data privacy and protection has become paramount in the era of deep learning. Unlearnable examples are proposed to mislead the deep learning models and prevent data from unauthorized exploration by adding small perturbations to data. However, such perturbations (e.g., noise, texture, color change) predominantly impact low-level features, making them vulnerable to common countermeasures. In contrast, semantic images with intricate shapes have a wealth of high-level features, making them more resilient to countermeasures and potential for producing robust unlearnable examples. In this paper, we propose a Deep Hiding (DH) scheme that adaptively hides semantic images enriched with high-level features. We employ an Invertible Neural Network (INN) to invisibly integrate predefined images, inherently hiding them with deceptive perturbations. To enhance data unlearnability, we introduce a Latent Feature Concentration module, designed to work with the INN, regularizing the intra-class variance of these perturbations. To further boost the robustness of unlearnable examples, we design a Semantic Images Generation module that produces hidden semantic images. By utilizing similar semantic information, this module generates similar semantic images for samples within the same classes, thereby enlarging the inter-class distance and narrowing the intra-class distance. Extensive experiments on CIFAR-10, CIFAR-100, and an ImageNet subset, against 18 countermeasures, reveal that our proposed method exhibits outstanding robustness for unlearnable examples, demonstrating its efficacy in preventing unauthorized data exploitation.
title Semantic Deep Hiding for Robust Unlearnable Examples
topic Cryptography and Security
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.17349