Probabilistically Robust Watermarking of Neural Networks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Pautov, Mikhail, Bogdanov, Nikita, Pyatkin, Stanislav, Rogov, Oleg, Oseledets, Ivan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929599366037504
author Pautov, Mikhail
Bogdanov, Nikita
Pyatkin, Stanislav
Rogov, Oleg
Oseledets, Ivan
author_facet Pautov, Mikhail
Bogdanov, Nikita
Pyatkin, Stanislav
Rogov, Oleg
Oseledets, Ivan
contents As deep learning (DL) models are widely and effectively used in Machine Learning as a Service (MLaaS) platforms, there is a rapidly growing interest in DL watermarking techniques that can be used to confirm the ownership of a particular model. Unfortunately, these methods usually produce watermarks susceptible to model stealing attacks. In our research, we introduce a novel trigger set-based watermarking approach that demonstrates resilience against functionality stealing attacks, particularly those involving extraction and distillation. Our approach does not require additional model training and can be applied to any model architecture. The key idea of our method is to compute the trigger set, which is transferable between the source model and the set of proxy models with a high probability. In our experimental study, we show that if the probability of the set being transferable is reasonably high, it can be effectively used for ownership verification of the stolen model. We evaluate our method on multiple benchmarks and show that our approach outperforms current state-of-the-art watermarking techniques in all considered experimental setups.
format Preprint
id arxiv_https___arxiv_org_abs_2401_08261
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Probabilistically Robust Watermarking of Neural Networks
Pautov, Mikhail
Bogdanov, Nikita
Pyatkin, Stanislav
Rogov, Oleg
Oseledets, Ivan
Cryptography and Security
Artificial Intelligence
As deep learning (DL) models are widely and effectively used in Machine Learning as a Service (MLaaS) platforms, there is a rapidly growing interest in DL watermarking techniques that can be used to confirm the ownership of a particular model. Unfortunately, these methods usually produce watermarks susceptible to model stealing attacks. In our research, we introduce a novel trigger set-based watermarking approach that demonstrates resilience against functionality stealing attacks, particularly those involving extraction and distillation. Our approach does not require additional model training and can be applied to any model architecture. The key idea of our method is to compute the trigger set, which is transferable between the source model and the set of proxy models with a high probability. In our experimental study, we show that if the probability of the set being transferable is reasonably high, it can be effectively used for ownership verification of the stolen model. We evaluate our method on multiple benchmarks and show that our approach outperforms current state-of-the-art watermarking techniques in all considered experimental setups.
title Probabilistically Robust Watermarking of Neural Networks
topic Cryptography and Security
Artificial Intelligence
url https://arxiv.org/abs/2401.08261