Robust and Large-Payload DNN Watermarking via Fixed, Distribution-Optimized, Weights

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tondi, Benedetta, Costanzo, Andrea, Barni, Mauro
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914642706563072
author Tondi, Benedetta
Costanzo, Andrea
Barni, Mauro
author_facet Tondi, Benedetta
Costanzo, Andrea
Barni, Mauro
contents The design of an effective multi-bit watermarking algorithm hinges upon finding a good trade-off between the three fundamental requirements forming the watermarking trade-off triangle, namely, robustness against network modifications, payload, and unobtrusiveness, ensuring minimal impact on the performance of the watermarked network. In this paper, we first revisit the nature of the watermarking trade-off triangle for the DNN case, then we exploit our findings to propose a white-box, multi-bit watermarking method achieving very large payload and strong robustness against network modification. In the proposed system, the weights hosting the watermark are set prior to training, making sure that their amplitude is large enough to bear the target payload and survive network modifications, notably retraining, and are left unchanged throughout the training process. The distribution of the weights carrying the watermark is theoretically optimised to ensure the secrecy of the watermark and make sure that the watermarked weights are indistinguishable from the non-watermarked ones. The proposed method can achieve outstanding performance, with no significant impact on network accuracy, including robustness against network modifications, retraining and transfer learning, while ensuring a payload which is out of reach of state of the art methods achieving a lower - or at most comparable - robustness.
format Preprint
id arxiv_https___arxiv_org_abs_2208_10973
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Robust and Large-Payload DNN Watermarking via Fixed, Distribution-Optimized, Weights
Tondi, Benedetta
Costanzo, Andrea
Barni, Mauro
Computer Vision and Pattern Recognition
Cryptography and Security
The design of an effective multi-bit watermarking algorithm hinges upon finding a good trade-off between the three fundamental requirements forming the watermarking trade-off triangle, namely, robustness against network modifications, payload, and unobtrusiveness, ensuring minimal impact on the performance of the watermarked network. In this paper, we first revisit the nature of the watermarking trade-off triangle for the DNN case, then we exploit our findings to propose a white-box, multi-bit watermarking method achieving very large payload and strong robustness against network modification. In the proposed system, the weights hosting the watermark are set prior to training, making sure that their amplitude is large enough to bear the target payload and survive network modifications, notably retraining, and are left unchanged throughout the training process. The distribution of the weights carrying the watermark is theoretically optimised to ensure the secrecy of the watermark and make sure that the watermarked weights are indistinguishable from the non-watermarked ones. The proposed method can achieve outstanding performance, with no significant impact on network accuracy, including robustness against network modifications, retraining and transfer learning, while ensuring a payload which is out of reach of state of the art methods achieving a lower - or at most comparable - robustness.
title Robust and Large-Payload DNN Watermarking via Fixed, Distribution-Optimized, Weights
topic Computer Vision and Pattern Recognition
Cryptography and Security
url https://arxiv.org/abs/2208.10973