CertDW: Towards Certified Dataset Ownership Verification via Conformal Prediction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Qiao, Ting, Li, Yiming, Li, Jianbin, Wang, Yingjia, Qi, Leyi, Guo, Junfeng, Feng, Ruili, Tao, Dacheng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915346402770944
author Qiao, Ting
Li, Yiming
Li, Jianbin
Wang, Yingjia
Qi, Leyi
Guo, Junfeng
Feng, Ruili
Tao, Dacheng
author_facet Qiao, Ting
Li, Yiming
Li, Jianbin
Wang, Yingjia
Qi, Leyi
Guo, Junfeng
Feng, Ruili
Tao, Dacheng
contents Deep neural networks (DNNs) rely heavily on high-quality open-source datasets (e.g., ImageNet) for their success, making dataset ownership verification (DOV) crucial for protecting public dataset copyrights. In this paper, we find existing DOV methods (implicitly) assume that the verification process is faithful, where the suspicious model will directly verify ownership by using the verification samples as input and returning their results. However, this assumption may not necessarily hold in practice and their performance may degrade sharply when subjected to intentional or unintentional perturbations. To address this limitation, we propose the first certified dataset watermark (i.e., CertDW) and CertDW-based certified dataset ownership verification method that ensures reliable verification even under malicious attacks, under certain conditions (e.g., constrained pixel-level perturbation). Specifically, inspired by conformal prediction, we introduce two statistical measures, including principal probability (PP) and watermark robustness (WR), to assess model prediction stability on benign and watermarked samples under noise perturbations. We prove there exists a provable lower bound between PP and WR, enabling ownership verification when a suspicious model's WR value significantly exceeds the PP values of multiple benign models trained on watermark-free datasets. If the number of PP values smaller than WR exceeds a threshold, the suspicious model is regarded as having been trained on the protected dataset. Extensive experiments on benchmark datasets verify the effectiveness of our CertDW method and its resistance to potential adaptive attacks. Our codes are at \href{https://github.com/NcepuQiaoTing/CertDW}{GitHub}.
format Preprint
id arxiv_https___arxiv_org_abs_2506_13160
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CertDW: Towards Certified Dataset Ownership Verification via Conformal Prediction
Qiao, Ting
Li, Yiming
Li, Jianbin
Wang, Yingjia
Qi, Leyi
Guo, Junfeng
Feng, Ruili
Tao, Dacheng
Machine Learning
Artificial Intelligence
Cryptography and Security
Computer Vision and Pattern Recognition
Deep neural networks (DNNs) rely heavily on high-quality open-source datasets (e.g., ImageNet) for their success, making dataset ownership verification (DOV) crucial for protecting public dataset copyrights. In this paper, we find existing DOV methods (implicitly) assume that the verification process is faithful, where the suspicious model will directly verify ownership by using the verification samples as input and returning their results. However, this assumption may not necessarily hold in practice and their performance may degrade sharply when subjected to intentional or unintentional perturbations. To address this limitation, we propose the first certified dataset watermark (i.e., CertDW) and CertDW-based certified dataset ownership verification method that ensures reliable verification even under malicious attacks, under certain conditions (e.g., constrained pixel-level perturbation). Specifically, inspired by conformal prediction, we introduce two statistical measures, including principal probability (PP) and watermark robustness (WR), to assess model prediction stability on benign and watermarked samples under noise perturbations. We prove there exists a provable lower bound between PP and WR, enabling ownership verification when a suspicious model's WR value significantly exceeds the PP values of multiple benign models trained on watermark-free datasets. If the number of PP values smaller than WR exceeds a threshold, the suspicious model is regarded as having been trained on the protected dataset. Extensive experiments on benchmark datasets verify the effectiveness of our CertDW method and its resistance to potential adaptive attacks. Our codes are at \href{https://github.com/NcepuQiaoTing/CertDW}{GitHub}.
title CertDW: Towards Certified Dataset Ownership Verification via Conformal Prediction
topic Machine Learning
Artificial Intelligence
Cryptography and Security
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.13160