Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xie, Yuechen, Song, Jie, Wang, Huiqiong, Song, Mingli
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915194272219136
author Xie, Yuechen
Song, Jie
Wang, Huiqiong
Song, Mingli
author_facet Xie, Yuechen
Song, Jie
Wang, Huiqiong
Song, Mingli
contents High-quality open-source text-to-image models have lowered the threshold for obtaining photorealistic images significantly, but also face potential risks of misuse. Specifically, suspects may use synthetic data generated by these generative models to train models for specific tasks without permission, when lacking real data resources especially. Protecting these generative models is crucial for the well-being of their owners. In this work, we propose the first method to this important yet unresolved issue, called Training data Provenance Verification (TrainProVe). The rationale behind TrainProVe is grounded in the principle of generalization error bound, which suggests that, for two models with the same task, if the distance between their training data distributions is smaller, their generalization ability will be closer. We validate the efficacy of TrainProVe across four text-to-image models (Stable Diffusion v1.4, latent consistency model, PixArt-$α$, and Stable Cascade). The results show that TrainProVe achieves a verification accuracy of over 99\% in determining the provenance of suspicious model training data, surpassing all previous methods. Code is available at https://github.com/xieyc99/TrainProVe.
format Preprint
id arxiv_https___arxiv_org_abs_2503_09122
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?
Xie, Yuechen
Song, Jie
Wang, Huiqiong
Song, Mingli
Computer Vision and Pattern Recognition
High-quality open-source text-to-image models have lowered the threshold for obtaining photorealistic images significantly, but also face potential risks of misuse. Specifically, suspects may use synthetic data generated by these generative models to train models for specific tasks without permission, when lacking real data resources especially. Protecting these generative models is crucial for the well-being of their owners. In this work, we propose the first method to this important yet unresolved issue, called Training data Provenance Verification (TrainProVe). The rationale behind TrainProVe is grounded in the principle of generalization error bound, which suggests that, for two models with the same task, if the distance between their training data distributions is smaller, their generalization ability will be closer. We validate the efficacy of TrainProVe across four text-to-image models (Stable Diffusion v1.4, latent consistency model, PixArt-$α$, and Stable Cascade). The results show that TrainProVe achieves a verification accuracy of over 99\% in determining the provenance of suspicious model training data, surpassing all previous methods. Code is available at https://github.com/xieyc99/TrainProVe.
title Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.09122