Radioactive Watermarks in Diffusion and Autoregressive Image Generative Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Meintz, Michel, Dubiński, Jan, Boenisch, Franziska, Dziedzic, Adam
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913919426101248
author Meintz, Michel
Dubiński, Jan
Boenisch, Franziska
Dziedzic, Adam
author_facet Meintz, Michel
Dubiński, Jan
Boenisch, Franziska
Dziedzic, Adam
contents Image generative models have become increasingly popular, but training them requires large datasets that are costly to collect and curate. To circumvent these costs, some parties may exploit existing models by using the generated images as training data for their own models. In general, watermarking is a valuable tool for detecting unauthorized use of generated images. However, when these images are used to train a new model, watermarking can only enable detection if the watermark persists through training and remains identifiable in the outputs of the newly trained model - a property known as radioactivity. We analyze the radioactivity of watermarks in images generated by diffusion models (DMs) and image autoregressive models (IARs). We find that existing watermarking methods for DMs fail to retain radioactivity, as watermarks are either erased during encoding into the latent space or lost in the noising-denoising process (during the training in the latent space). Meanwhile, despite IARs having recently surpassed DMs in image generation quality and efficiency, no radioactive watermarking methods have been proposed for them. To overcome this limitation, we propose the first watermarking method tailored for IARs and with radioactivity in mind - drawing inspiration from techniques in large language models (LLMs), which share IARs' autoregressive paradigm. Our extensive experimental evaluation highlights our method's effectiveness in preserving radioactivity within IARs, enabling robust provenance tracking, and preventing unauthorized use of their generated images.
format Preprint
id arxiv_https___arxiv_org_abs_2506_23731
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Radioactive Watermarks in Diffusion and Autoregressive Image Generative Models
Meintz, Michel
Dubiński, Jan
Boenisch, Franziska
Dziedzic, Adam
Machine Learning
Computer Vision and Pattern Recognition
Image generative models have become increasingly popular, but training them requires large datasets that are costly to collect and curate. To circumvent these costs, some parties may exploit existing models by using the generated images as training data for their own models. In general, watermarking is a valuable tool for detecting unauthorized use of generated images. However, when these images are used to train a new model, watermarking can only enable detection if the watermark persists through training and remains identifiable in the outputs of the newly trained model - a property known as radioactivity. We analyze the radioactivity of watermarks in images generated by diffusion models (DMs) and image autoregressive models (IARs). We find that existing watermarking methods for DMs fail to retain radioactivity, as watermarks are either erased during encoding into the latent space or lost in the noising-denoising process (during the training in the latent space). Meanwhile, despite IARs having recently surpassed DMs in image generation quality and efficiency, no radioactive watermarking methods have been proposed for them. To overcome this limitation, we propose the first watermarking method tailored for IARs and with radioactivity in mind - drawing inspiration from techniques in large language models (LLMs), which share IARs' autoregressive paradigm. Our extensive experimental evaluation highlights our method's effectiveness in preserving radioactivity within IARs, enabling robust provenance tracking, and preventing unauthorized use of their generated images.
title Radioactive Watermarks in Diffusion and Autoregressive Image Generative Models
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.23731