Rethinking Artistic Copyright Infringements in the Era of Text-to-Image Generative Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Moayeri, Mazda, Basu, Samyadeep, Balasubramanian, Sriram, Kattakinda, Priyatham, Chengini, Atoosa, Brauneis, Robert, Feizi, Soheil
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909167302737920
author Moayeri, Mazda
Basu, Samyadeep
Balasubramanian, Sriram
Kattakinda, Priyatham
Chengini, Atoosa
Brauneis, Robert
Feizi, Soheil
author_facet Moayeri, Mazda
Basu, Samyadeep
Balasubramanian, Sriram
Kattakinda, Priyatham
Chengini, Atoosa
Brauneis, Robert
Feizi, Soheil
contents Recent text-to-image generative models such as Stable Diffusion are extremely adept at mimicking and generating copyrighted content, raising concerns amongst artists that their unique styles may be improperly copied. Understanding how generative models copy "artistic style" is more complex than duplicating a single image, as style is comprised by a set of elements (or signature) that frequently co-occurs across a body of work, where each individual work may vary significantly. In our paper, we first reformulate the problem of "artistic copyright infringement" to a classification problem over image sets, instead of probing image-wise similarities. We then introduce ArtSavant, a practical (i.e., efficient and easy to understand) tool to (i) determine the unique style of an artist by comparing it to a reference dataset of works from 372 artists curated from WikiArt, and (ii) recognize if the identified style reappears in generated images. We leverage two complementary methods to perform artistic style classification over image sets, includingTagMatch, which is a novel inherently interpretable and attributable method, making it more suitable for broader use by non-technical stake holders (artists, lawyers, judges, etc). Leveraging ArtSavant, we then perform a large-scale empirical study to provide quantitative insight on the prevalence of artistic style copying across 3 popular text-to-image generative models. Namely, amongst a dataset of prolific artists (including many famous ones), only 20% of them appear to have their styles be at a risk of copying via simple prompting of today's popular text-to-image generative models.
format Preprint
id arxiv_https___arxiv_org_abs_2404_08030
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Rethinking Artistic Copyright Infringements in the Era of Text-to-Image Generative Models
Moayeri, Mazda
Basu, Samyadeep
Balasubramanian, Sriram
Kattakinda, Priyatham
Chengini, Atoosa
Brauneis, Robert
Feizi, Soheil
Computer Vision and Pattern Recognition
Artificial Intelligence
Recent text-to-image generative models such as Stable Diffusion are extremely adept at mimicking and generating copyrighted content, raising concerns amongst artists that their unique styles may be improperly copied. Understanding how generative models copy "artistic style" is more complex than duplicating a single image, as style is comprised by a set of elements (or signature) that frequently co-occurs across a body of work, where each individual work may vary significantly. In our paper, we first reformulate the problem of "artistic copyright infringement" to a classification problem over image sets, instead of probing image-wise similarities. We then introduce ArtSavant, a practical (i.e., efficient and easy to understand) tool to (i) determine the unique style of an artist by comparing it to a reference dataset of works from 372 artists curated from WikiArt, and (ii) recognize if the identified style reappears in generated images. We leverage two complementary methods to perform artistic style classification over image sets, includingTagMatch, which is a novel inherently interpretable and attributable method, making it more suitable for broader use by non-technical stake holders (artists, lawyers, judges, etc). Leveraging ArtSavant, we then perform a large-scale empirical study to provide quantitative insight on the prevalence of artistic style copying across 3 popular text-to-image generative models. Namely, amongst a dataset of prolific artists (including many famous ones), only 20% of them appear to have their styles be at a risk of copying via simple prompting of today's popular text-to-image generative models.
title Rethinking Artistic Copyright Infringements in the Era of Text-to-Image Generative Models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2404.08030