Synthetic images aid the recognition of human-made art forgeries

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ostmeyer, Johann, Schaerf, Ludovica, Buividovich, Pavel, Charles, Tessa, Postma, Eric, Popovici, Carina
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917591139745792
author Ostmeyer, Johann
Schaerf, Ludovica
Buividovich, Pavel
Charles, Tessa
Postma, Eric
Popovici, Carina
author_facet Ostmeyer, Johann
Schaerf, Ludovica
Buividovich, Pavel
Charles, Tessa
Postma, Eric
Popovici, Carina
contents Previous research has shown that Artificial Intelligence is capable of distinguishing between authentic paintings by a given artist and human-made forgeries with remarkable accuracy, provided sufficient training. However, with the limited amount of existing known forgeries, augmentation methods for forgery detection are highly desirable. In this work, we examine the potential of incorporating synthetic artworks into training datasets to enhance the performance of forgery detection. Our investigation focuses on paintings by Vincent van Gogh, for which we release the first dataset specialized for forgery detection. To reinforce our results, we conduct the same analyses on the artists Amedeo Modigliani and Raphael. We train a classifier to distinguish original artworks from forgeries. For this, we use human-made forgeries and imitations in the style of well-known artists and augment our training sets with images in a similar style generated by Stable Diffusion and StyleGAN. We find that the additional synthetic forgeries consistently improve the detection of human-made forgeries. In addition, we find that, in line with previous research, the inclusion of synthetic forgeries in the training also enables the detection of AI-generated forgeries, especially if created using a similar generator.
format Preprint
id arxiv_https___arxiv_org_abs_2312_14998
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Synthetic images aid the recognition of human-made art forgeries
Ostmeyer, Johann
Schaerf, Ludovica
Buividovich, Pavel
Charles, Tessa
Postma, Eric
Popovici, Carina
Computer Vision and Pattern Recognition
Artificial Intelligence
Previous research has shown that Artificial Intelligence is capable of distinguishing between authentic paintings by a given artist and human-made forgeries with remarkable accuracy, provided sufficient training. However, with the limited amount of existing known forgeries, augmentation methods for forgery detection are highly desirable. In this work, we examine the potential of incorporating synthetic artworks into training datasets to enhance the performance of forgery detection. Our investigation focuses on paintings by Vincent van Gogh, for which we release the first dataset specialized for forgery detection. To reinforce our results, we conduct the same analyses on the artists Amedeo Modigliani and Raphael. We train a classifier to distinguish original artworks from forgeries. For this, we use human-made forgeries and imitations in the style of well-known artists and augment our training sets with images in a similar style generated by Stable Diffusion and StyleGAN. We find that the additional synthetic forgeries consistently improve the detection of human-made forgeries. In addition, we find that, in line with previous research, the inclusion of synthetic forgeries in the training also enables the detection of AI-generated forgeries, especially if created using a similar generator.
title Synthetic images aid the recognition of human-made art forgeries
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2312.14998