TextureCrop: Enhancing Synthetic Image Detection through Texture-based Cropping

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Konstantinidou, Despina, Koutlis, Christos, Papadopoulos, Symeon
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912190113513472
author Konstantinidou, Despina
Koutlis, Christos
Papadopoulos, Symeon
author_facet Konstantinidou, Despina
Koutlis, Christos
Papadopoulos, Symeon
contents Generative AI technologies produce increasingly realistic imagery, which, despite its potential for creative applications, can also be misused to produce misleading and harmful content. This renders Synthetic Image Detection (SID) methods essential for identifying AI-generated content online. State-of-the-art SID methods typically resize or center-crop input images due to architectural or computational constraints, which hampers the detection of artifacts that appear in high-resolution images. To address this limitation, we propose TextureCrop, an image pre-processing component that can be plugged in any pre-trained SID model to improve its performance. By focusing on high-frequency image parts where generative artifacts are prevalent, TextureCrop enhances SID performance with manageable memory requirements. Experimental results demonstrate a consistent improvement in AUC across various detectors by 6.1% compared to center cropping and by 15% compared to resizing, across high-resolution images from the Forensynths, Synthbuster and TWIGMA datasets. Code available at https : //github.com/mever-team/texture-crop.
format Preprint
id arxiv_https___arxiv_org_abs_2407_15500
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle TextureCrop: Enhancing Synthetic Image Detection through Texture-based Cropping
Konstantinidou, Despina
Koutlis, Christos
Papadopoulos, Symeon
Computer Vision and Pattern Recognition
Generative AI technologies produce increasingly realistic imagery, which, despite its potential for creative applications, can also be misused to produce misleading and harmful content. This renders Synthetic Image Detection (SID) methods essential for identifying AI-generated content online. State-of-the-art SID methods typically resize or center-crop input images due to architectural or computational constraints, which hampers the detection of artifacts that appear in high-resolution images. To address this limitation, we propose TextureCrop, an image pre-processing component that can be plugged in any pre-trained SID model to improve its performance. By focusing on high-frequency image parts where generative artifacts are prevalent, TextureCrop enhances SID performance with manageable memory requirements. Experimental results demonstrate a consistent improvement in AUC across various detectors by 6.1% compared to center cropping and by 15% compared to resizing, across high-resolution images from the Forensynths, Synthbuster and TWIGMA datasets. Code available at https : //github.com/mever-team/texture-crop.
title TextureCrop: Enhancing Synthetic Image Detection through Texture-based Cropping
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.15500