Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detection

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Coccomini, Davide Alessandro, Caldelli, Roberto, Falchi, Fabrizio, Gennaro, Claudio, Amato, Giuseppe
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929529411338240
author Coccomini, Davide Alessandro
Caldelli, Roberto
Falchi, Fabrizio
Gennaro, Claudio
Amato, Giuseppe
author_facet Coccomini, Davide Alessandro
Caldelli, Roberto
Falchi, Fabrizio
Gennaro, Claudio
Amato, Giuseppe
contents Image manipulation is rapidly evolving, allowing the creation of credible content that can be used to bend reality. Although the results of deepfake detectors are promising, deepfakes can be made even more complicated to detect through adversarial attacks. They aim to further manipulate the image to camouflage deepfakes' artifacts or to insert signals making the image appear pristine. In this paper, we further explore the potential of super-resolution attacks based on different super-resolution techniques and with different scales that can impact the performance of deepfake detectors with more or less intensity. We also evaluated the impact of the attack on more diverse datasets discovering that the super-resolution process is effective in hiding the artifacts introduced by deepfake generation models but fails in hiding the traces contained in fully synthetic images. Finally, we propose some changes to the detectors' training process to improve their robustness to this kind of attack.
format Preprint
id arxiv_https___arxiv_org_abs_2410_04205
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detection
Coccomini, Davide Alessandro
Caldelli, Roberto
Falchi, Fabrizio
Gennaro, Claudio
Amato, Giuseppe
Computer Vision and Pattern Recognition
Image and Video Processing
Image manipulation is rapidly evolving, allowing the creation of credible content that can be used to bend reality. Although the results of deepfake detectors are promising, deepfakes can be made even more complicated to detect through adversarial attacks. They aim to further manipulate the image to camouflage deepfakes' artifacts or to insert signals making the image appear pristine. In this paper, we further explore the potential of super-resolution attacks based on different super-resolution techniques and with different scales that can impact the performance of deepfake detectors with more or less intensity. We also evaluated the impact of the attack on more diverse datasets discovering that the super-resolution process is effective in hiding the artifacts introduced by deepfake generation models but fails in hiding the traces contained in fully synthetic images. Finally, we propose some changes to the detectors' training process to improve their robustness to this kind of attack.
title Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detection
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2410.04205