Is JPEG AI going to change image forensics?

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cannas, Edoardo Daniele, Mandelli, Sara, Popović, Nataša, Alkhateeb, Ayman, Gnutti, Alessandro, Bestagini, Paolo, Tubaro, Stefano
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915203366518784
author Cannas, Edoardo Daniele
Mandelli, Sara
Popović, Nataša
Alkhateeb, Ayman
Gnutti, Alessandro
Bestagini, Paolo
Tubaro, Stefano
author_facet Cannas, Edoardo Daniele
Mandelli, Sara
Popović, Nataša
Alkhateeb, Ayman
Gnutti, Alessandro
Bestagini, Paolo
Tubaro, Stefano
contents In this paper, we investigate the counter-forensic effects of the new JPEG AI standard based on neural image compression, focusing on two critical areas: deepfake image detection and image splicing localization. Neural image compression leverages advanced neural network algorithms to achieve higher compression rates while maintaining image quality. However, it introduces artifacts that closely resemble those generated by image synthesis techniques and image splicing pipelines, complicating the work of researchers when discriminating pristine from manipulated content. We comprehensively analyze JPEG AI's counter-forensic effects through extensive experiments on several state-of-the-art detectors and datasets. Our results demonstrate a reduction in the performance of leading forensic detectors when analyzing content processed through JPEG AI. By exposing the vulnerabilities of the available forensic tools, we aim to raise the urgent need for multimedia forensics researchers to include JPEG AI images in their experimental setups and develop robust forensic techniques to distinguish between neural compression artifacts and actual manipulations.
format Preprint
id arxiv_https___arxiv_org_abs_2412_03261
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Is JPEG AI going to change image forensics?
Cannas, Edoardo Daniele
Mandelli, Sara
Popović, Nataša
Alkhateeb, Ayman
Gnutti, Alessandro
Bestagini, Paolo
Tubaro, Stefano
Image and Video Processing
Computer Vision and Pattern Recognition
In this paper, we investigate the counter-forensic effects of the new JPEG AI standard based on neural image compression, focusing on two critical areas: deepfake image detection and image splicing localization. Neural image compression leverages advanced neural network algorithms to achieve higher compression rates while maintaining image quality. However, it introduces artifacts that closely resemble those generated by image synthesis techniques and image splicing pipelines, complicating the work of researchers when discriminating pristine from manipulated content. We comprehensively analyze JPEG AI's counter-forensic effects through extensive experiments on several state-of-the-art detectors and datasets. Our results demonstrate a reduction in the performance of leading forensic detectors when analyzing content processed through JPEG AI. By exposing the vulnerabilities of the available forensic tools, we aim to raise the urgent need for multimedia forensics researchers to include JPEG AI images in their experimental setups and develop robust forensic techniques to distinguish between neural compression artifacts and actual manipulations.
title Is JPEG AI going to change image forensics?
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.03261