Saved in:
Bibliographic Details
Main Authors: de Kergunic, Julien Simon, Abecidan, Rony, Bas, Patrick, Itier, Vincent
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.03318
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913492665106432
author de Kergunic, Julien Simon
Abecidan, Rony
Bas, Patrick
Itier, Vincent
author_facet de Kergunic, Julien Simon
Abecidan, Rony
Bas, Patrick
Itier, Vincent
contents Despite advancements in splicing detection, practitioners still struggle to fully leverage forensic tools from the literature due to a critical issue: deep learning-based detectors are extremely sensitive to their trained instances. Simple post-processing applied to evaluation images can easily decrease their performances, leading to a lack of confidence in splicing detectors for operational contexts. In this study, we show that a deep splicing detector behaves differently against unknown post-processes for different learned weights, even if it achieves similar performances on a test set from the same distribution as its training one. We connect this observation to the fact that different learnings create different latent spaces separating training samples differently. Our experiments reveal a strong correlation between the distributions of latent margins and the ability of the detector to generalize to post-processed images. We thus provide to the practitioner a way to build deep detectors that are more robust than others against post-processing operations, suggesting to train their architecture under different conditions and picking the one maximizing the latent space margin.
format Preprint
id arxiv_https___arxiv_org_abs_2409_03318
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Pick the Largest Margin for Robust Detection of Splicing
de Kergunic, Julien Simon
Abecidan, Rony
Bas, Patrick
Itier, Vincent
Signal Processing
Despite advancements in splicing detection, practitioners still struggle to fully leverage forensic tools from the literature due to a critical issue: deep learning-based detectors are extremely sensitive to their trained instances. Simple post-processing applied to evaluation images can easily decrease their performances, leading to a lack of confidence in splicing detectors for operational contexts. In this study, we show that a deep splicing detector behaves differently against unknown post-processes for different learned weights, even if it achieves similar performances on a test set from the same distribution as its training one. We connect this observation to the fact that different learnings create different latent spaces separating training samples differently. Our experiments reveal a strong correlation between the distributions of latent margins and the ability of the detector to generalize to post-processed images. We thus provide to the practitioner a way to build deep detectors that are more robust than others against post-processing operations, suggesting to train their architecture under different conditions and picking the one maximizing the latent space margin.
title Pick the Largest Margin for Robust Detection of Splicing
topic Signal Processing
url https://arxiv.org/abs/2409.03318