Saved in:
Bibliographic Details
Main Authors: Colbois, Laurent, Marcel, Sébastien
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.16802
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910695012958208
author Colbois, Laurent
Marcel, Sébastien
author_facet Colbois, Laurent
Marcel, Sébastien
contents Morphing attacks have diversified significantly over the past years, with new methods based on generative adversarial networks (GANs) and diffusion models posing substantial threats to face recognition systems. Recent research has demonstrated the effectiveness of features extracted from large vision models pretrained on bonafide data only (attack-agnostic features) for detecting deep generative images. Building on this, we investigate the potential of these image representations for morphing attack detection (MAD). We develop supervised detectors by training a simple binary linear SVM on the extracted features and one-class detectors by modeling the distribution of bonafide features with a Gaussian Mixture Model (GMM). Our method is evaluated across a comprehensive set of attacks and various scenarios, including generalization to unseen attacks, different source datasets, and print-scan data. Our results indicate that attack-agnostic features can effectively detect morphing attacks, outperforming traditional supervised and one-class detectors from the literature in most scenarios. Additionally, we provide insights into the strengths and limitations of each considered representation and discuss potential future research directions to further enhance the robustness and generalizability of our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16802
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evaluating the Effectiveness of Attack-Agnostic Features for Morphing Attack Detection
Colbois, Laurent
Marcel, Sébastien
Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Morphing attacks have diversified significantly over the past years, with new methods based on generative adversarial networks (GANs) and diffusion models posing substantial threats to face recognition systems. Recent research has demonstrated the effectiveness of features extracted from large vision models pretrained on bonafide data only (attack-agnostic features) for detecting deep generative images. Building on this, we investigate the potential of these image representations for morphing attack detection (MAD). We develop supervised detectors by training a simple binary linear SVM on the extracted features and one-class detectors by modeling the distribution of bonafide features with a Gaussian Mixture Model (GMM). Our method is evaluated across a comprehensive set of attacks and various scenarios, including generalization to unseen attacks, different source datasets, and print-scan data. Our results indicate that attack-agnostic features can effectively detect morphing attacks, outperforming traditional supervised and one-class detectors from the literature in most scenarios. Additionally, we provide insights into the strengths and limitations of each considered representation and discuss potential future research directions to further enhance the robustness and generalizability of our approach.
title Evaluating the Effectiveness of Attack-Agnostic Features for Morphing Attack Detection
topic Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
url https://arxiv.org/abs/2410.16802