Familiarity-Based Open-Set Recognition Under Adversarial Attacks

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Enevoldsen, Philip, Gundersen, Christian, Lang, Nico, Belongie, Serge, Igel, Christian
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913633210990592
author Enevoldsen, Philip
Gundersen, Christian
Lang, Nico
Belongie, Serge
Igel, Christian
author_facet Enevoldsen, Philip
Gundersen, Christian
Lang, Nico
Belongie, Serge
Igel, Christian
contents Open-set recognition (OSR), the identification of novel categories, can be a critical component when deploying classification models in real-world applications. Recent work has shown that familiarity-based scoring rules such as the Maximum Softmax Probability (MSP) or the Maximum Logit Score (MLS) are strong baselines when the closed-set accuracy is high. However, one of the potential weaknesses of familiarity-based OSR are adversarial attacks. Here, we study gradient-based adversarial attacks on familiarity scores for both types of attacks, False Familiarity and False Novelty attacks, and evaluate their effectiveness in informed and uninformed settings on TinyImageNet. Furthermore, we explore how novel and familiar samples react to adversarial attacks and formulate the adversarial reaction score as an alternative OSR scoring rule, which shows a high correlation with the MLS familiarity score.
format Preprint
id arxiv_https___arxiv_org_abs_2311_05006
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Familiarity-Based Open-Set Recognition Under Adversarial Attacks
Enevoldsen, Philip
Gundersen, Christian
Lang, Nico
Belongie, Serge
Igel, Christian
Computer Vision and Pattern Recognition
Machine Learning
Open-set recognition (OSR), the identification of novel categories, can be a critical component when deploying classification models in real-world applications. Recent work has shown that familiarity-based scoring rules such as the Maximum Softmax Probability (MSP) or the Maximum Logit Score (MLS) are strong baselines when the closed-set accuracy is high. However, one of the potential weaknesses of familiarity-based OSR are adversarial attacks. Here, we study gradient-based adversarial attacks on familiarity scores for both types of attacks, False Familiarity and False Novelty attacks, and evaluate their effectiveness in informed and uninformed settings on TinyImageNet. Furthermore, we explore how novel and familiar samples react to adversarial attacks and formulate the adversarial reaction score as an alternative OSR scoring rule, which shows a high correlation with the MLS familiarity score.
title Familiarity-Based Open-Set Recognition Under Adversarial Attacks
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2311.05006