FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tiwari, Shubham, Sethia, Yash, Kumar, Ritesh, Tanwar, Ashwani, Dwivedi, Rudresh
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909173434810368
author Tiwari, Shubham
Sethia, Yash
Kumar, Ritesh
Tanwar, Ashwani
Dwivedi, Rudresh
author_facet Tiwari, Shubham
Sethia, Yash
Kumar, Ritesh
Tanwar, Ashwani
Dwivedi, Rudresh
contents With the advent of social media, fun selfie filters have come into tremendous mainstream use affecting the functioning of facial biometric systems as well as image recognition systems. These filters vary from beautification filters and Augmented Reality (AR)-based filters to filters that modify facial landmarks. Hence, there is a need to assess the impact of such filters on the performance of existing face recognition systems. The limitation associated with existing solutions is that these solutions focus more on the beautification filters. However, the current AR-based filters and filters which distort facial key points are in vogue recently and make the faces highly unrecognizable even to the naked eye. Also, the filters considered are mostly obsolete with limited variations. To mitigate these limitations, we aim to perform a holistic impact analysis of the latest filters and propose an user recognition model with the filtered images. We have utilized a benchmark dataset for baseline images, and applied the latest filters over them to generate a beautified/filtered dataset. Next, we have introduced a model FaceFilterNet for beautified user recognition. In this framework, we also utilize our model to comment on various attributes of the person including age, gender, and ethnicity. In addition, we have also presented a filter-wise impact analysis on face recognition, age estimation, gender, and ethnicity prediction. The proposed method affirms the efficacy of our dataset with an accuracy of 87.25% and an optimal accuracy for facial attribute analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2404_08277
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework
Tiwari, Shubham
Sethia, Yash
Kumar, Ritesh
Tanwar, Ashwani
Dwivedi, Rudresh
Computer Vision and Pattern Recognition
With the advent of social media, fun selfie filters have come into tremendous mainstream use affecting the functioning of facial biometric systems as well as image recognition systems. These filters vary from beautification filters and Augmented Reality (AR)-based filters to filters that modify facial landmarks. Hence, there is a need to assess the impact of such filters on the performance of existing face recognition systems. The limitation associated with existing solutions is that these solutions focus more on the beautification filters. However, the current AR-based filters and filters which distort facial key points are in vogue recently and make the faces highly unrecognizable even to the naked eye. Also, the filters considered are mostly obsolete with limited variations. To mitigate these limitations, we aim to perform a holistic impact analysis of the latest filters and propose an user recognition model with the filtered images. We have utilized a benchmark dataset for baseline images, and applied the latest filters over them to generate a beautified/filtered dataset. Next, we have introduced a model FaceFilterNet for beautified user recognition. In this framework, we also utilize our model to comment on various attributes of the person including age, gender, and ethnicity. In addition, we have also presented a filter-wise impact analysis on face recognition, age estimation, gender, and ethnicity prediction. The proposed method affirms the efficacy of our dataset with an accuracy of 87.25% and an optimal accuracy for facial attribute analysis.
title FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2404.08277