Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignment

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rizvi, Syed Sameen Ahmad, Seth, Aryan, Narang, Pratik
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929558162243584
author Rizvi, Syed Sameen Ahmad
Seth, Aryan
Narang, Pratik
author_facet Rizvi, Syed Sameen Ahmad
Seth, Aryan
Narang, Pratik
contents Automatically recognizing emotional intent using facial expression has been a thoroughly investigated topic in the realm of computer vision. Facial Expression Recognition (FER), being a supervised learning task, relies heavily on substantially large data exemplifying various socio-cultural demographic attributes. Over the past decade, several real-world in-the-wild FER datasets that have been proposed were collected through crowd-sourcing or web-scraping. However, most of these practically used datasets employ a manual annotation methodology for labeling emotional intent, which inherently propagates individual demographic biases. Moreover, these datasets also lack an equitable representation of various socio-cultural demographic groups, thereby inducing a class imbalance. Bias analysis and its mitigation have been investigated across multiple domains and problem settings, however, in the FER domain, this is a relatively lesser explored area. This work leverages representation learning based on latent spaces to mitigate bias in facial expression recognition systems, thereby enhancing a deep learning model's fairness and overall accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2410_19444
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignment
Rizvi, Syed Sameen Ahmad
Seth, Aryan
Narang, Pratik
Computer Vision and Pattern Recognition
Machine Learning
Automatically recognizing emotional intent using facial expression has been a thoroughly investigated topic in the realm of computer vision. Facial Expression Recognition (FER), being a supervised learning task, relies heavily on substantially large data exemplifying various socio-cultural demographic attributes. Over the past decade, several real-world in-the-wild FER datasets that have been proposed were collected through crowd-sourcing or web-scraping. However, most of these practically used datasets employ a manual annotation methodology for labeling emotional intent, which inherently propagates individual demographic biases. Moreover, these datasets also lack an equitable representation of various socio-cultural demographic groups, thereby inducing a class imbalance. Bias analysis and its mitigation have been investigated across multiple domains and problem settings, however, in the FER domain, this is a relatively lesser explored area. This work leverages representation learning based on latent spaces to mitigate bias in facial expression recognition systems, thereby enhancing a deep learning model's fairness and overall accuracy.
title Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignment
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2410.19444