Unmasking Gender Bias in Recommendation Systems and Enhancing Category-Aware Fairness

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kheya, Tahsin Alamgir, Bouadjenek, Mohamed Reda, Aryal, Sunil
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912244495810560
author Kheya, Tahsin Alamgir
Bouadjenek, Mohamed Reda
Aryal, Sunil
author_facet Kheya, Tahsin Alamgir
Bouadjenek, Mohamed Reda
Aryal, Sunil
contents Recommendation systems are now an integral part of our daily lives. We rely on them for tasks such as discovering new movies, finding friends on social media, and connecting job seekers with relevant opportunities. Given their vital role, we must ensure these recommendations are free from societal stereotypes. Therefore, evaluating and addressing such biases in recommendation systems is crucial. Previous work evaluating the fairness of recommended items fails to capture certain nuances as they mainly focus on comparing performance metrics for different sensitive groups. In this paper, we introduce a set of comprehensive metrics for quantifying gender bias in recommendations. Specifically, we show the importance of evaluating fairness on a more granular level, which can be achieved using our metrics to capture gender bias using categories of recommended items like genres for movies. Furthermore, we show that employing a category-aware fairness metric as a regularization term along with the main recommendation loss during training can help effectively minimize bias in the models' output. We experiment on three real-world datasets, using five baseline models alongside two popular fairness-aware models, to show the effectiveness of our metrics in evaluating gender bias. Our metrics help provide an enhanced insight into bias in recommended items compared to previous metrics. Additionally, our results demonstrate how incorporating our regularization term significantly improves the fairness in recommendations for different categories without substantial degradation in overall recommendation performance.
format Preprint
id arxiv_https___arxiv_org_abs_2502_17921
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Unmasking Gender Bias in Recommendation Systems and Enhancing Category-Aware Fairness
Kheya, Tahsin Alamgir
Bouadjenek, Mohamed Reda
Aryal, Sunil
Artificial Intelligence
Computers and Society
Human-Computer Interaction
Information Retrieval
Recommendation systems are now an integral part of our daily lives. We rely on them for tasks such as discovering new movies, finding friends on social media, and connecting job seekers with relevant opportunities. Given their vital role, we must ensure these recommendations are free from societal stereotypes. Therefore, evaluating and addressing such biases in recommendation systems is crucial. Previous work evaluating the fairness of recommended items fails to capture certain nuances as they mainly focus on comparing performance metrics for different sensitive groups. In this paper, we introduce a set of comprehensive metrics for quantifying gender bias in recommendations. Specifically, we show the importance of evaluating fairness on a more granular level, which can be achieved using our metrics to capture gender bias using categories of recommended items like genres for movies. Furthermore, we show that employing a category-aware fairness metric as a regularization term along with the main recommendation loss during training can help effectively minimize bias in the models' output. We experiment on three real-world datasets, using five baseline models alongside two popular fairness-aware models, to show the effectiveness of our metrics in evaluating gender bias. Our metrics help provide an enhanced insight into bias in recommended items compared to previous metrics. Additionally, our results demonstrate how incorporating our regularization term significantly improves the fairness in recommendations for different categories without substantial degradation in overall recommendation performance.
title Unmasking Gender Bias in Recommendation Systems and Enhancing Category-Aware Fairness
topic Artificial Intelligence
Computers and Society
Human-Computer Interaction
Information Retrieval
url https://arxiv.org/abs/2502.17921