Closing the Gap in the Trade-off between Fair Representations and Accuracy

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rout, Biswajit, Sai, Ananya B., Rajkumar, Arun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917639640580096
author Rout, Biswajit
Sai, Ananya B.
Rajkumar, Arun
author_facet Rout, Biswajit
Sai, Ananya B.
Rajkumar, Arun
contents The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such aspect that is deservedly gaining more attention. In this work, we analyse the natural language representations of documents and sentences (i.e., encodings) for any embedding-level bias that could potentially also affect the fairness of the downstream tasks that rely on them. We identify bias in these encodings either towards or against different sub-groups based on the difference in their reconstruction errors along various subsets of principal components. We explore and recommend ways to mitigate such bias in the encodings while also maintaining a decent accuracy in classification models that use them.
format Preprint
id arxiv_https___arxiv_org_abs_2404_09664
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Closing the Gap in the Trade-off between Fair Representations and Accuracy
Rout, Biswajit
Sai, Ananya B.
Rajkumar, Arun
Machine Learning
Computers and Society
The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such aspect that is deservedly gaining more attention. In this work, we analyse the natural language representations of documents and sentences (i.e., encodings) for any embedding-level bias that could potentially also affect the fairness of the downstream tasks that rely on them. We identify bias in these encodings either towards or against different sub-groups based on the difference in their reconstruction errors along various subsets of principal components. We explore and recommend ways to mitigate such bias in the encodings while also maintaining a decent accuracy in classification models that use them.
title Closing the Gap in the Trade-off between Fair Representations and Accuracy
topic Machine Learning
Computers and Society
url https://arxiv.org/abs/2404.09664