Saved in:
Bibliographic Details
Main Authors: Zhang, Yixuan, Li, Zhidong, Wang, Yang, Chen, Fang, Fan, Xuhui, Zhou, Feng
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.11072
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929632439173120
author Zhang, Yixuan
Li, Zhidong
Wang, Yang
Chen, Fang
Fan, Xuhui
Zhou, Feng
author_facet Zhang, Yixuan
Li, Zhidong
Wang, Yang
Chen, Fang
Fan, Xuhui
Zhou, Feng
contents Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias typically involve modifying models and intervening in the training process, but these lack flexibility for large-scale datasets. To address this limitation, we introduce a data selection method designed to efficiently and flexibly mitigate label bias, tailored to more practical needs. Our approach utilizes a zero-shot predictor as a proxy model that simulates training on a clean holdout set. This strategy, supported by peer predictions, ensures the fairness of the proxy model and eliminates the need for an additional holdout set, which is a common requirement in previous methods. Without altering the classifier's architecture, our modality-agnostic method effectively selects appropriate training data and has proven efficient and effective in handling label bias and improving fairness across diverse datasets in experimental evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2412_11072
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Navigating Towards Fairness with Data Selection
Zhang, Yixuan
Li, Zhidong
Wang, Yang
Chen, Fang
Fan, Xuhui
Zhou, Feng
Machine Learning
Computers and Society
Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias typically involve modifying models and intervening in the training process, but these lack flexibility for large-scale datasets. To address this limitation, we introduce a data selection method designed to efficiently and flexibly mitigate label bias, tailored to more practical needs. Our approach utilizes a zero-shot predictor as a proxy model that simulates training on a clean holdout set. This strategy, supported by peer predictions, ensures the fairness of the proxy model and eliminates the need for an additional holdout set, which is a common requirement in previous methods. Without altering the classifier's architecture, our modality-agnostic method effectively selects appropriate training data and has proven efficient and effective in handling label bias and improving fairness across diverse datasets in experimental evaluations.
title Navigating Towards Fairness with Data Selection
topic Machine Learning
Computers and Society
url https://arxiv.org/abs/2412.11072