Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.11072 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929632439173120 |
|---|---|
| author | Zhang, Yixuan Li, Zhidong Wang, Yang Chen, Fang Fan, Xuhui Zhou, Feng |
| author_facet | Zhang, Yixuan Li, Zhidong Wang, Yang Chen, Fang Fan, Xuhui Zhou, Feng |
| contents | Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias typically involve modifying models and intervening in the training process, but these lack flexibility for large-scale datasets. To address this limitation, we introduce a data selection method designed to efficiently and flexibly mitigate label bias, tailored to more practical needs. Our approach utilizes a zero-shot predictor as a proxy model that simulates training on a clean holdout set. This strategy, supported by peer predictions, ensures the fairness of the proxy model and eliminates the need for an additional holdout set, which is a common requirement in previous methods. Without altering the classifier's architecture, our modality-agnostic method effectively selects appropriate training data and has proven efficient and effective in handling label bias and improving fairness across diverse datasets in experimental evaluations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_11072 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Navigating Towards Fairness with Data Selection Zhang, Yixuan Li, Zhidong Wang, Yang Chen, Fang Fan, Xuhui Zhou, Feng Machine Learning Computers and Society Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias typically involve modifying models and intervening in the training process, but these lack flexibility for large-scale datasets. To address this limitation, we introduce a data selection method designed to efficiently and flexibly mitigate label bias, tailored to more practical needs. Our approach utilizes a zero-shot predictor as a proxy model that simulates training on a clean holdout set. This strategy, supported by peer predictions, ensures the fairness of the proxy model and eliminates the need for an additional holdout set, which is a common requirement in previous methods. Without altering the classifier's architecture, our modality-agnostic method effectively selects appropriate training data and has proven efficient and effective in handling label bias and improving fairness across diverse datasets in experimental evaluations. |
| title | Navigating Towards Fairness with Data Selection |
| topic | Machine Learning Computers and Society |
| url | https://arxiv.org/abs/2412.11072 |