Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929398076145664 |
|---|---|
| author | Jain, Saachi Hamidieh, Kimia Georgiev, Kristian Ilyas, Andrew Ghassemi, Marzyeh Madry, Aleksander |
| author_facet | Jain, Saachi Hamidieh, Kimia Georgiev, Kristian Ilyas, Andrew Ghassemi, Marzyeh Madry, Aleksander |
| contents | Machine learning models can fail on subgroups that are underrepresented during training. While techniques such as dataset balancing can improve performance on underperforming groups, they require access to training group annotations and can end up removing large portions of the dataset. In this paper, we introduce Data Debiasing with Datamodels (D3M), a debiasing approach which isolates and removes specific training examples that drive the model's failures on minority groups. Our approach enables us to efficiently train debiased classifiers while removing only a small number of examples, and does not require training group annotations or additional hyperparameter tuning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_16846 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selection Jain, Saachi Hamidieh, Kimia Georgiev, Kristian Ilyas, Andrew Ghassemi, Marzyeh Madry, Aleksander Machine Learning Computers and Society Machine learning models can fail on subgroups that are underrepresented during training. While techniques such as dataset balancing can improve performance on underperforming groups, they require access to training group annotations and can end up removing large portions of the dataset. In this paper, we introduce Data Debiasing with Datamodels (D3M), a debiasing approach which isolates and removes specific training examples that drive the model's failures on minority groups. Our approach enables us to efficiently train debiased classifiers while removing only a small number of examples, and does not require training group annotations or additional hyperparameter tuning. |
| title | Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selection |
| topic | Machine Learning Computers and Society |
| url | https://arxiv.org/abs/2406.16846 |