When Fair Ranking Meets Uncertain Inference
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2021
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911426089582592 |
|---|---|
| author | Ghosh, Avijit Dutt, Ritam Wilson, Christo |
| author_facet | Ghosh, Avijit Dutt, Ritam Wilson, Christo |
| contents | Existing fair ranking systems, especially those designed to be demographically fair, assume that accurate demographic information about individuals is available to the ranking algorithm. In practice, however, this assumption may not hold -- in real-world contexts like ranking job applicants or credit seekers, social and legal barriers may prevent algorithm operators from collecting peoples' demographic information. In these cases, algorithm operators may attempt to infer peoples' demographics and then supply these inferences as inputs to the ranking algorithm.
In this study, we investigate how uncertainty and errors in demographic inference impact the fairness offered by fair ranking algorithms. Using simulations and three case studies with real datasets, we show how demographic inferences drawn from real systems can lead to unfair rankings. Our results suggest that developers should not use inferred demographic data as input to fair ranking algorithms, unless the inferences are extremely accurate. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2105_02091 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | When Fair Ranking Meets Uncertain Inference Ghosh, Avijit Dutt, Ritam Wilson, Christo Information Retrieval Computers and Society Machine Learning Existing fair ranking systems, especially those designed to be demographically fair, assume that accurate demographic information about individuals is available to the ranking algorithm. In practice, however, this assumption may not hold -- in real-world contexts like ranking job applicants or credit seekers, social and legal barriers may prevent algorithm operators from collecting peoples' demographic information. In these cases, algorithm operators may attempt to infer peoples' demographics and then supply these inferences as inputs to the ranking algorithm. In this study, we investigate how uncertainty and errors in demographic inference impact the fairness offered by fair ranking algorithms. Using simulations and three case studies with real datasets, we show how demographic inferences drawn from real systems can lead to unfair rankings. Our results suggest that developers should not use inferred demographic data as input to fair ranking algorithms, unless the inferences are extremely accurate. |
| title | When Fair Ranking Meets Uncertain Inference |
| topic | Information Retrieval Computers and Society Machine Learning |
| url | https://arxiv.org/abs/2105.02091 |