Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2310.01009 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915237341429760 |
|---|---|
| author | Fan, Jianqing Tong, Xin Wu, Yanhui Xia, Lucy Yao, Shunan |
| author_facet | Fan, Jianqing Tong, Xin Wu, Yanhui Xia, Lucy Yao, Shunan |
| contents | Organizations often rely on statistical algorithms to make socially and economically impactful decisions. We must address the fairness issues in these important automated decisions. On the other hand, economic efficiency remains instrumental in organizations' survival and success. Therefore, a proper dual focus on fairness and efficiency is essential in promoting fairness in real-world data science solutions. Among the first efforts towards this dual focus, we incorporate the equal opportunity (EO) constraint into the Neyman-Pearson (NP) classification paradigm. Under this new NP-EO framework, we (a) derive the oracle classifier, (b) propose finite-sample based classifiers that satisfy population-level fairness and efficiency constraints with high probability, and (c) demonstrate statistical and social effectiveness of our algorithms on simulated and real datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_01009 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Neyman-Pearson and equal opportunity: when efficiency meets fairness in classification Fan, Jianqing Tong, Xin Wu, Yanhui Xia, Lucy Yao, Shunan Methodology Organizations often rely on statistical algorithms to make socially and economically impactful decisions. We must address the fairness issues in these important automated decisions. On the other hand, economic efficiency remains instrumental in organizations' survival and success. Therefore, a proper dual focus on fairness and efficiency is essential in promoting fairness in real-world data science solutions. Among the first efforts towards this dual focus, we incorporate the equal opportunity (EO) constraint into the Neyman-Pearson (NP) classification paradigm. Under this new NP-EO framework, we (a) derive the oracle classifier, (b) propose finite-sample based classifiers that satisfy population-level fairness and efficiency constraints with high probability, and (c) demonstrate statistical and social effectiveness of our algorithms on simulated and real datasets. |
| title | Neyman-Pearson and equal opportunity: when efficiency meets fairness in classification |
| topic | Methodology |
| url | https://arxiv.org/abs/2310.01009 |