Learning with Selectively Labeled Data from Multiple Decision-makers
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909624197709824 |
|---|---|
| author | Chen, Jian Li, Zhehao Mao, Xiaojie |
| author_facet | Chen, Jian Li, Zhehao Mao, Xiaojie |
| contents | We study the problem of classification with selectively labeled data, whose distribution may differ from the full population due to historical decision-making. We exploit the fact that in many applications historical decisions were made by multiple decision-makers, each with different decision rules. We analyze this setup under a principled instrumental variable (IV) framework and rigorously study the identification of classification risk. We establish conditions for the exact identification of classification risk and derive tight partial identification bounds when exact identification fails. We further propose a unified cost-sensitive learning (UCL) approach to learn classifiers robust to selection bias in both identification settings. Finally, we theoretically and numerically validate the efficacy of our proposed method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2306_07566 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Learning with Selectively Labeled Data from Multiple Decision-makers Chen, Jian Li, Zhehao Mao, Xiaojie Machine Learning We study the problem of classification with selectively labeled data, whose distribution may differ from the full population due to historical decision-making. We exploit the fact that in many applications historical decisions were made by multiple decision-makers, each with different decision rules. We analyze this setup under a principled instrumental variable (IV) framework and rigorously study the identification of classification risk. We establish conditions for the exact identification of classification risk and derive tight partial identification bounds when exact identification fails. We further propose a unified cost-sensitive learning (UCL) approach to learn classifiers robust to selection bias in both identification settings. Finally, we theoretically and numerically validate the efficacy of our proposed method. |
| title | Learning with Selectively Labeled Data from Multiple Decision-makers |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2306.07566 |