Understanding Fairness and Prediction Error through Subspace Decomposition and Influence Analysis
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914313304801280 |
|---|---|
| author | Shi, Enze Bhagwat, Pankaj Yang, Zhixian Kong, Linglong Jiang, Bei |
| author_facet | Shi, Enze Bhagwat, Pankaj Yang, Zhixian Kong, Linglong Jiang, Bei |
| contents | Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing underlying biases in data representations. In this work, we propose a principled framework that adjusts data representations to balance predictive utility and fairness. Using sufficient dimension reduction, we decompose the feature space into target-relevant, sensitive, and shared components, and control the fairness-utility trade-off by selectively removing sensitive information. We provide a theoretical analysis of how prediction error and fairness gaps evolve as shared subspaces are added, and employ influence functions to quantify their effects on the asymptotic behavior of parameter estimates. Experiments on both synthetic and real-world datasets validate our theoretical insights and show that the proposed method effectively improves fairness while preserving predictive performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_23935 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Understanding Fairness and Prediction Error through Subspace Decomposition and Influence Analysis Shi, Enze Bhagwat, Pankaj Yang, Zhixian Kong, Linglong Jiang, Bei Machine Learning Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing underlying biases in data representations. In this work, we propose a principled framework that adjusts data representations to balance predictive utility and fairness. Using sufficient dimension reduction, we decompose the feature space into target-relevant, sensitive, and shared components, and control the fairness-utility trade-off by selectively removing sensitive information. We provide a theoretical analysis of how prediction error and fairness gaps evolve as shared subspaces are added, and employ influence functions to quantify their effects on the asymptotic behavior of parameter estimates. Experiments on both synthetic and real-world datasets validate our theoretical insights and show that the proposed method effectively improves fairness while preserving predictive performance. |
| title | Understanding Fairness and Prediction Error through Subspace Decomposition and Influence Analysis |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2510.23935 |