Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.00802 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910926122254336 |
|---|---|
| author | Papanikou, Vasiliki Karidi, Danae Pla Pitoura, Evaggelia Panagiotou, Emmanouil Ntoutsi, Eirini |
| author_facet | Papanikou, Vasiliki Karidi, Danae Pla Pitoura, Evaggelia Panagiotou, Emmanouil Ntoutsi, Eirini |
| contents | As Artificial Intelligence (AI) is increasingly used in areas that significantly impact human lives, concerns about fairness and transparency have grown, especially regarding their impact on protected groups. Recently, the intersection of explainability and fairness has emerged as an important area to promote responsible AI systems. This paper explores how explainability methods can be leveraged to detect and interpret unfairness. We propose a pipeline that integrates local post-hoc explanation methods to derive fairness-related insights. During the pipeline design, we identify and address critical questions arising from the use of explanations as bias detectors such as the relationship between distributive and procedural fairness, the effect of removing the protected attribute, the consistency and quality of results across different explanation methods, the impact of various aggregation strategies of local explanations on group fairness evaluations, and the overall trustworthiness of explanations as bias detectors. Our results show the potential of explanation methods used for fairness while highlighting the need to carefully consider the aforementioned critical aspects. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_00802 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Exploration Papanikou, Vasiliki Karidi, Danae Pla Pitoura, Evaggelia Panagiotou, Emmanouil Ntoutsi, Eirini Artificial Intelligence Machine Learning As Artificial Intelligence (AI) is increasingly used in areas that significantly impact human lives, concerns about fairness and transparency have grown, especially regarding their impact on protected groups. Recently, the intersection of explainability and fairness has emerged as an important area to promote responsible AI systems. This paper explores how explainability methods can be leveraged to detect and interpret unfairness. We propose a pipeline that integrates local post-hoc explanation methods to derive fairness-related insights. During the pipeline design, we identify and address critical questions arising from the use of explanations as bias detectors such as the relationship between distributive and procedural fairness, the effect of removing the protected attribute, the consistency and quality of results across different explanation methods, the impact of various aggregation strategies of local explanations on group fairness evaluations, and the overall trustworthiness of explanations as bias detectors. Our results show the potential of explanation methods used for fairness while highlighting the need to carefully consider the aforementioned critical aspects. |
| title | Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Exploration |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2505.00802 |