Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.03292 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913378760392704 |
|---|---|
| author | Coraglia, Greta Genco, Francesco A. Piantadosi, Pellegrino Bagli, Enrico Giuffrida, Pietro Posillipo, Davide Primiero, Giuseppe |
| author_facet | Coraglia, Greta Genco, Francesco A. Piantadosi, Pellegrino Bagli, Enrico Giuffrida, Pietro Posillipo, Davide Primiero, Giuseppe |
| contents | We present a method for quantitative, in-depth analyses of fairness issues in AI systems with an application to credit scoring. To this aim we use BRIO, a tool for the evaluation of AI systems with respect to social unfairness and, more in general, ethically undesirable behaviours. It features a model-agnostic bias detection module, presented in \cite{DBLP:conf/beware/CoragliaDGGPPQ23}, to which a full-fledged unfairness risk evaluation module is added. As a case study, we focus on the context of credit scoring, analysing the UCI German Credit Dataset \cite{misc_statlog_(german_credit_data)_144}. We apply the BRIO fairness metrics to several, socially sensitive attributes featured in the German Credit Dataset, quantifying fairness across various demographic segments, with the aim of identifying potential sources of bias and discrimination in a credit scoring model. We conclude by combining our results with a revenue analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03292 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Evaluating AI fairness in credit scoring with the BRIO tool Coraglia, Greta Genco, Francesco A. Piantadosi, Pellegrino Bagli, Enrico Giuffrida, Pietro Posillipo, Davide Primiero, Giuseppe Artificial Intelligence We present a method for quantitative, in-depth analyses of fairness issues in AI systems with an application to credit scoring. To this aim we use BRIO, a tool for the evaluation of AI systems with respect to social unfairness and, more in general, ethically undesirable behaviours. It features a model-agnostic bias detection module, presented in \cite{DBLP:conf/beware/CoragliaDGGPPQ23}, to which a full-fledged unfairness risk evaluation module is added. As a case study, we focus on the context of credit scoring, analysing the UCI German Credit Dataset \cite{misc_statlog_(german_credit_data)_144}. We apply the BRIO fairness metrics to several, socially sensitive attributes featured in the German Credit Dataset, quantifying fairness across various demographic segments, with the aim of identifying potential sources of bias and discrimination in a credit scoring model. We conclude by combining our results with a revenue analysis. |
| title | Evaluating AI fairness in credit scoring with the BRIO tool |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2406.03292 |