Towards Standardizing AI Bias Exploration

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Krasanakis, Emmanouil, Papadopoulos, Symeon
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911892242432000
author Krasanakis, Emmanouil
Papadopoulos, Symeon
author_facet Krasanakis, Emmanouil
Papadopoulos, Symeon
contents Creating fair AI systems is a complex problem that involves the assessment of context-dependent bias concerns. Existing research and programming libraries express specific concerns as measures of bias that they aim to constrain or mitigate. In practice, one should explore a wide variety of (sometimes incompatible) measures before deciding which ones warrant corrective action, but their narrow scope means that most new situations can only be examined after devising new measures. In this work, we present a mathematical framework that distils literature measures of bias into building blocks, hereby facilitating new combinations to cover a wide range of fairness concerns, such as classification or recommendation differences across multiple multi-value sensitive attributes (e.g., many genders and races, and their intersections). We show how this framework generalizes existing concepts and present frequently used blocks. We provide an open-source implementation of our framework as a Python library, called FairBench, that facilitates systematic and extensible exploration of potential bias concerns.
format Preprint
id arxiv_https___arxiv_org_abs_2405_19022
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Standardizing AI Bias Exploration
Krasanakis, Emmanouil
Papadopoulos, Symeon
Machine Learning
Computers and Society
Human-Computer Interaction
Creating fair AI systems is a complex problem that involves the assessment of context-dependent bias concerns. Existing research and programming libraries express specific concerns as measures of bias that they aim to constrain or mitigate. In practice, one should explore a wide variety of (sometimes incompatible) measures before deciding which ones warrant corrective action, but their narrow scope means that most new situations can only be examined after devising new measures. In this work, we present a mathematical framework that distils literature measures of bias into building blocks, hereby facilitating new combinations to cover a wide range of fairness concerns, such as classification or recommendation differences across multiple multi-value sensitive attributes (e.g., many genders and races, and their intersections). We show how this framework generalizes existing concepts and present frequently used blocks. We provide an open-source implementation of our framework as a Python library, called FairBench, that facilitates systematic and extensible exploration of potential bias concerns.
title Towards Standardizing AI Bias Exploration
topic Machine Learning
Computers and Society
Human-Computer Interaction
url https://arxiv.org/abs/2405.19022