Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Weerts, Hilde, Pfisterer, Florian, Feurer, Matthias, Eggensperger, Katharina, Bergman, Edward, Awad, Noor, Vanschoren, Joaquin, Pechenizkiy, Mykola, Bischl, Bernd, Hutter, Frank
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911780391878656
author Weerts, Hilde
Pfisterer, Florian
Feurer, Matthias
Eggensperger, Katharina
Bergman, Edward
Awad, Noor
Vanschoren, Joaquin
Pechenizkiy, Mykola
Bischl, Bernd
Hutter, Frank
author_facet Weerts, Hilde
Pfisterer, Florian
Feurer, Matthias
Eggensperger, Katharina
Bergman, Edward
Awad, Noor
Vanschoren, Joaquin
Pechenizkiy, Mykola
Bischl, Bernd
Hutter, Frank
contents The field of automated machine learning (AutoML) introduces techniques that automate parts of the development of machine learning (ML) systems, accelerating the process and reducing barriers for novices. However, decisions derived from ML models can reproduce, amplify, or even introduce unfairness in our societies, causing harm to (groups of) individuals. In response, researchers have started to propose AutoML systems that jointly optimize fairness and predictive performance to mitigate fairness-related harm. However, fairness is a complex and inherently interdisciplinary subject, and solely posing it as an optimization problem can have adverse side effects. With this work, we aim to raise awareness among developers of AutoML systems about such limitations of fairness-aware AutoML, while also calling attention to the potential of AutoML as a tool for fairness research. We present a comprehensive overview of different ways in which fairness-related harm can arise and the ensuing implications for the design of fairness-aware AutoML. We conclude that while fairness cannot be automated, fairness-aware AutoML can play an important role in the toolbox of ML practitioners. We highlight several open technical challenges for future work in this direction. Additionally, we advocate for the creation of more user-centered assistive systems designed to tackle challenges encountered in fairness work
format Preprint
id arxiv_https___arxiv_org_abs_2303_08485
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML
Weerts, Hilde
Pfisterer, Florian
Feurer, Matthias
Eggensperger, Katharina
Bergman, Edward
Awad, Noor
Vanschoren, Joaquin
Pechenizkiy, Mykola
Bischl, Bernd
Hutter, Frank
Artificial Intelligence
Computers and Society
The field of automated machine learning (AutoML) introduces techniques that automate parts of the development of machine learning (ML) systems, accelerating the process and reducing barriers for novices. However, decisions derived from ML models can reproduce, amplify, or even introduce unfairness in our societies, causing harm to (groups of) individuals. In response, researchers have started to propose AutoML systems that jointly optimize fairness and predictive performance to mitigate fairness-related harm. However, fairness is a complex and inherently interdisciplinary subject, and solely posing it as an optimization problem can have adverse side effects. With this work, we aim to raise awareness among developers of AutoML systems about such limitations of fairness-aware AutoML, while also calling attention to the potential of AutoML as a tool for fairness research. We present a comprehensive overview of different ways in which fairness-related harm can arise and the ensuing implications for the design of fairness-aware AutoML. We conclude that while fairness cannot be automated, fairness-aware AutoML can play an important role in the toolbox of ML practitioners. We highlight several open technical challenges for future work in this direction. Additionally, we advocate for the creation of more user-centered assistive systems designed to tackle challenges encountered in fairness work
title Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML
topic Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2303.08485