Analysing and Organising Human Communications for AI Fairness-Related Decisions: Use Cases from the Public Sector

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Dankloff, Mirthe, Skoric, Vanja, Sileno, Giovanni, Ghebreab, Sennay, Van Ossenbruggen, Jacco, Beauxis-Aussalet, Emma
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910482621792256
author Dankloff, Mirthe
Skoric, Vanja
Sileno, Giovanni
Ghebreab, Sennay
Van Ossenbruggen, Jacco
Beauxis-Aussalet, Emma
author_facet Dankloff, Mirthe
Skoric, Vanja
Sileno, Giovanni
Ghebreab, Sennay
Van Ossenbruggen, Jacco
Beauxis-Aussalet, Emma
contents AI algorithms used in the public sector, e.g., for allocating social benefits or predicting fraud, often involve multiple public and private stakeholders at various phases of the algorithm's life-cycle. Communication issues between these diverse stakeholders can lead to misinterpretation and misuse of algorithms. We investigate the communication processes for AI fairness-related decisions by conducting interviews with practitioners working on algorithmic systems in the public sector. By applying qualitative coding analysis, we identify key elements of communication processes that underlie fairness-related human decisions. We analyze the division of roles, tasks, skills, and challenges perceived by stakeholders. We formalize the underlying communication issues within a conceptual framework that i. represents the communication patterns ii. outlines missing elements, such as actors who miss skills for their tasks. The framework is used for describing and analyzing key organizational issues for fairness-related decisions. Three general patterns emerge from the analysis: 1. Policy-makers, civil servants, and domain experts are less involved compared to developers throughout a system's life-cycle. This leads to developers taking on extra roles such as advisor, while they potentially miss the required skills and guidance from domain experts. 2. End-users and policy-makers often lack the technical skills to interpret a system's limitations, and rely on developer roles for making decisions concerning fairness issues. 3. Citizens are structurally absent throughout a system's life-cycle, which may lead to decisions that do not include relevant considerations from impacted stakeholders.
format Preprint
id arxiv_https___arxiv_org_abs_2404_00022
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Analysing and Organising Human Communications for AI Fairness-Related Decisions: Use Cases from the Public Sector
Dankloff, Mirthe
Skoric, Vanja
Sileno, Giovanni
Ghebreab, Sennay
Van Ossenbruggen, Jacco
Beauxis-Aussalet, Emma
Human-Computer Interaction
Artificial Intelligence
AI algorithms used in the public sector, e.g., for allocating social benefits or predicting fraud, often involve multiple public and private stakeholders at various phases of the algorithm's life-cycle. Communication issues between these diverse stakeholders can lead to misinterpretation and misuse of algorithms. We investigate the communication processes for AI fairness-related decisions by conducting interviews with practitioners working on algorithmic systems in the public sector. By applying qualitative coding analysis, we identify key elements of communication processes that underlie fairness-related human decisions. We analyze the division of roles, tasks, skills, and challenges perceived by stakeholders. We formalize the underlying communication issues within a conceptual framework that i. represents the communication patterns ii. outlines missing elements, such as actors who miss skills for their tasks. The framework is used for describing and analyzing key organizational issues for fairness-related decisions. Three general patterns emerge from the analysis: 1. Policy-makers, civil servants, and domain experts are less involved compared to developers throughout a system's life-cycle. This leads to developers taking on extra roles such as advisor, while they potentially miss the required skills and guidance from domain experts. 2. End-users and policy-makers often lack the technical skills to interpret a system's limitations, and rely on developer roles for making decisions concerning fairness issues. 3. Citizens are structurally absent throughout a system's life-cycle, which may lead to decisions that do not include relevant considerations from impacted stakeholders.
title Analysing and Organising Human Communications for AI Fairness-Related Decisions: Use Cases from the Public Sector
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2404.00022