(Un)fair devices: Moving beyond AI accuracy in personal sensing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yfantidou, Sofia, Constantinides, Marios, Spathis, Dimitris, Vakali, Athena, Quercia, Daniele, Kawsar, Fahim
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911479751507968
author Yfantidou, Sofia
Constantinides, Marios
Spathis, Dimitris
Vakali, Athena
Quercia, Daniele
Kawsar, Fahim
author_facet Yfantidou, Sofia
Constantinides, Marios
Spathis, Dimitris
Vakali, Athena
Quercia, Daniele
Kawsar, Fahim
contents Personal devices are omnipresent in our lives, seamlessly monitoring our activities, from smart rings tracking sleep patterns to smartwatches keeping an eye on missed heartbeats. The rich data streams from such devices fuel advanced Artificial Intelligence (AI) applications. Instead of solely relying on direct sensor measurements, these applications are increasingly leveraging Machine Learning (ML) model estimates to derive insights. But are these estimates biased or not? This literature review delivers compelling evidence about the impact of hidden biases that creep into ML models deployed on personal devices. We discuss critical bias issues drawn from prior work such as racial bias in pulse oximeters, weight bias in optical heart rate sensors, and sex bias in audio-based diagnostics. In response to these challenges, we advocate for a shift from prioritizing performance-oriented evaluations of personal devices to adopting assessments grounded in a human-centered approach. To facilitate this transition, we provide guidelines for the design, development, evaluation, and use of unbiased AI in personal devices, recognizing their potential impact on improving our health, lifestyle, and productivity -- more than any other technology.
format Preprint
id arxiv_https___arxiv_org_abs_2303_15585
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle (Un)fair devices: Moving beyond AI accuracy in personal sensing
Yfantidou, Sofia
Constantinides, Marios
Spathis, Dimitris
Vakali, Athena
Quercia, Daniele
Kawsar, Fahim
Computers and Society
Human-Computer Interaction
Machine Learning
Personal devices are omnipresent in our lives, seamlessly monitoring our activities, from smart rings tracking sleep patterns to smartwatches keeping an eye on missed heartbeats. The rich data streams from such devices fuel advanced Artificial Intelligence (AI) applications. Instead of solely relying on direct sensor measurements, these applications are increasingly leveraging Machine Learning (ML) model estimates to derive insights. But are these estimates biased or not? This literature review delivers compelling evidence about the impact of hidden biases that creep into ML models deployed on personal devices. We discuss critical bias issues drawn from prior work such as racial bias in pulse oximeters, weight bias in optical heart rate sensors, and sex bias in audio-based diagnostics. In response to these challenges, we advocate for a shift from prioritizing performance-oriented evaluations of personal devices to adopting assessments grounded in a human-centered approach. To facilitate this transition, we provide guidelines for the design, development, evaluation, and use of unbiased AI in personal devices, recognizing their potential impact on improving our health, lifestyle, and productivity -- more than any other technology.
title (Un)fair devices: Moving beyond AI accuracy in personal sensing
topic Computers and Society
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2303.15585