Skin-Deep Bias: How Avatar Appearances Shape Perceptions of AI Hiring

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lau, Ka Hei Carrie, Stark, Philipp, Bozkir, Efe, Kasneci, Enkelejda
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913012871331840
author Lau, Ka Hei Carrie
Stark, Philipp
Bozkir, Efe
Kasneci, Enkelejda
author_facet Lau, Ka Hei Carrie
Stark, Philipp
Bozkir, Efe
Kasneci, Enkelejda
contents Artificial intelligence is increasingly used in hiring, raising concerns about how applicants perceive these systems. While prior work on algorithmic fairness has emphasized technical bias mitigation, little is known about how avatar identity cues influence applicants' justice attributions in an interview context. We conducted a crowdsourcing study with 215 participants who completed an interview with photorealistic AI avatars varied in phenotypic traits (race and sex), followed by a standardized rejection. Using self-reports, sentiment analysis, and eye tracking, we measured perceptions of trust, fairness, and bias. Results show that racial mismatch heightened perceptions of ethnic bias, while partial match (sharing only one identity) reduced fairness judgments compared to both full and no match. This work extends the Computers-Are-Social-Actors paradigm by demonstrating that avatar appearances shape justicerelated evaluations of AI. We contribute to HCI by revealing how identity cues influence fairness attributions and offer actionable insights for designing equitable AI interview systems.
format Preprint
id arxiv_https___arxiv_org_abs_2604_06187
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Skin-Deep Bias: How Avatar Appearances Shape Perceptions of AI Hiring
Lau, Ka Hei Carrie
Stark, Philipp
Bozkir, Efe
Kasneci, Enkelejda
Human-Computer Interaction
Artificial intelligence is increasingly used in hiring, raising concerns about how applicants perceive these systems. While prior work on algorithmic fairness has emphasized technical bias mitigation, little is known about how avatar identity cues influence applicants' justice attributions in an interview context. We conducted a crowdsourcing study with 215 participants who completed an interview with photorealistic AI avatars varied in phenotypic traits (race and sex), followed by a standardized rejection. Using self-reports, sentiment analysis, and eye tracking, we measured perceptions of trust, fairness, and bias. Results show that racial mismatch heightened perceptions of ethnic bias, while partial match (sharing only one identity) reduced fairness judgments compared to both full and no match. This work extends the Computers-Are-Social-Actors paradigm by demonstrating that avatar appearances shape justicerelated evaluations of AI. We contribute to HCI by revealing how identity cues influence fairness attributions and offer actionable insights for designing equitable AI interview systems.
title Skin-Deep Bias: How Avatar Appearances Shape Perceptions of AI Hiring
topic Human-Computer Interaction
url https://arxiv.org/abs/2604.06187