Nationality, Race, and Ethnicity Biases in and Consequences of Detecting AI-Generated Self-Presentations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chu, Haoran, Men, Linjuan Rita, Liu, Sixiao, Yuan, Shupei, Sun, Yuan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910762289594368
author Chu, Haoran
Men, Linjuan Rita
Liu, Sixiao
Yuan, Shupei
Sun, Yuan
author_facet Chu, Haoran
Men, Linjuan Rita
Liu, Sixiao
Yuan, Shupei
Sun, Yuan
contents This study builds on person perception and human AI interaction (HAII) theories to investigate how content and source cues, specifically race, ethnicity, and nationality, affect judgments of AI-generated content in a high-stakes self-presentation context: college applications. Results of a pre-registered experiment with a nationally representative U.S. sample (N = 644) show that content heuristics, such as linguistic style, played a dominant role in AI detection. Source heuristics, such as nationality, also emerged as a significant factor, with international students more likely to be perceived as using AI, especially when their statements included AI-sounding features. Interestingly, Asian and Hispanic applicants were more likely to be judged as AI users when labeled as domestic students, suggesting interactions between racial stereotypes and AI detection. AI attribution led to lower perceptions of personal statement quality and authenticity, as well as negative evaluations of the applicant's competence, sociability, morality, and future success.
format Preprint
id arxiv_https___arxiv_org_abs_2412_18647
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Nationality, Race, and Ethnicity Biases in and Consequences of Detecting AI-Generated Self-Presentations
Chu, Haoran
Men, Linjuan Rita
Liu, Sixiao
Yuan, Shupei
Sun, Yuan
Artificial Intelligence
Human-Computer Interaction
This study builds on person perception and human AI interaction (HAII) theories to investigate how content and source cues, specifically race, ethnicity, and nationality, affect judgments of AI-generated content in a high-stakes self-presentation context: college applications. Results of a pre-registered experiment with a nationally representative U.S. sample (N = 644) show that content heuristics, such as linguistic style, played a dominant role in AI detection. Source heuristics, such as nationality, also emerged as a significant factor, with international students more likely to be perceived as using AI, especially when their statements included AI-sounding features. Interestingly, Asian and Hispanic applicants were more likely to be judged as AI users when labeled as domestic students, suggesting interactions between racial stereotypes and AI detection. AI attribution led to lower perceptions of personal statement quality and authenticity, as well as negative evaluations of the applicant's competence, sociability, morality, and future success.
title Nationality, Race, and Ethnicity Biases in and Consequences of Detecting AI-Generated Self-Presentations
topic Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2412.18647