AnthroScore: A Computational Linguistic Measure of Anthropomorphism

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cheng, Myra, Gligoric, Kristina, Piccardi, Tiziano, Jurafsky, Dan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913222398836736
author Cheng, Myra
Gligoric, Kristina
Piccardi, Tiziano
Jurafsky, Dan
author_facet Cheng, Myra
Gligoric, Kristina
Piccardi, Tiziano
Jurafsky, Dan
contents Anthropomorphism, or the attribution of human-like characteristics to non-human entities, has shaped conversations about the impacts and possibilities of technology. We present AnthroScore, an automatic metric of implicit anthropomorphism in language. We use a masked language model to quantify how non-human entities are implicitly framed as human by the surrounding context. We show that AnthroScore corresponds with human judgments of anthropomorphism and dimensions of anthropomorphism described in social science literature. Motivated by concerns of misleading anthropomorphism in computer science discourse, we use AnthroScore to analyze 15 years of research papers and downstream news articles. In research papers, we find that anthropomorphism has steadily increased over time, and that papers related to language models have the most anthropomorphism. Within ACL papers, temporal increases in anthropomorphism are correlated with key neural advancements. Building upon concerns of scientific misinformation in mass media, we identify higher levels of anthropomorphism in news headlines compared to the research papers they cite. Since AnthroScore is lexicon-free, it can be directly applied to a wide range of text sources.
format Preprint
id arxiv_https___arxiv_org_abs_2402_02056
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AnthroScore: A Computational Linguistic Measure of Anthropomorphism
Cheng, Myra
Gligoric, Kristina
Piccardi, Tiziano
Jurafsky, Dan
Computation and Language
Artificial Intelligence
Computers and Society
Anthropomorphism, or the attribution of human-like characteristics to non-human entities, has shaped conversations about the impacts and possibilities of technology. We present AnthroScore, an automatic metric of implicit anthropomorphism in language. We use a masked language model to quantify how non-human entities are implicitly framed as human by the surrounding context. We show that AnthroScore corresponds with human judgments of anthropomorphism and dimensions of anthropomorphism described in social science literature. Motivated by concerns of misleading anthropomorphism in computer science discourse, we use AnthroScore to analyze 15 years of research papers and downstream news articles. In research papers, we find that anthropomorphism has steadily increased over time, and that papers related to language models have the most anthropomorphism. Within ACL papers, temporal increases in anthropomorphism are correlated with key neural advancements. Building upon concerns of scientific misinformation in mass media, we identify higher levels of anthropomorphism in news headlines compared to the research papers they cite. Since AnthroScore is lexicon-free, it can be directly applied to a wide range of text sources.
title AnthroScore: A Computational Linguistic Measure of Anthropomorphism
topic Computation and Language
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2402.02056