Measuring and Forecasting Conversation Incivility: the Role of Antisocial and Prosocial Behaviors

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yu, Xinchen, Arnold, Hayden, Su, Benjamin, Blanco, Eduardo
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917858767798272
author Yu, Xinchen
Arnold, Hayden
Su, Benjamin
Blanco, Eduardo
author_facet Yu, Xinchen
Arnold, Hayden
Su, Benjamin
Blanco, Eduardo
contents This paper focuses on the task of measuring and forecasting incivility in conversations following replies to hate speech. Identifying replies that steer conversations away from hatred and elicit civil follow-up conversations sheds light into effective strategies to engage with hate speech and proactively avoid further escalation. We propose new metrics that take into account various dimensions of antisocial and prosocial behaviors to measure the conversation incivility following replies to hate speech. Our best metric aligns with human perceptions better than prior work. Additionally, we present analyses on a) the language of antisocial and prosocial posts, b) the relationship between antisocial or prosocial posts and user interactions, and c) the language of replies to hate speech that elicit follow-up conversations with different incivility levels. We show that forecasting the incivility level of conversations following a reply to hate speech is a challenging task. We also present qualitative analyses to identify the most common errors made by our best model.
format Preprint
id arxiv_https___arxiv_org_abs_2412_02911
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Measuring and Forecasting Conversation Incivility: the Role of Antisocial and Prosocial Behaviors
Yu, Xinchen
Arnold, Hayden
Su, Benjamin
Blanco, Eduardo
Computers and Society
This paper focuses on the task of measuring and forecasting incivility in conversations following replies to hate speech. Identifying replies that steer conversations away from hatred and elicit civil follow-up conversations sheds light into effective strategies to engage with hate speech and proactively avoid further escalation. We propose new metrics that take into account various dimensions of antisocial and prosocial behaviors to measure the conversation incivility following replies to hate speech. Our best metric aligns with human perceptions better than prior work. Additionally, we present analyses on a) the language of antisocial and prosocial posts, b) the relationship between antisocial or prosocial posts and user interactions, and c) the language of replies to hate speech that elicit follow-up conversations with different incivility levels. We show that forecasting the incivility level of conversations following a reply to hate speech is a challenging task. We also present qualitative analyses to identify the most common errors made by our best model.
title Measuring and Forecasting Conversation Incivility: the Role of Antisocial and Prosocial Behaviors
topic Computers and Society
url https://arxiv.org/abs/2412.02911