HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Text

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kumar, Ritesh, Bhalla, Ojaswee, Vanthi, Madhu, Wani, Shehlat Maknoon, Singh, Siddharth
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929281031995392
author Kumar, Ritesh
Bhalla, Ojaswee
Vanthi, Madhu
Wani, Shehlat Maknoon
Singh, Siddharth
author_facet Kumar, Ritesh
Bhalla, Ojaswee
Vanthi, Madhu
Wani, Shehlat Maknoon
Singh, Siddharth
contents In this paper, we discuss the development of an annotation schema to build datasets for evaluating the offline harm potential of social media texts. We define "harm potential" as the potential for an online public post to cause real-world physical harm (i.e., violence). Understanding that real-world violence is often spurred by a web of triggers, often combining several online tactics and pre-existing intersectional fissures in the social milieu, to result in targeted physical violence, we do not focus on any single divisive aspect (i.e., caste, gender, religion, or other identities of the victim and perpetrators) nor do we focus on just hate speech or mis/dis-information. Rather, our understanding of the intersectional causes of such triggers focuses our attempt at measuring the harm potential of online content, irrespective of whether it is hateful or not. In this paper, we discuss the development of a framework/annotation schema that allows annotating the data with different aspects of the text including its socio-political grounding and intent of the speaker (as expressed through mood and modality) that together contribute to it being a trigger for offline harm. We also give a comparative analysis and mapping of our framework with some of the existing frameworks.
format Preprint
id arxiv_https___arxiv_org_abs_2403_11108
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Text
Kumar, Ritesh
Bhalla, Ojaswee
Vanthi, Madhu
Wani, Shehlat Maknoon
Singh, Siddharth
Computation and Language
In this paper, we discuss the development of an annotation schema to build datasets for evaluating the offline harm potential of social media texts. We define "harm potential" as the potential for an online public post to cause real-world physical harm (i.e., violence). Understanding that real-world violence is often spurred by a web of triggers, often combining several online tactics and pre-existing intersectional fissures in the social milieu, to result in targeted physical violence, we do not focus on any single divisive aspect (i.e., caste, gender, religion, or other identities of the victim and perpetrators) nor do we focus on just hate speech or mis/dis-information. Rather, our understanding of the intersectional causes of such triggers focuses our attempt at measuring the harm potential of online content, irrespective of whether it is hateful or not. In this paper, we discuss the development of a framework/annotation schema that allows annotating the data with different aspects of the text including its socio-political grounding and intent of the speaker (as expressed through mood and modality) that together contribute to it being a trigger for offline harm. We also give a comparative analysis and mapping of our framework with some of the existing frameworks.
title HarmPot: An Annotation Framework for Evaluating Offline Harm Potential of Social Media Text
topic Computation and Language
url https://arxiv.org/abs/2403.11108