Towards Generalized Offensive Language Identification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Dmonte, Alphaeus, Arya, Tejas, Ranasinghe, Tharindu, Zampieri, Marcos
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911969057964032
author Dmonte, Alphaeus
Arya, Tejas
Ranasinghe, Tharindu
Zampieri, Marcos
author_facet Dmonte, Alphaeus
Arya, Tejas
Ranasinghe, Tharindu
Zampieri, Marcos
contents The prevalence of offensive content on the internet, encompassing hate speech and cyberbullying, is a pervasive issue worldwide. Consequently, it has garnered significant attention from the machine learning (ML) and natural language processing (NLP) communities. As a result, numerous systems have been developed to automatically identify potentially harmful content and mitigate its impact. These systems can follow two approaches; (1) Use publicly available models and application endpoints, including prompting large language models (LLMs) (2) Annotate datasets and train ML models on them. However, both approaches lack an understanding of how generalizable they are. Furthermore, the applicability of these systems is often questioned in off-domain and practical environments. This paper empirically evaluates the generalizability of offensive language detection models and datasets across a novel generalized benchmark. We answer three research questions on generalizability. Our findings will be useful in creating robust real-world offensive language detection systems.
format Preprint
id arxiv_https___arxiv_org_abs_2407_18738
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Generalized Offensive Language Identification
Dmonte, Alphaeus
Arya, Tejas
Ranasinghe, Tharindu
Zampieri, Marcos
Computation and Language
Artificial Intelligence
The prevalence of offensive content on the internet, encompassing hate speech and cyberbullying, is a pervasive issue worldwide. Consequently, it has garnered significant attention from the machine learning (ML) and natural language processing (NLP) communities. As a result, numerous systems have been developed to automatically identify potentially harmful content and mitigate its impact. These systems can follow two approaches; (1) Use publicly available models and application endpoints, including prompting large language models (LLMs) (2) Annotate datasets and train ML models on them. However, both approaches lack an understanding of how generalizable they are. Furthermore, the applicability of these systems is often questioned in off-domain and practical environments. This paper empirically evaluates the generalizability of offensive language detection models and datasets across a novel generalized benchmark. We answer three research questions on generalizability. Our findings will be useful in creating robust real-world offensive language detection systems.
title Towards Generalized Offensive Language Identification
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2407.18738