Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Daouadi, Kheir Eddine, Boualleg, Yaakoub, Haouaouchi, Kheir Eddine
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914856124284928
author Daouadi, Kheir Eddine
Boualleg, Yaakoub
Haouaouchi, Kheir Eddine
author_facet Daouadi, Kheir Eddine
Boualleg, Yaakoub
Haouaouchi, Kheir Eddine
contents Today, hate speech classification from Arabic tweets has drawn the attention of several researchers. Many systems and techniques have been developed to resolve this classification task. Nevertheless, two of the major challenges faced in this context are the limited performance and the problem of imbalanced data. In this study, we propose a novel approach that leverages ensemble learning and semi-supervised learning based on previously manually labeled. We conducted experiments on a benchmark dataset by classifying Arabic tweets into 5 distinct classes: non-hate, general hate, racial, religious, or sexism. Experimental results show that: (1) ensemble learning based on pre-trained language models outperforms existing related works; (2) Our proposed data augmentation improves the accuracy results of hate speech detection from Arabic tweets and outperforms existing related works. Our main contribution is the achievement of encouraging results in Arabic hate speech detection.
format Preprint
id arxiv_https___arxiv_org_abs_2407_02448
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets
Daouadi, Kheir Eddine
Boualleg, Yaakoub
Haouaouchi, Kheir Eddine
Computation and Language
Artificial Intelligence
Today, hate speech classification from Arabic tweets has drawn the attention of several researchers. Many systems and techniques have been developed to resolve this classification task. Nevertheless, two of the major challenges faced in this context are the limited performance and the problem of imbalanced data. In this study, we propose a novel approach that leverages ensemble learning and semi-supervised learning based on previously manually labeled. We conducted experiments on a benchmark dataset by classifying Arabic tweets into 5 distinct classes: non-hate, general hate, racial, religious, or sexism. Experimental results show that: (1) ensemble learning based on pre-trained language models outperforms existing related works; (2) Our proposed data augmentation improves the accuracy results of hate speech detection from Arabic tweets and outperforms existing related works. Our main contribution is the achievement of encouraging results in Arabic hate speech detection.
title Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2407.02448