Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Daouadi, Kheir Eddine, Boualleg, Yaakoub, Haouaouchi, Kheir Eddine
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914856124284928
author Daouadi, Kheir Eddine
Boualleg, Yaakoub
Haouaouchi, Kheir Eddine
author_facet Daouadi, Kheir Eddine
Boualleg, Yaakoub
Haouaouchi, Kheir Eddine
contents Today, hate speech classification from Arabic tweets has drawn the attention of several researchers. Many systems and techniques have been developed to resolve this classification task. Nevertheless, two of the major challenges faced in this context are the limited performance and the problem of imbalanced data. In this study, we propose a novel approach that leverages ensemble learning and semi-supervised learning based on previously manually labeled. We conducted experiments on a benchmark dataset by classifying Arabic tweets into 5 distinct classes: non-hate, general hate, racial, religious, or sexism. Experimental results show that: (1) ensemble learning based on pre-trained language models outperforms existing related works; (2) Our proposed data augmentation improves the accuracy results of hate speech detection from Arabic tweets and outperforms existing related works. Our main contribution is the achievement of encouraging results in Arabic hate speech detection.
format Preprint
id arxiv_https___arxiv_org_abs_2407_02448
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets
Daouadi, Kheir Eddine
Boualleg, Yaakoub
Haouaouchi, Kheir Eddine
Computation and Language
Artificial Intelligence
Today, hate speech classification from Arabic tweets has drawn the attention of several researchers. Many systems and techniques have been developed to resolve this classification task. Nevertheless, two of the major challenges faced in this context are the limited performance and the problem of imbalanced data. In this study, we propose a novel approach that leverages ensemble learning and semi-supervised learning based on previously manually labeled. We conducted experiments on a benchmark dataset by classifying Arabic tweets into 5 distinct classes: non-hate, general hate, racial, religious, or sexism. Experimental results show that: (1) ensemble learning based on pre-trained language models outperforms existing related works; (2) Our proposed data augmentation improves the accuracy results of hate speech detection from Arabic tweets and outperforms existing related works. Our main contribution is the achievement of encouraging results in Arabic hate speech detection.
title Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2407.02448