Feature Selection Empowered BERT for Detection of Hate Speech with Vocabulary Augmentation
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911297705082880 |
|---|---|
| author | Desai, Pritish N. Kewalramani, Tanay Mandal, Srimanta |
| author_facet | Desai, Pritish N. Kewalramani, Tanay Mandal, Srimanta |
| contents | Abusive speech on social media poses a persistent and evolving challenge, driven by the continuous emergence of novel slang and obfuscated terms designed to circumvent detection systems. In this work, we present a data efficient strategy for fine tuning BERT on hate speech classification by significantly reducing training set size without compromising performance. Our approach employs a TF IDF-based sample selection mechanism to retain only the most informative 75 percent of examples, thereby minimizing training overhead. To address the limitations of BERT's native vocabulary in capturing evolving hate speech terminology, we augment the tokenizer with domain-specific slang and lexical variants commonly found in abusive contexts. Experimental results on a widely used hate speech dataset demonstrate that our method achieves competitive performance while improving computational efficiency, highlighting its potential for scalable and adaptive abusive content moderation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_02141 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Feature Selection Empowered BERT for Detection of Hate Speech with Vocabulary Augmentation Desai, Pritish N. Kewalramani, Tanay Mandal, Srimanta Computation and Language Artificial Intelligence Neural and Evolutionary Computing Abusive speech on social media poses a persistent and evolving challenge, driven by the continuous emergence of novel slang and obfuscated terms designed to circumvent detection systems. In this work, we present a data efficient strategy for fine tuning BERT on hate speech classification by significantly reducing training set size without compromising performance. Our approach employs a TF IDF-based sample selection mechanism to retain only the most informative 75 percent of examples, thereby minimizing training overhead. To address the limitations of BERT's native vocabulary in capturing evolving hate speech terminology, we augment the tokenizer with domain-specific slang and lexical variants commonly found in abusive contexts. Experimental results on a widely used hate speech dataset demonstrate that our method achieves competitive performance while improving computational efficiency, highlighting its potential for scalable and adaptive abusive content moderation. |
| title | Feature Selection Empowered BERT for Detection of Hate Speech with Vocabulary Augmentation |
| topic | Computation and Language Artificial Intelligence Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2512.02141 |