Leveraging Large Language Models and Topic Modeling for Toxicity Classification
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913587276021760 |
|---|---|
| author | Oskouie, Haniyeh Ehsani Chance, Christina Huang, Claire Capetz, Margaret Eyeson, Elizabeth Sarrafzadeh, Majid |
| author_facet | Oskouie, Haniyeh Ehsani Chance, Christina Huang, Claire Capetz, Margaret Eyeson, Elizabeth Sarrafzadeh, Majid |
| contents | Content moderation and toxicity classification represent critical tasks with significant social implications. However, studies have shown that major classification models exhibit tendencies to magnify or reduce biases and potentially overlook or disadvantage certain marginalized groups within their classification processes. Researchers suggest that the positionality of annotators influences the gold standard labels in which the models learned from propagate annotators' bias. To further investigate the impact of annotator positionality, we delve into fine-tuning BERTweet and HateBERT on the dataset while using topic-modeling strategies for content moderation. The results indicate that fine-tuning the models on specific topics results in a notable improvement in the F1 score of the models when compared to the predictions generated by other prominent classification models such as GPT-4, PerspectiveAPI, and RewireAPI. These findings further reveal that the state-of-the-art large language models exhibit significant limitations in accurately detecting and interpreting text toxicity contrasted with earlier methodologies. Code is available at https://github.com/aheldis/Toxicity-Classification.git. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_17876 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Leveraging Large Language Models and Topic Modeling for Toxicity Classification Oskouie, Haniyeh Ehsani Chance, Christina Huang, Claire Capetz, Margaret Eyeson, Elizabeth Sarrafzadeh, Majid Computation and Language Machine Learning Content moderation and toxicity classification represent critical tasks with significant social implications. However, studies have shown that major classification models exhibit tendencies to magnify or reduce biases and potentially overlook or disadvantage certain marginalized groups within their classification processes. Researchers suggest that the positionality of annotators influences the gold standard labels in which the models learned from propagate annotators' bias. To further investigate the impact of annotator positionality, we delve into fine-tuning BERTweet and HateBERT on the dataset while using topic-modeling strategies for content moderation. The results indicate that fine-tuning the models on specific topics results in a notable improvement in the F1 score of the models when compared to the predictions generated by other prominent classification models such as GPT-4, PerspectiveAPI, and RewireAPI. These findings further reveal that the state-of-the-art large language models exhibit significant limitations in accurately detecting and interpreting text toxicity contrasted with earlier methodologies. Code is available at https://github.com/aheldis/Toxicity-Classification.git. |
| title | Leveraging Large Language Models and Topic Modeling for Toxicity Classification |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2411.17876 |