Leveraging Large Language Models and Topic Modeling for Toxicity Classification
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913587276021760 |
|---|---|
| author | Oskouie, Haniyeh Ehsani Chance, Christina Huang, Claire Capetz, Margaret Eyeson, Elizabeth Sarrafzadeh, Majid |
| author_facet | Oskouie, Haniyeh Ehsani Chance, Christina Huang, Claire Capetz, Margaret Eyeson, Elizabeth Sarrafzadeh, Majid |
| contents | Content moderation and toxicity classification represent critical tasks with significant social implications. However, studies have shown that major classification models exhibit tendencies to magnify or reduce biases and potentially overlook or disadvantage certain marginalized groups within their classification processes. Researchers suggest that the positionality of annotators influences the gold standard labels in which the models learned from propagate annotators' bias. To further investigate the impact of annotator positionality, we delve into fine-tuning BERTweet and HateBERT on the dataset while using topic-modeling strategies for content moderation. The results indicate that fine-tuning the models on specific topics results in a notable improvement in the F1 score of the models when compared to the predictions generated by other prominent classification models such as GPT-4, PerspectiveAPI, and RewireAPI. These findings further reveal that the state-of-the-art large language models exhibit significant limitations in accurately detecting and interpreting text toxicity contrasted with earlier methodologies. Code is available at https://github.com/aheldis/Toxicity-Classification.git. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_17876 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Leveraging Large Language Models and Topic Modeling for Toxicity Classification Oskouie, Haniyeh Ehsani Chance, Christina Huang, Claire Capetz, Margaret Eyeson, Elizabeth Sarrafzadeh, Majid Computation and Language Machine Learning Content moderation and toxicity classification represent critical tasks with significant social implications. However, studies have shown that major classification models exhibit tendencies to magnify or reduce biases and potentially overlook or disadvantage certain marginalized groups within their classification processes. Researchers suggest that the positionality of annotators influences the gold standard labels in which the models learned from propagate annotators' bias. To further investigate the impact of annotator positionality, we delve into fine-tuning BERTweet and HateBERT on the dataset while using topic-modeling strategies for content moderation. The results indicate that fine-tuning the models on specific topics results in a notable improvement in the F1 score of the models when compared to the predictions generated by other prominent classification models such as GPT-4, PerspectiveAPI, and RewireAPI. These findings further reveal that the state-of-the-art large language models exhibit significant limitations in accurately detecting and interpreting text toxicity contrasted with earlier methodologies. Code is available at https://github.com/aheldis/Toxicity-Classification.git. |
| title | Leveraging Large Language Models and Topic Modeling for Toxicity Classification |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2411.17876 |