Exploring the Plausibility of Hate and Counter Speech Detectors with Explainable AI
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929441361362944 |
|---|---|
| author | Böck, Adrian Jaques Slijepčević, Djordje Zeppelzauer, Matthias |
| author_facet | Böck, Adrian Jaques Slijepčević, Djordje Zeppelzauer, Matthias |
| contents | In this paper we investigate the explainability of transformer models and their plausibility for hate speech and counter speech detection. We compare representatives of four different explainability approaches, i.e., gradient-based, perturbation-based, attention-based, and prototype-based approaches, and analyze them quantitatively with an ablation study and qualitatively in a user study. Results show that perturbation-based explainability performs best, followed by gradient-based and attention-based explainability. Prototypebased experiments did not yield useful results. Overall, we observe that explainability strongly supports the users in better understanding the model predictions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_20274 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring the Plausibility of Hate and Counter Speech Detectors with Explainable AI Böck, Adrian Jaques Slijepčević, Djordje Zeppelzauer, Matthias Machine Learning Artificial Intelligence Computation and Language In this paper we investigate the explainability of transformer models and their plausibility for hate speech and counter speech detection. We compare representatives of four different explainability approaches, i.e., gradient-based, perturbation-based, attention-based, and prototype-based approaches, and analyze them quantitatively with an ablation study and qualitatively in a user study. Results show that perturbation-based explainability performs best, followed by gradient-based and attention-based explainability. Prototypebased experiments did not yield useful results. Overall, we observe that explainability strongly supports the users in better understanding the model predictions. |
| title | Exploring the Plausibility of Hate and Counter Speech Detectors with Explainable AI |
| topic | Machine Learning Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2407.20274 |