CoLLAB: A Collaborative Approach for Multilingual Abuse Detection
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909217351270400 |
|---|---|
| author | Phukan, Orchid Chetia Chaurasia, Yashasvi Buduru, Arun Balaji Sharma, Rajesh |
| author_facet | Phukan, Orchid Chetia Chaurasia, Yashasvi Buduru, Arun Balaji Sharma, Rajesh |
| contents | In this study, we investigate representations from paralingual Pre-Trained model (PTM) for Audio Abuse Detection (AAD), which has not been explored for AAD. Our results demonstrate their superiority compared to other PTM representations on the ADIMA benchmark. Furthermore, combining PTM representations enhances AAD performance. Despite these improvements, challenges with cross-lingual generalizability still remain, and certain languages require training in the same language. This demands individual models for different languages, leading to scalability, maintenance, and resource allocation issues and hindering the practical deployment of AAD systems in linguistically diverse real-world environments. To address this, we introduce CoLLAB, a novel framework that doesn't require training and allows seamless merging of models trained in different languages through weight-averaging. This results in a unified model with competitive AAD performance across multiple languages. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03205 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CoLLAB: A Collaborative Approach for Multilingual Abuse Detection Phukan, Orchid Chetia Chaurasia, Yashasvi Buduru, Arun Balaji Sharma, Rajesh Audio and Speech Processing In this study, we investigate representations from paralingual Pre-Trained model (PTM) for Audio Abuse Detection (AAD), which has not been explored for AAD. Our results demonstrate their superiority compared to other PTM representations on the ADIMA benchmark. Furthermore, combining PTM representations enhances AAD performance. Despite these improvements, challenges with cross-lingual generalizability still remain, and certain languages require training in the same language. This demands individual models for different languages, leading to scalability, maintenance, and resource allocation issues and hindering the practical deployment of AAD systems in linguistically diverse real-world environments. To address this, we introduce CoLLAB, a novel framework that doesn't require training and allows seamless merging of models trained in different languages through weight-averaging. This results in a unified model with competitive AAD performance across multiple languages. |
| title | CoLLAB: A Collaborative Approach for Multilingual Abuse Detection |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2406.03205 |