COMMENTATOR: A Code-mixed Multilingual Text Annotation Framework
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929450818469888 |
|---|---|
| author | Sheth, Rajvee Nisar, Shubh Prajapati, Heenaben Beniwal, Himanshu Singh, Mayank |
| author_facet | Sheth, Rajvee Nisar, Shubh Prajapati, Heenaben Beniwal, Himanshu Singh, Mayank |
| contents | As the NLP community increasingly addresses challenges associated with multilingualism, robust annotation tools are essential to handle multilingual datasets efficiently. In this paper, we introduce a code-mixed multilingual text annotation framework, COMMENTATOR, specifically designed for annotating code-mixed text. The tool demonstrates its effectiveness in token-level and sentence-level language annotation tasks for Hinglish text. We perform robust qualitative human-based evaluations to showcase COMMENTATOR led to 5x faster annotations than the best baseline. Our code is publicly available at \url{https://github.com/lingo-iitgn/commentator}. The demonstration video is available at \url{https://bit.ly/commentator_video}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_03125 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | COMMENTATOR: A Code-mixed Multilingual Text Annotation Framework Sheth, Rajvee Nisar, Shubh Prajapati, Heenaben Beniwal, Himanshu Singh, Mayank Computation and Language Artificial Intelligence As the NLP community increasingly addresses challenges associated with multilingualism, robust annotation tools are essential to handle multilingual datasets efficiently. In this paper, we introduce a code-mixed multilingual text annotation framework, COMMENTATOR, specifically designed for annotating code-mixed text. The tool demonstrates its effectiveness in token-level and sentence-level language annotation tasks for Hinglish text. We perform robust qualitative human-based evaluations to showcase COMMENTATOR led to 5x faster annotations than the best baseline. Our code is publicly available at \url{https://github.com/lingo-iitgn/commentator}. The demonstration video is available at \url{https://bit.ly/commentator_video}. |
| title | COMMENTATOR: A Code-mixed Multilingual Text Annotation Framework |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2408.03125 |