Comparing LLM prompting with Cross-lingual transfer performance on Indigenous and Low-resource Brazilian Languages
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917653855076352 |
|---|---|
| author | Adelani, David Ifeoluwa Doğruöz, A. Seza Coneglian, André Ojha, Atul Kr. |
| author_facet | Adelani, David Ifeoluwa Doğruöz, A. Seza Coneglian, André Ojha, Atul Kr. |
| contents | Large Language Models are transforming NLP for a variety of tasks. However, how LLMs perform NLP tasks for low-resource languages (LRLs) is less explored. In line with the goals of the AmericasNLP workshop, we focus on 12 LRLs from Brazil, 2 LRLs from Africa and 2 high-resource languages (HRLs) (e.g., English and Brazilian Portuguese). Our results indicate that the LLMs perform worse for the part of speech (POS) labeling of LRLs in comparison to HRLs. We explain the reasons behind this failure and provide an error analysis through examples observed in our data set. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_18286 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Comparing LLM prompting with Cross-lingual transfer performance on Indigenous and Low-resource Brazilian Languages Adelani, David Ifeoluwa Doğruöz, A. Seza Coneglian, André Ojha, Atul Kr. Computation and Language Large Language Models are transforming NLP for a variety of tasks. However, how LLMs perform NLP tasks for low-resource languages (LRLs) is less explored. In line with the goals of the AmericasNLP workshop, we focus on 12 LRLs from Brazil, 2 LRLs from Africa and 2 high-resource languages (HRLs) (e.g., English and Brazilian Portuguese). Our results indicate that the LLMs perform worse for the part of speech (POS) labeling of LRLs in comparison to HRLs. We explain the reasons behind this failure and provide an error analysis through examples observed in our data set. |
| title | Comparing LLM prompting with Cross-lingual transfer performance on Indigenous and Low-resource Brazilian Languages |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2404.18286 |