RoBERTurk: Adjusting RoBERTa for Turkish
Fuente:
arXiv
Guardado en:
| Autor principal: | |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917561059246080 |
|---|---|
| author | Tas, Nuri |
| author_facet | Tas, Nuri |
| contents | We pretrain RoBERTa on a Turkish corpora using BPE tokenizer. Our model outperforms BERTurk family models on the BOUN dataset for the POS task while resulting in underperformance on the IMST dataset for the same task and achieving competitive scores on the Turkish split of the XTREME dataset for the NER task - all while being pretrained on smaller data than its competitors. We release our pretrained model and tokenizer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_03515 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RoBERTurk: Adjusting RoBERTa for Turkish Tas, Nuri Computation and Language Machine Learning We pretrain RoBERTa on a Turkish corpora using BPE tokenizer. Our model outperforms BERTurk family models on the BOUN dataset for the POS task while resulting in underperformance on the IMST dataset for the same task and achieving competitive scores on the Turkish split of the XTREME dataset for the NER task - all while being pretrained on smaller data than its competitors. We release our pretrained model and tokenizer. |
| title | RoBERTurk: Adjusting RoBERTa for Turkish |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2401.03515 |