Thai Universal Dependency Treebank
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918204432973824 |
|---|---|
| author | Sriwirote, Panyut Leong, Wei Qi Polpanumas, Charin Thanyawong, Santhawat Tjhi, William Chandra Aroonmanakun, Wirote Rutherford, Attapol T. |
| author_facet | Sriwirote, Panyut Leong, Wei Qi Polpanumas, Charin Thanyawong, Santhawat Tjhi, William Chandra Aroonmanakun, Wirote Rutherford, Attapol T. |
| contents | Automatic dependency parsing of Thai sentences has been underexplored, as evidenced by the lack of large Thai dependency treebanks with complete dependency structures and the lack of a published systematic evaluation of state-of-the-art models, especially transformer-based parsers. In this work, we address these problems by introducing Thai Universal Dependency Treebank (TUD), a new largest Thai treebank consisting of 3,627 trees annotated in accordance with the Universal Dependencies (UD) framework. We then benchmark dependency parsing models that incorporate pretrained transformers as encoders and train them on Thai-PUD and our TUD. The evaluation results show that most of our models can outperform other models reported in previous papers and provide insight into the optimal choices of components to include in Thai dependency parsers. The new treebank and every model's full prediction generated in our experiment are made available on a GitHub repository for further study. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_07586 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Thai Universal Dependency Treebank Sriwirote, Panyut Leong, Wei Qi Polpanumas, Charin Thanyawong, Santhawat Tjhi, William Chandra Aroonmanakun, Wirote Rutherford, Attapol T. Computation and Language Automatic dependency parsing of Thai sentences has been underexplored, as evidenced by the lack of large Thai dependency treebanks with complete dependency structures and the lack of a published systematic evaluation of state-of-the-art models, especially transformer-based parsers. In this work, we address these problems by introducing Thai Universal Dependency Treebank (TUD), a new largest Thai treebank consisting of 3,627 trees annotated in accordance with the Universal Dependencies (UD) framework. We then benchmark dependency parsing models that incorporate pretrained transformers as encoders and train them on Thai-PUD and our TUD. The evaluation results show that most of our models can outperform other models reported in previous papers and provide insight into the optimal choices of components to include in Thai dependency parsers. The new treebank and every model's full prediction generated in our experiment are made available on a GitHub repository for further study. |
| title | Thai Universal Dependency Treebank |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.07586 |