Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.13552 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915715079995392 |
|---|---|
| author | Kaing, Hour Dabre, Raj Song, Haiyue Tran, Van-Hien Tanaka, Hideki Utiyama, Masao |
| author_facet | Kaing, Hour Dabre, Raj Song, Haiyue Tran, Van-Hien Tanaka, Hideki Utiyama, Masao |
| contents | This work introduces {\it PrahokBART}, a compact pre-trained sequence-to-sequence model trained from scratch for Khmer using carefully curated Khmer and English corpora. We focus on improving the pre-training corpus quality and addressing the linguistic issues of Khmer, which are ignored in existing multilingual models, by incorporating linguistic components such as word segmentation and normalization. We evaluate PrahokBART on three generative tasks: machine translation, text summarization, and headline generation, where our results demonstrate that it outperforms mBART50, a strong multilingual pre-trained model. Additionally, our analysis provides insights into the impact of each linguistic module and evaluates how effectively our model handles space during text generation, which is crucial for the naturalness of texts in Khmer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_13552 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PrahokBART: A Pre-trained Sequence-to-Sequence Model for Khmer Natural Language Generation Kaing, Hour Dabre, Raj Song, Haiyue Tran, Van-Hien Tanaka, Hideki Utiyama, Masao Computation and Language This work introduces {\it PrahokBART}, a compact pre-trained sequence-to-sequence model trained from scratch for Khmer using carefully curated Khmer and English corpora. We focus on improving the pre-training corpus quality and addressing the linguistic issues of Khmer, which are ignored in existing multilingual models, by incorporating linguistic components such as word segmentation and normalization. We evaluate PrahokBART on three generative tasks: machine translation, text summarization, and headline generation, where our results demonstrate that it outperforms mBART50, a strong multilingual pre-trained model. Additionally, our analysis provides insights into the impact of each linguistic module and evaluates how effectively our model handles space during text generation, which is crucial for the naturalness of texts in Khmer. |
| title | PrahokBART: A Pre-trained Sequence-to-Sequence Model for Khmer Natural Language Generation |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2512.13552 |