SiTSE: Sinhala Text Simplification Dataset and Evaluation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929610563780608 |
|---|---|
| author | Ranathunga, Surangika Sirithunga, Rumesh Rathnayake, Himashi De Silva, Lahiru Aluthwala, Thamindu Peramuna, Saman Shekhar, Ravi |
| author_facet | Ranathunga, Surangika Sirithunga, Rumesh Rathnayake, Himashi De Silva, Lahiru Aluthwala, Thamindu Peramuna, Saman Shekhar, Ravi |
| contents | Text Simplification is a task that has been minimally explored for low-resource languages. Consequently, there are only a few manually curated datasets. In this paper, we present a human curated sentence-level text simplification dataset for the Sinhala language. Our evaluation dataset contains 1,000 complex sentences and corresponding 3,000 simplified sentences produced by three different human annotators. We model the text simplification task as a zero-shot and zero resource sequence-to-sequence (seq-seq) task on the multilingual language models mT5 and mBART. We exploit auxiliary data from related seq-seq tasks and explore the possibility of using intermediate task transfer learning (ITTL). Our analysis shows that ITTL outperforms the previously proposed zero-resource methods for text simplification. Our findings also highlight the challenges in evaluating text simplification systems, and support the calls for improved metrics for measuring the quality of automated text simplification systems that would suit low-resource languages as well. Our code and data are publicly available: https://github.com/brainsharks-fyp17/Sinhala-Text-Simplification-Dataset-and-Evaluation |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_01293 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SiTSE: Sinhala Text Simplification Dataset and Evaluation Ranathunga, Surangika Sirithunga, Rumesh Rathnayake, Himashi De Silva, Lahiru Aluthwala, Thamindu Peramuna, Saman Shekhar, Ravi Computation and Language Text Simplification is a task that has been minimally explored for low-resource languages. Consequently, there are only a few manually curated datasets. In this paper, we present a human curated sentence-level text simplification dataset for the Sinhala language. Our evaluation dataset contains 1,000 complex sentences and corresponding 3,000 simplified sentences produced by three different human annotators. We model the text simplification task as a zero-shot and zero resource sequence-to-sequence (seq-seq) task on the multilingual language models mT5 and mBART. We exploit auxiliary data from related seq-seq tasks and explore the possibility of using intermediate task transfer learning (ITTL). Our analysis shows that ITTL outperforms the previously proposed zero-resource methods for text simplification. Our findings also highlight the challenges in evaluating text simplification systems, and support the calls for improved metrics for measuring the quality of automated text simplification systems that would suit low-resource languages as well. Our code and data are publicly available: https://github.com/brainsharks-fyp17/Sinhala-Text-Simplification-Dataset-and-Evaluation |
| title | SiTSE: Sinhala Text Simplification Dataset and Evaluation |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2412.01293 |