Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.15320 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909209974538240 |
|---|---|
| author | Ersoy, Asım Yıldız, Olcay Taner |
| author_facet | Ersoy, Asım Yıldız, Olcay Taner |
| contents | Grammatical Error Correction has seen significant progress with the recent advancements in deep learning. As those methods require huge amounts of data, synthetic datasets are being built to fill this gap. Unfortunately, synthetic datasets are not organic enough in some cases and even require clean data to start with. Furthermore, most of the work that has been done is focused mostly on English. In this work, we introduce a new organic data-driven approach, clean insertions, to build parallel Turkish Grammatical Error Correction datasets from any organic data, and to clean the data used for training Large Language Models. We achieve state-of-the-art results on two Turkish Grammatical Error Correction test sets out of the three publicly available ones. We also show the effectiveness of our method on the training losses of training language models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_15320 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Organic Data-Driven Approach for Turkish Grammatical Error Correction and LLMs Ersoy, Asım Yıldız, Olcay Taner Computation and Language Artificial Intelligence Grammatical Error Correction has seen significant progress with the recent advancements in deep learning. As those methods require huge amounts of data, synthetic datasets are being built to fill this gap. Unfortunately, synthetic datasets are not organic enough in some cases and even require clean data to start with. Furthermore, most of the work that has been done is focused mostly on English. In this work, we introduce a new organic data-driven approach, clean insertions, to build parallel Turkish Grammatical Error Correction datasets from any organic data, and to clean the data used for training Large Language Models. We achieve state-of-the-art results on two Turkish Grammatical Error Correction test sets out of the three publicly available ones. We also show the effectiveness of our method on the training losses of training language models. |
| title | Organic Data-Driven Approach for Turkish Grammatical Error Correction and LLMs |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2405.15320 |