Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.13484 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929636508696576 |
|---|---|
| author | Hari, Kancharla Aditya Gupta, Manish Varma, Vasudeva |
| author_facet | Hari, Kancharla Aditya Gupta, Manish Varma, Vasudeva |
| contents | Curriculum learning has been used to improve the quality of text generation systems by ordering the training samples according to a particular schedule in various tasks. In the context of data-to-text generation (DTG), previous studies used various difficulty criteria to order the training samples for monolingual DTG. These criteria, however, do not generalize to the crosslingual variant of the problem and do not account for noisy data. We explore multiple criteria that can be used for improving the performance of cross-lingual DTG systems with noisy data using two curriculum schedules. Using the alignment score criterion for ordering samples and an annealing schedule to train the model, we show increase in BLEU score by up to 4 points, and improvements in faithfulness and coverage of generations by 5-15% on average across 11 Indian languages and English in 2 separate datasets. We make code and data publicly available |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_13484 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Curriculum Learning for Cross-Lingual Data-to-Text Generation With Noisy Data Hari, Kancharla Aditya Gupta, Manish Varma, Vasudeva Computation and Language Curriculum learning has been used to improve the quality of text generation systems by ordering the training samples according to a particular schedule in various tasks. In the context of data-to-text generation (DTG), previous studies used various difficulty criteria to order the training samples for monolingual DTG. These criteria, however, do not generalize to the crosslingual variant of the problem and do not account for noisy data. We explore multiple criteria that can be used for improving the performance of cross-lingual DTG systems with noisy data using two curriculum schedules. Using the alignment score criterion for ordering samples and an annealing schedule to train the model, we show increase in BLEU score by up to 4 points, and improvements in faithfulness and coverage of generations by 5-15% on average across 11 Indian languages and English in 2 separate datasets. We make code and data publicly available |
| title | Curriculum Learning for Cross-Lingual Data-to-Text Generation With Noisy Data |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2412.13484 |