A comparison of data filtering techniques for English-Polish LLM-based machine translation in the biomedical domain
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913667923050496 |
|---|---|
| author | Lérida, Jorge del Pozo Kojs, Kamil Máté, János Barański, Mikołaj Antoni Hardmeier, Christian |
| author_facet | Lérida, Jorge del Pozo Kojs, Kamil Máté, János Barański, Mikołaj Antoni Hardmeier, Christian |
| contents | Large Language Models (LLMs) have become state-of-the-art in Machine Translation (MT), often trained on massive bilingual parallel corpora scraped from the web, that contain low-quality entries and redundant information, leading to significant computational challenges. Various data filtering methods exist to reduce dataset sizes, but their effectiveness largely varies based on specific language pairs and domains. This paper evaluates the impact of commonly used data filtering techniques, such as LASER, MUSE, and LaBSE, on English-Polish translation within the biomedical domain. By filtering the UFAL Medical Corpus, we created varying dataset sizes to fine-tune the mBART50 model, which was then evaluated using the SacreBLEU metric on the Khresmoi dataset, having the quality of translations assessed by bilingual speakers. Our results show that both LASER and MUSE can significantly reduce dataset sizes while maintaining or even enhancing performance. We recommend the use of LASER, as it consistently outperforms the other methods and provides the most fluent and natural-sounding translations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_16533 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A comparison of data filtering techniques for English-Polish LLM-based machine translation in the biomedical domain Lérida, Jorge del Pozo Kojs, Kamil Máté, János Barański, Mikołaj Antoni Hardmeier, Christian Computation and Language Machine Learning Large Language Models (LLMs) have become state-of-the-art in Machine Translation (MT), often trained on massive bilingual parallel corpora scraped from the web, that contain low-quality entries and redundant information, leading to significant computational challenges. Various data filtering methods exist to reduce dataset sizes, but their effectiveness largely varies based on specific language pairs and domains. This paper evaluates the impact of commonly used data filtering techniques, such as LASER, MUSE, and LaBSE, on English-Polish translation within the biomedical domain. By filtering the UFAL Medical Corpus, we created varying dataset sizes to fine-tune the mBART50 model, which was then evaluated using the SacreBLEU metric on the Khresmoi dataset, having the quality of translations assessed by bilingual speakers. Our results show that both LASER and MUSE can significantly reduce dataset sizes while maintaining or even enhancing performance. We recommend the use of LASER, as it consistently outperforms the other methods and provides the most fluent and natural-sounding translations. |
| title | A comparison of data filtering techniques for English-Polish LLM-based machine translation in the biomedical domain |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2501.16533 |