Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916418795077632 |
|---|---|
| author | Myung, Jiyoon Park, Jihyeon Son, Jungki Lee, Kyungro Han, Joohyung |
| author_facet | Myung, Jiyoon Park, Jihyeon Son, Jungki Lee, Kyungro Han, Joohyung |
| contents | This paper addresses the challenge of accurately translating technical terms, which are crucial for clear communication in specialized fields. We introduce the Parenthetical Terminology Translation (PTT) task, designed to mitigate potential inaccuracies by displaying the original term in parentheses alongside its translation. To implement this approach, we generated a representative PTT dataset using a collaborative approach with large language models and applied knowledge distillation to fine-tune traditional Neural Machine Translation (NMT) models and small-sized Large Language Models (sLMs). Additionally, we developed a novel evaluation metric to assess both overall translation accuracy and the correct parenthetical presentation of terms. Our findings indicate that sLMs did not consistently outperform NMT models, with fine-tuning proving more effective than few-shot prompting, particularly in models with continued pre-training in the target language. These insights contribute to the advancement of more reliable terminology translation methodologies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_00683 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation Myung, Jiyoon Park, Jihyeon Son, Jungki Lee, Kyungro Han, Joohyung Computation and Language Artificial Intelligence This paper addresses the challenge of accurately translating technical terms, which are crucial for clear communication in specialized fields. We introduce the Parenthetical Terminology Translation (PTT) task, designed to mitigate potential inaccuracies by displaying the original term in parentheses alongside its translation. To implement this approach, we generated a representative PTT dataset using a collaborative approach with large language models and applied knowledge distillation to fine-tune traditional Neural Machine Translation (NMT) models and small-sized Large Language Models (sLMs). Additionally, we developed a novel evaluation metric to assess both overall translation accuracy and the correct parenthetical presentation of terms. Our findings indicate that sLMs did not consistently outperform NMT models, with fine-tuning proving more effective than few-shot prompting, particularly in models with continued pre-training in the target language. These insights contribute to the advancement of more reliable terminology translation methodologies. |
| title | Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2410.00683 |