Enregistré dans:
Détails bibliographiques
Auteurs principaux: Choi, Seung-Woo, Yoo, Ga-Hyun, Lee, Jay-Yoon
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2410.11693
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916770802040832
author Choi, Seung-Woo
Yoo, Ga-Hyun
Lee, Jay-Yoon
author_facet Choi, Seung-Woo
Yoo, Ga-Hyun
Lee, Jay-Yoon
contents Recent Large Language Models (LLMs) have demonstrated impressive translation performance without requiring fine-tuning on additional parallel corpora. However, they still face significant challenges in certain scenarios, particularly when translating low-resource languages. A common approach to address this issue is to provide external knowledge, such as few-shot examples, to assist LLMs in translating specific source sentences. However, this method is fundamentally limited by the quality or quantity of relevant sources, which cannot always be guaranteed. To reduce LLMs' reliance on external sources, we propose BridG MT, a method that combines Sentence Bridging, which generates a sequence of sentences as a bridge that gradually transition from easy-to-translate to more difficult, and Gradual MT, which sequentially translates these sentences using earlier translations as few-shot examples for subsequent ones. Experiments conducted on four LLMs across seven languages demonstrate that our method effectively enhances translation performance, even outperforming translation methods that rely on a large number of few-shot examples.
format Preprint
id arxiv_https___arxiv_org_abs_2410_11693
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle BridG MT: Enhancing LLMs' Machine Translation Capabilities with Sentence Bridging and Gradual MT
Choi, Seung-Woo
Yoo, Ga-Hyun
Lee, Jay-Yoon
Computation and Language
Recent Large Language Models (LLMs) have demonstrated impressive translation performance without requiring fine-tuning on additional parallel corpora. However, they still face significant challenges in certain scenarios, particularly when translating low-resource languages. A common approach to address this issue is to provide external knowledge, such as few-shot examples, to assist LLMs in translating specific source sentences. However, this method is fundamentally limited by the quality or quantity of relevant sources, which cannot always be guaranteed. To reduce LLMs' reliance on external sources, we propose BridG MT, a method that combines Sentence Bridging, which generates a sequence of sentences as a bridge that gradually transition from easy-to-translate to more difficult, and Gradual MT, which sequentially translates these sentences using earlier translations as few-shot examples for subsequent ones. Experiments conducted on four LLMs across seven languages demonstrate that our method effectively enhances translation performance, even outperforming translation methods that rely on a large number of few-shot examples.
title BridG MT: Enhancing LLMs' Machine Translation Capabilities with Sentence Bridging and Gradual MT
topic Computation and Language
url https://arxiv.org/abs/2410.11693