Learning to Translate Ambiguous Terminology by Preference Optimization on Post-Edits

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Berger, Nathaniel, Eschbach-Dymanus, Johannes, Exel, Miriam, Huck, Matthias, Riezler, Stefan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913945507332096
author Berger, Nathaniel
Eschbach-Dymanus, Johannes
Exel, Miriam
Huck, Matthias
Riezler, Stefan
author_facet Berger, Nathaniel
Eschbach-Dymanus, Johannes
Exel, Miriam
Huck, Matthias
Riezler, Stefan
contents In real world translation scenarios, terminology is rarely one-to-one. Instead, multiple valid translations may appear in a terminology dictionary, but correctness of a translation depends on corporate style guides and context. This can be challenging for neural machine translation (NMT) systems. Luckily, in a corporate context, many examples of human post-edits of valid but incorrect terminology exist. The goal of this work is to learn how to disambiguate our terminology based on these corrections. Our approach is based on preference optimization, using the term post-edit as the knowledge to be preferred. While previous work had to rely on unambiguous translation dictionaries to set hard constraints during decoding, or to add soft constraints in the input, our framework requires neither one-to-one dictionaries nor human intervention at decoding time. We report results on English-German post-edited data and find that the optimal combination of supervised fine-tuning and preference optimization, with both term-specific and full sequence objectives, yields statistically significant improvements in term accuracy over a strong NMT baseline without significant losses in COMET score. Additionally, we release test sets from our post-edited data and terminology dictionary.
format Preprint
id arxiv_https___arxiv_org_abs_2507_03580
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning to Translate Ambiguous Terminology by Preference Optimization on Post-Edits
Berger, Nathaniel
Eschbach-Dymanus, Johannes
Exel, Miriam
Huck, Matthias
Riezler, Stefan
Computation and Language
In real world translation scenarios, terminology is rarely one-to-one. Instead, multiple valid translations may appear in a terminology dictionary, but correctness of a translation depends on corporate style guides and context. This can be challenging for neural machine translation (NMT) systems. Luckily, in a corporate context, many examples of human post-edits of valid but incorrect terminology exist. The goal of this work is to learn how to disambiguate our terminology based on these corrections. Our approach is based on preference optimization, using the term post-edit as the knowledge to be preferred. While previous work had to rely on unambiguous translation dictionaries to set hard constraints during decoding, or to add soft constraints in the input, our framework requires neither one-to-one dictionaries nor human intervention at decoding time. We report results on English-German post-edited data and find that the optimal combination of supervised fine-tuning and preference optimization, with both term-specific and full sequence objectives, yields statistically significant improvements in term accuracy over a strong NMT baseline without significant losses in COMET score. Additionally, we release test sets from our post-edited data and terminology dictionary.
title Learning to Translate Ambiguous Terminology by Preference Optimization on Post-Edits
topic Computation and Language
url https://arxiv.org/abs/2507.03580