Revisiting Context Choices for Context-aware Machine Translation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Rikters, Matīss, Nakazawa, Toshiaki
Format: Preprint
Publié: 2021
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916302433550336
author Rikters, Matīss
Nakazawa, Toshiaki
author_facet Rikters, Matīss
Nakazawa, Toshiaki
contents One of the most popular methods for context-aware machine translation (MT) is to use separate encoders for the source sentence and context as multiple sources for one target sentence. Recent work has cast doubt on whether these models actually learn useful signals from the context or are improvements in automatic evaluation metrics just a side-effect. We show that multi-source transformer models improve MT over standard transformer-base models even with empty lines provided as context, but the translation quality improves significantly (1.51 - 2.65 BLEU) when a sufficient amount of correct context is provided. We also show that even though randomly shuffling in-domain context can also improve over baselines, the correct context further improves translation quality and random out-of-domain context further degrades it.
format Preprint
id arxiv_https___arxiv_org_abs_2109_02995
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Revisiting Context Choices for Context-aware Machine Translation
Rikters, Matīss
Nakazawa, Toshiaki
Computation and Language
One of the most popular methods for context-aware machine translation (MT) is to use separate encoders for the source sentence and context as multiple sources for one target sentence. Recent work has cast doubt on whether these models actually learn useful signals from the context or are improvements in automatic evaluation metrics just a side-effect. We show that multi-source transformer models improve MT over standard transformer-base models even with empty lines provided as context, but the translation quality improves significantly (1.51 - 2.65 BLEU) when a sufficient amount of correct context is provided. We also show that even though randomly shuffling in-domain context can also improve over baselines, the correct context further improves translation quality and random out-of-domain context further degrades it.
title Revisiting Context Choices for Context-aware Machine Translation
topic Computation and Language
url https://arxiv.org/abs/2109.02995