A Context-aware Framework for Translation-mediated Conversations

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Pombal, José, Agrawal, Sweta, Fernandes, Patrick, Zaranis, Emmanouil, Martins, André F. T.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916814125006848
author Pombal, José
Agrawal, Sweta
Fernandes, Patrick
Zaranis, Emmanouil
Martins, André F. T.
author_facet Pombal, José
Agrawal, Sweta
Fernandes, Patrick
Zaranis, Emmanouil
Martins, André F. T.
contents Automatic translation systems offer a powerful solution to bridge language barriers in scenarios where participants do not share a common language. However, these systems can introduce errors leading to misunderstandings and conversation breakdown. A key issue is that current systems fail to incorporate the rich contextual information necessary to resolve ambiguities and omitted details, resulting in literal, inappropriate, or misaligned translations. In this work, we present a framework to improve large language model-based translation systems by incorporating contextual information in bilingual conversational settings during training and inference. We validate our proposed framework on two task-oriented domains: customer chat and user-assistant interaction. Across both settings, the system produced by our framework-TowerChat-consistently results in better translations than state-of-the-art systems like GPT-4o and TowerInstruct, as measured by multiple automatic translation quality metrics on several language pairs. We also show that the resulting model leverages context in an intended and interpretable way, improving consistency between the conveyed message and the generated translations.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04205
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Context-aware Framework for Translation-mediated Conversations
Pombal, José
Agrawal, Sweta
Fernandes, Patrick
Zaranis, Emmanouil
Martins, André F. T.
Computation and Language
Automatic translation systems offer a powerful solution to bridge language barriers in scenarios where participants do not share a common language. However, these systems can introduce errors leading to misunderstandings and conversation breakdown. A key issue is that current systems fail to incorporate the rich contextual information necessary to resolve ambiguities and omitted details, resulting in literal, inappropriate, or misaligned translations. In this work, we present a framework to improve large language model-based translation systems by incorporating contextual information in bilingual conversational settings during training and inference. We validate our proposed framework on two task-oriented domains: customer chat and user-assistant interaction. Across both settings, the system produced by our framework-TowerChat-consistently results in better translations than state-of-the-art systems like GPT-4o and TowerInstruct, as measured by multiple automatic translation quality metrics on several language pairs. We also show that the resulting model leverages context in an intended and interpretable way, improving consistency between the conveyed message and the generated translations.
title A Context-aware Framework for Translation-mediated Conversations
topic Computation and Language
url https://arxiv.org/abs/2412.04205