A Multi-task Learning Framework for Evaluating Machine Translation of Emotion-loaded User-generated Content

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Qian, Shenbin, Orăsan, Constantin, Kanojia, Diptesh, Carmo, Félix do
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917794159788032
author Qian, Shenbin
Orăsan, Constantin
Kanojia, Diptesh
Carmo, Félix do
author_facet Qian, Shenbin
Orăsan, Constantin
Kanojia, Diptesh
Carmo, Félix do
contents Machine translation (MT) of user-generated content (UGC) poses unique challenges, including handling slang, emotion, and literary devices like irony and sarcasm. Evaluating the quality of these translations is challenging as current metrics do not focus on these ubiquitous features of UGC. To address this issue, we utilize an existing emotion-related dataset that includes emotion labels and human-annotated translation errors based on Multi-dimensional Quality Metrics. We extend it with sentence-level evaluation scores and word-level labels, leading to a dataset suitable for sentence- and word-level translation evaluation and emotion classification, in a multi-task setting. We propose a new architecture to perform these tasks concurrently, with a novel combined loss function, which integrates different loss heuristics, like the Nash and Aligned losses. Our evaluation compares existing fine-tuning and multi-task learning approaches, assessing generalization with ablative experiments over multiple datasets. Our approach achieves state-of-the-art performance and we present a comprehensive analysis for MT evaluation of UGC.
format Preprint
id arxiv_https___arxiv_org_abs_2410_03277
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Multi-task Learning Framework for Evaluating Machine Translation of Emotion-loaded User-generated Content
Qian, Shenbin
Orăsan, Constantin
Kanojia, Diptesh
Carmo, Félix do
Computation and Language
Machine translation (MT) of user-generated content (UGC) poses unique challenges, including handling slang, emotion, and literary devices like irony and sarcasm. Evaluating the quality of these translations is challenging as current metrics do not focus on these ubiquitous features of UGC. To address this issue, we utilize an existing emotion-related dataset that includes emotion labels and human-annotated translation errors based on Multi-dimensional Quality Metrics. We extend it with sentence-level evaluation scores and word-level labels, leading to a dataset suitable for sentence- and word-level translation evaluation and emotion classification, in a multi-task setting. We propose a new architecture to perform these tasks concurrently, with a novel combined loss function, which integrates different loss heuristics, like the Nash and Aligned losses. Our evaluation compares existing fine-tuning and multi-task learning approaches, assessing generalization with ablative experiments over multiple datasets. Our approach achieves state-of-the-art performance and we present a comprehensive analysis for MT evaluation of UGC.
title A Multi-task Learning Framework for Evaluating Machine Translation of Emotion-loaded User-generated Content
topic Computation and Language
url https://arxiv.org/abs/2410.03277