A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909208909185024 |
|---|---|
| author | Shen, Huangjun Shao, Liangying Li, Wenbo Lan, Zhibin Liu, Zhanyu Su, Jinsong |
| author_facet | Shen, Huangjun Shao, Liangying Li, Wenbo Lan, Zhibin Liu, Zhanyu Su, Jinsong |
| contents | In recent years, multi-modal machine translation has attracted significant interest in both academia and industry due to its superior performance. It takes both textual and visual modalities as inputs, leveraging visual context to tackle the ambiguities in source texts. In this paper, we begin by offering an exhaustive overview of 99 prior works, comprehensively summarizing representative studies from the perspectives of dominant models, datasets, and evaluation metrics. Afterwards, we analyze the impact of various factors on model performance and finally discuss the possible research directions for this task in the future. Over time, multi-modal machine translation has developed more types to meet diverse needs. Unlike previous surveys confined to the early stage of multi-modal machine translation, our survey thoroughly concludes these emerging types from different aspects, so as to provide researchers with a better understanding of its current state. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_12669 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges Shen, Huangjun Shao, Liangying Li, Wenbo Lan, Zhibin Liu, Zhanyu Su, Jinsong Computation and Language In recent years, multi-modal machine translation has attracted significant interest in both academia and industry due to its superior performance. It takes both textual and visual modalities as inputs, leveraging visual context to tackle the ambiguities in source texts. In this paper, we begin by offering an exhaustive overview of 99 prior works, comprehensively summarizing representative studies from the perspectives of dominant models, datasets, and evaluation metrics. Afterwards, we analyze the impact of various factors on model performance and finally discuss the possible research directions for this task in the future. Over time, multi-modal machine translation has developed more types to meet diverse needs. Unlike previous surveys confined to the early stage of multi-modal machine translation, our survey thoroughly concludes these emerging types from different aspects, so as to provide researchers with a better understanding of its current state. |
| title | A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.12669 |