Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.09994 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909837413056512 |
|---|---|
| author | Xiao, Yimin Zhang, Yongle Ki, Dayeon Bao, Calvin Martindale, Marianna J. Vaughn, Charlotte Gao, Ge Carpuat, Marine |
| author_facet | Xiao, Yimin Zhang, Yongle Ki, Dayeon Bao, Calvin Martindale, Marianna J. Vaughn, Charlotte Gao, Ge Carpuat, Marine |
| contents | As Machine Translation (MT) becomes increasingly commonplace, understanding how the general public perceives and relies on imperfect MT is crucial for contextualizing MT research in real-world applications. We present a human study conducted in a public museum (n=452), investigating how fluency and adequacy errors impact bilingual and non-bilingual users' reliance on MT during casual use. Our findings reveal that non-bilingual users often over-rely on MT due to a lack of evaluation strategies and alternatives, while experiencing the impact of errors can prompt users to reassess future reliance. This highlights the need for MT evaluation and NLP explanation techniques to promote not only MT quality, but also MT literacy among its users. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_09994 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Toward Machine Translation Literacy: How Lay Users Perceive and Rely on Imperfect Translations Xiao, Yimin Zhang, Yongle Ki, Dayeon Bao, Calvin Martindale, Marianna J. Vaughn, Charlotte Gao, Ge Carpuat, Marine Computation and Language As Machine Translation (MT) becomes increasingly commonplace, understanding how the general public perceives and relies on imperfect MT is crucial for contextualizing MT research in real-world applications. We present a human study conducted in a public museum (n=452), investigating how fluency and adequacy errors impact bilingual and non-bilingual users' reliance on MT during casual use. Our findings reveal that non-bilingual users often over-rely on MT due to a lack of evaluation strategies and alternatives, while experiencing the impact of errors can prompt users to reassess future reliance. This highlights the need for MT evaluation and NLP explanation techniques to promote not only MT quality, but also MT literacy among its users. |
| title | Toward Machine Translation Literacy: How Lay Users Perceive and Rely on Imperfect Translations |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2510.09994 |