Saved in:
Bibliographic Details
Main Authors: Kim, Yewon, Le, Thanh-Long V., Kim, Donghwi, Lee, Mina, Lee, Sung-Ju
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.07475
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912381712465920
author Kim, Yewon
Le, Thanh-Long V.
Kim, Donghwi
Lee, Mina
Lee, Sung-Ju
author_facet Kim, Yewon
Le, Thanh-Long V.
Kim, Donghwi
Lee, Mina
Lee, Sung-Ju
contents We investigate how non-native English speakers (NNESs) interact with diverse information aids to assess and select AI-generated paraphrases. We develop ParaScope, an AI paraphrasing assistant that integrates diverse information aids, such as back-translation, explanations, and usage examples, and logs user interaction data. Our in-lab study with 22 NNESs reveals that user preferences for information aids vary by language proficiency, with workflows progressing from global to more detailed information. While back-translation was the most frequently used aid, it was not a decisive factor in suggestion acceptance; users combined multiple information aids to make informed decisions. Our findings demonstrate the potential of explainable AI paraphrasing tools to enhance NNESs' confidence, autonomy, and writing efficiency, while also emphasizing the importance of thoughtful design to prevent information overload. Based on these findings, we offer design implications for explainable AI paraphrasing tools that support NNESs in making informed decisions when using AI writing systems.
format Preprint
id arxiv_https___arxiv_org_abs_2405_07475
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Design Opportunities for Explainable AI Paraphrasing Tools: A User Study with Non-native English Speakers
Kim, Yewon
Le, Thanh-Long V.
Kim, Donghwi
Lee, Mina
Lee, Sung-Ju
Human-Computer Interaction
We investigate how non-native English speakers (NNESs) interact with diverse information aids to assess and select AI-generated paraphrases. We develop ParaScope, an AI paraphrasing assistant that integrates diverse information aids, such as back-translation, explanations, and usage examples, and logs user interaction data. Our in-lab study with 22 NNESs reveals that user preferences for information aids vary by language proficiency, with workflows progressing from global to more detailed information. While back-translation was the most frequently used aid, it was not a decisive factor in suggestion acceptance; users combined multiple information aids to make informed decisions. Our findings demonstrate the potential of explainable AI paraphrasing tools to enhance NNESs' confidence, autonomy, and writing efficiency, while also emphasizing the importance of thoughtful design to prevent information overload. Based on these findings, we offer design implications for explainable AI paraphrasing tools that support NNESs in making informed decisions when using AI writing systems.
title Design Opportunities for Explainable AI Paraphrasing Tools: A User Study with Non-native English Speakers
topic Human-Computer Interaction
url https://arxiv.org/abs/2405.07475