Task Supportive and Personalized Human-Large Language Model Interaction: A User Study

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Ben, Liu, Jiqun, Karimnazarov, Jamshed, Thompson, Nicolas
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909099381227520
author Wang, Ben
Liu, Jiqun
Karimnazarov, Jamshed
Thompson, Nicolas
author_facet Wang, Ben
Liu, Jiqun
Karimnazarov, Jamshed
Thompson, Nicolas
contents Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive barriers and biased perceptions further impede task completion. These issues reflect broader challenges identified within the fields of IS and interactive information retrieval (IIR). To address these, our approach integrates task context and user perceptions into human-ChatGPT interactions through prompt engineering. We developed a ChatGPT-like platform integrated with supportive functions, including perception articulation, prompt suggestion, and conversation explanation. Our findings of a user study demonstrate that the supportive functions help users manage expectations, reduce cognitive loads, better refine prompts, and increase user engagement. This research enhances our comprehension of designing proactive and user-centric systems with LLMs. It offers insights into evaluating human-LLM interactions and emphasizes potential challenges for under served users.
format Preprint
id arxiv_https___arxiv_org_abs_2402_06170
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Task Supportive and Personalized Human-Large Language Model Interaction: A User Study
Wang, Ben
Liu, Jiqun
Karimnazarov, Jamshed
Thompson, Nicolas
Human-Computer Interaction
Information Retrieval
Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive barriers and biased perceptions further impede task completion. These issues reflect broader challenges identified within the fields of IS and interactive information retrieval (IIR). To address these, our approach integrates task context and user perceptions into human-ChatGPT interactions through prompt engineering. We developed a ChatGPT-like platform integrated with supportive functions, including perception articulation, prompt suggestion, and conversation explanation. Our findings of a user study demonstrate that the supportive functions help users manage expectations, reduce cognitive loads, better refine prompts, and increase user engagement. This research enhances our comprehension of designing proactive and user-centric systems with LLMs. It offers insights into evaluating human-LLM interactions and emphasizes potential challenges for under served users.
title Task Supportive and Personalized Human-Large Language Model Interaction: A User Study
topic Human-Computer Interaction
Information Retrieval
url https://arxiv.org/abs/2402.06170