Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916164144201728 |
|---|---|
| author | Subramonyam, Hariharan Pea, Roy Pondoc, Christopher Lawrence Agrawala, Maneesh Seifert, Colleen |
| author_facet | Subramonyam, Hariharan Pea, Roy Pondoc, Christopher Lawrence Agrawala, Maneesh Seifert, Colleen |
| contents | Large language models (LLMs) exhibit dynamic capabilities and appear to comprehend complex and ambiguous natural language prompts. However, calibrating LLM interactions is challenging for interface designers and end-users alike. A central issue is our limited grasp of how human cognitive processes begin with a goal and form intentions for executing actions, a blindspot even in established interaction models such as Norman's gulfs of execution and evaluation. To address this gap, we theorize how end-users 'envision' translating their goals into clear intentions and craft prompts to obtain the desired LLM response. We define a process of Envisioning by highlighting three misalignments: (1) knowing whether LLMs can accomplish the task, (2) how to instruct the LLM to do the task, and (3) how to evaluate the success of the LLM's output in meeting the goal. Finally, we make recommendations to narrow the envisioning gulf in human-LLM interactions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_14459 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces Subramonyam, Hariharan Pea, Roy Pondoc, Christopher Lawrence Agrawala, Maneesh Seifert, Colleen Human-Computer Interaction Large language models (LLMs) exhibit dynamic capabilities and appear to comprehend complex and ambiguous natural language prompts. However, calibrating LLM interactions is challenging for interface designers and end-users alike. A central issue is our limited grasp of how human cognitive processes begin with a goal and form intentions for executing actions, a blindspot even in established interaction models such as Norman's gulfs of execution and evaluation. To address this gap, we theorize how end-users 'envision' translating their goals into clear intentions and craft prompts to obtain the desired LLM response. We define a process of Envisioning by highlighting three misalignments: (1) knowing whether LLMs can accomplish the task, (2) how to instruct the LLM to do the task, and (3) how to evaluate the success of the LLM's output in meeting the goal. Finally, we make recommendations to narrow the envisioning gulf in human-LLM interactions. |
| title | Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2309.14459 |