Exploring the Design Space of Real-time LLM Knowledge Support Systems: A Case Study of Jargon Explanations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Yuhan, Shah, Aadit, Ackerman, Jordan, Saha, Manaswi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912355741335552
author Liu, Yuhan
Shah, Aadit
Ackerman, Jordan
Saha, Manaswi
author_facet Liu, Yuhan
Shah, Aadit
Ackerman, Jordan
Saha, Manaswi
contents Knowledge gaps often arise during communication due to diverse backgrounds, knowledge bases, and vocabularies. With recent LLM developments, providing real-time knowledge support is increasingly viable, but is challenging due to shared and individual cognitive limitations (e.g., attention, memory, and comprehension) and the difficulty in understanding the user's context and internal knowledge. To address these challenges, we explore the key question of understanding how people want to receive real-time knowledge support. We built StopGap -- a prototype that provides real-time knowledge support for explaining jargon words in videos -- to conduct a design probe study (N=24) that explored multiple visual knowledge representation formats. Our study revealed individual differences in preferred representations and highlighted the importance of user agency, personalization, and mixed-initiative assistance. Based on our findings, we map out six key design dimensions for real-time LLM knowledge support systems and offer insights for future research in this space.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00715
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring the Design Space of Real-time LLM Knowledge Support Systems: A Case Study of Jargon Explanations
Liu, Yuhan
Shah, Aadit
Ackerman, Jordan
Saha, Manaswi
Human-Computer Interaction
Knowledge gaps often arise during communication due to diverse backgrounds, knowledge bases, and vocabularies. With recent LLM developments, providing real-time knowledge support is increasingly viable, but is challenging due to shared and individual cognitive limitations (e.g., attention, memory, and comprehension) and the difficulty in understanding the user's context and internal knowledge. To address these challenges, we explore the key question of understanding how people want to receive real-time knowledge support. We built StopGap -- a prototype that provides real-time knowledge support for explaining jargon words in videos -- to conduct a design probe study (N=24) that explored multiple visual knowledge representation formats. Our study revealed individual differences in preferred representations and highlighted the importance of user agency, personalization, and mixed-initiative assistance. Based on our findings, we map out six key design dimensions for real-time LLM knowledge support systems and offer insights for future research in this space.
title Exploring the Design Space of Real-time LLM Knowledge Support Systems: A Case Study of Jargon Explanations
topic Human-Computer Interaction
url https://arxiv.org/abs/2503.00715