Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Michael Xieyang, Wu, Tongshuang, Chen, Tianying, Li, Franklin Mingzhe, Kittur, Aniket, Myers, Brad A.
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914655096537088
author Liu, Michael Xieyang
Wu, Tongshuang
Chen, Tianying
Li, Franklin Mingzhe
Kittur, Aniket
Myers, Brad A.
author_facet Liu, Michael Xieyang
Wu, Tongshuang
Chen, Tianying
Li, Franklin Mingzhe
Kittur, Aniket
Myers, Brad A.
contents Sensemaking in unfamiliar domains can be challenging, demanding considerable user effort to compare different options with respect to various criteria. Prior research and our formative study found that people would benefit from reading an overview of an information space upfront, including the criteria others previously found useful. However, existing sensemaking tools struggle with the "cold-start" problem -- it not only requires significant input from previous users to generate and share these overviews, but such overviews may also turn out to be biased and incomplete. In this work, we introduce a novel system, Selenite, which leverages Large Language Models (LLMs) as reasoning machines and knowledge retrievers to automatically produce a comprehensive overview of options and criteria to jumpstart users' sensemaking processes. Subsequently, Selenite also adapts as people use it, helping users find, read, and navigate unfamiliar information in a systematic yet personalized manner. Through three studies, we found that Selenite produced accurate and high-quality overviews reliably, significantly accelerated users' information processing, and effectively improved their overall comprehension and sensemaking experience.
format Preprint
id arxiv_https___arxiv_org_abs_2310_02161
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language Models
Liu, Michael Xieyang
Wu, Tongshuang
Chen, Tianying
Li, Franklin Mingzhe
Kittur, Aniket
Myers, Brad A.
Human-Computer Interaction
Artificial Intelligence
Sensemaking in unfamiliar domains can be challenging, demanding considerable user effort to compare different options with respect to various criteria. Prior research and our formative study found that people would benefit from reading an overview of an information space upfront, including the criteria others previously found useful. However, existing sensemaking tools struggle with the "cold-start" problem -- it not only requires significant input from previous users to generate and share these overviews, but such overviews may also turn out to be biased and incomplete. In this work, we introduce a novel system, Selenite, which leverages Large Language Models (LLMs) as reasoning machines and knowledge retrievers to automatically produce a comprehensive overview of options and criteria to jumpstart users' sensemaking processes. Subsequently, Selenite also adapts as people use it, helping users find, read, and navigate unfamiliar information in a systematic yet personalized manner. Through three studies, we found that Selenite produced accurate and high-quality overviews reliably, significantly accelerated users' information processing, and effectively improved their overall comprehension and sensemaking experience.
title Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language Models
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2310.02161