Supporting Business Document Workflows via Collection-Centric Information Foraging with Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fok, Raymond, Lipka, Nedim, Sun, Tong, Siu, Alexa
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910432436944896
author Fok, Raymond
Lipka, Nedim
Sun, Tong
Siu, Alexa
author_facet Fok, Raymond
Lipka, Nedim
Sun, Tong
Siu, Alexa
contents Knowledge workers often need to extract and analyze information from a collection of documents to solve complex information tasks in the workplace, e.g., hiring managers reviewing resumes or analysts assessing risk in contracts. However, foraging for relevant information can become tedious and repetitive over many documents and criteria of interest. We introduce Marco, a mixed-initiative workspace supporting sensemaking over diverse business document collections. Through collection-centric assistance, Marco reduces the cognitive costs of extracting and structuring information, allowing users to prioritize comparative synthesis and decision making processes. Users interactively communicate their information needs to an AI assistant using natural language and compose schemas that provide an overview of a document collection. Findings from a usability study (n=16) demonstrate that when using Marco, users complete sensemaking tasks 16% more quickly, with less effort, and without diminishing accuracy. A design probe with seven domain experts identifies how Marco can benefit various real-world workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2405_01501
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Supporting Business Document Workflows via Collection-Centric Information Foraging with Large Language Models
Fok, Raymond
Lipka, Nedim
Sun, Tong
Siu, Alexa
Human-Computer Interaction
Knowledge workers often need to extract and analyze information from a collection of documents to solve complex information tasks in the workplace, e.g., hiring managers reviewing resumes or analysts assessing risk in contracts. However, foraging for relevant information can become tedious and repetitive over many documents and criteria of interest. We introduce Marco, a mixed-initiative workspace supporting sensemaking over diverse business document collections. Through collection-centric assistance, Marco reduces the cognitive costs of extracting and structuring information, allowing users to prioritize comparative synthesis and decision making processes. Users interactively communicate their information needs to an AI assistant using natural language and compose schemas that provide an overview of a document collection. Findings from a usability study (n=16) demonstrate that when using Marco, users complete sensemaking tasks 16% more quickly, with less effort, and without diminishing accuracy. A design probe with seven domain experts identifies how Marco can benefit various real-world workflows.
title Supporting Business Document Workflows via Collection-Centric Information Foraging with Large Language Models
topic Human-Computer Interaction
url https://arxiv.org/abs/2405.01501