ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Park, Jeongeon, Min, Bryan, Son, Kihoon, Song, Jean Y., Ma, Xiaojuan, Kim, Juho
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918346186817536
author Park, Jeongeon
Min, Bryan
Son, Kihoon
Song, Jean Y.
Ma, Xiaojuan
Kim, Juho
author_facet Park, Jeongeon
Min, Bryan
Son, Kihoon
Song, Jean Y.
Ma, Xiaojuan
Kim, Juho
contents From deciding on a PhD program to buying a new camera, unfamiliar decisions--decisions without domain knowledge--are frequent and significant. The complexity and uncertainty of such decisions demand unique approaches to information seeking, understanding, and decision-making. Our formative study highlights that users want to start by discovering broad and relevant domain information evenly and simultaneously, quickly address emerging inquiries, and gain personalized standards to assess information found. We present ChoiceMates, an interactive multi-agent system designed to address these needs by enabling users to engage with a dynamic set of LLM agents each presenting a unique experience in the domain. Unlike existing multi-agent systems that automate tasks with agents, the user orchestrates agents to assist their decision-making process. Our user evaluation (n=12) shows that ChoiceMates enables a more confident, satisfactory decision-making with better situation understanding than web search, and higher decision quality and confidence than a commercial multi-agent framework. This work provides insights into designing a more controllable and collaborative multi-agent system.
format Preprint
id arxiv_https___arxiv_org_abs_2310_01331
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions
Park, Jeongeon
Min, Bryan
Son, Kihoon
Song, Jean Y.
Ma, Xiaojuan
Kim, Juho
Human-Computer Interaction
Artificial Intelligence
From deciding on a PhD program to buying a new camera, unfamiliar decisions--decisions without domain knowledge--are frequent and significant. The complexity and uncertainty of such decisions demand unique approaches to information seeking, understanding, and decision-making. Our formative study highlights that users want to start by discovering broad and relevant domain information evenly and simultaneously, quickly address emerging inquiries, and gain personalized standards to assess information found. We present ChoiceMates, an interactive multi-agent system designed to address these needs by enabling users to engage with a dynamic set of LLM agents each presenting a unique experience in the domain. Unlike existing multi-agent systems that automate tasks with agents, the user orchestrates agents to assist their decision-making process. Our user evaluation (n=12) shows that ChoiceMates enables a more confident, satisfactory decision-making with better situation understanding than web search, and higher decision quality and confidence than a commercial multi-agent framework. This work provides insights into designing a more controllable and collaborative multi-agent system.
title ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2310.01331