Proactive Conversational Agents with Inner Thoughts

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Xingyu Bruce, Fang, Shitao, Shi, Weiyan, Wu, Chien-Sheng, Igarashi, Takeo, Chen, Xiang Anthony
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929718653091840
author Liu, Xingyu Bruce
Fang, Shitao
Shi, Weiyan
Wu, Chien-Sheng
Igarashi, Takeo
Chen, Xiang Anthony
author_facet Liu, Xingyu Bruce
Fang, Shitao
Shi, Weiyan
Wu, Chien-Sheng
Igarashi, Takeo
Chen, Xiang Anthony
contents One of the long-standing aspirations in conversational AI is to allow them to autonomously take initiatives in conversations, i.e., being proactive. This is especially challenging for multi-party conversations. Prior NLP research focused mainly on predicting the next speaker from contexts like preceding conversations. In this paper, we demonstrate the limitations of such methods and rethink what it means for AI to be proactive in multi-party, human-AI conversations. We propose that just like humans, rather than merely reacting to turn-taking cues, a proactive AI formulates its own inner thoughts during a conversation, and seeks the right moment to contribute. Through a formative study with 24 participants and inspiration from linguistics and cognitive psychology, we introduce the Inner Thoughts framework. Our framework equips AI with a continuous, covert train of thoughts in parallel to the overt communication process, which enables it to proactively engage by modeling its intrinsic motivation to express these thoughts. We instantiated this framework into two real-time systems: an AI playground web app and a chatbot. Through a technical evaluation and user studies with human participants, our framework significantly surpasses existing baselines on aspects like anthropomorphism, coherence, intelligence, and turn-taking appropriateness.
format Preprint
id arxiv_https___arxiv_org_abs_2501_00383
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Proactive Conversational Agents with Inner Thoughts
Liu, Xingyu Bruce
Fang, Shitao
Shi, Weiyan
Wu, Chien-Sheng
Igarashi, Takeo
Chen, Xiang Anthony
Human-Computer Interaction
Artificial Intelligence
One of the long-standing aspirations in conversational AI is to allow them to autonomously take initiatives in conversations, i.e., being proactive. This is especially challenging for multi-party conversations. Prior NLP research focused mainly on predicting the next speaker from contexts like preceding conversations. In this paper, we demonstrate the limitations of such methods and rethink what it means for AI to be proactive in multi-party, human-AI conversations. We propose that just like humans, rather than merely reacting to turn-taking cues, a proactive AI formulates its own inner thoughts during a conversation, and seeks the right moment to contribute. Through a formative study with 24 participants and inspiration from linguistics and cognitive psychology, we introduce the Inner Thoughts framework. Our framework equips AI with a continuous, covert train of thoughts in parallel to the overt communication process, which enables it to proactively engage by modeling its intrinsic motivation to express these thoughts. We instantiated this framework into two real-time systems: an AI playground web app and a chatbot. Through a technical evaluation and user studies with human participants, our framework significantly surpasses existing baselines on aspects like anthropomorphism, coherence, intelligence, and turn-taking appropriateness.
title Proactive Conversational Agents with Inner Thoughts
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2501.00383