ACE: A LLM-based Negotiation Coaching System

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shea, Ryan, Kallala, Aymen, Liu, Xin Lucy, Morris, Michael W., Yu, Zhou
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909333083652096
author Shea, Ryan
Kallala, Aymen
Liu, Xin Lucy
Morris, Michael W.
Yu, Zhou
author_facet Shea, Ryan
Kallala, Aymen
Liu, Xin Lucy
Morris, Michael W.
Yu, Zhou
contents The growing prominence of LLMs has led to an increase in the development of AI tutoring systems. These systems are crucial in providing underrepresented populations with improved access to valuable education. One important area of education that is unavailable to many learners is strategic bargaining related to negotiation. To address this, we develop a LLM-based Assistant for Coaching nEgotiation (ACE). ACE not only serves as a negotiation partner for users but also provides them with targeted feedback for improvement. To build our system, we collect a dataset of negotiation transcripts between MBA students. These transcripts come from trained negotiators and emulate realistic bargaining scenarios. We use the dataset, along with expert consultations, to design an annotation scheme for detecting negotiation mistakes. ACE employs this scheme to identify mistakes and provide targeted feedback to users. To test the effectiveness of ACE-generated feedback, we conducted a user experiment with two consecutive trials of negotiation and found that it improves negotiation performances significantly compared to a system that doesn't provide feedback and one which uses an alternative method of providing feedback.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01555
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ACE: A LLM-based Negotiation Coaching System
Shea, Ryan
Kallala, Aymen
Liu, Xin Lucy
Morris, Michael W.
Yu, Zhou
Computation and Language
Human-Computer Interaction
The growing prominence of LLMs has led to an increase in the development of AI tutoring systems. These systems are crucial in providing underrepresented populations with improved access to valuable education. One important area of education that is unavailable to many learners is strategic bargaining related to negotiation. To address this, we develop a LLM-based Assistant for Coaching nEgotiation (ACE). ACE not only serves as a negotiation partner for users but also provides them with targeted feedback for improvement. To build our system, we collect a dataset of negotiation transcripts between MBA students. These transcripts come from trained negotiators and emulate realistic bargaining scenarios. We use the dataset, along with expert consultations, to design an annotation scheme for detecting negotiation mistakes. ACE employs this scheme to identify mistakes and provide targeted feedback to users. To test the effectiveness of ACE-generated feedback, we conducted a user experiment with two consecutive trials of negotiation and found that it improves negotiation performances significantly compared to a system that doesn't provide feedback and one which uses an alternative method of providing feedback.
title ACE: A LLM-based Negotiation Coaching System
topic Computation and Language
Human-Computer Interaction
url https://arxiv.org/abs/2410.01555