Saved in:
Bibliographic Details
Main Authors: Banerjee, Tanushree, Zhu, Richard, Yang, Runzhe, Narasimhan, Karthik
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.13915
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929474168160256
author Banerjee, Tanushree
Zhu, Richard
Yang, Runzhe
Narasimhan, Karthik
author_facet Banerjee, Tanushree
Zhu, Richard
Yang, Runzhe
Narasimhan, Karthik
contents Large Language Models (LLMs) excel at generating human-like dialogues and comprehending text. However, understanding the subtleties of complex exchanges in language remains a challenge. We propose a bootstrapping framework that leverages self-generated feedback to enhance LLM reasoning capabilities for lie detection. The framework consists of three stages: suggestion, feedback collection, and modification. In the suggestion stage, a cost-effective language model generates initial predictions based on game state and dialogue. The feedback-collection stage involves a language model providing feedback on these predictions. In the modification stage, a more advanced language model refines the initial predictions using the auto-generated feedback. We investigate the application of the proposed framework for detecting betrayal and deception in Diplomacy games, and compare it with feedback from professional human players. The LLM-generated feedback exhibits superior quality and significantly enhances the performance of the model. Our approach achieves a 39% improvement over the zero-shot baseline in lying-F1 without the need for any training data, rivaling state-of-the-art supervised learning results.
format Preprint
id arxiv_https___arxiv_org_abs_2408_13915
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle LLMs are Superior Feedback Providers: Bootstrapping Reasoning for Lie Detection with Self-Generated Feedback
Banerjee, Tanushree
Zhu, Richard
Yang, Runzhe
Narasimhan, Karthik
Computation and Language
Artificial Intelligence
Large Language Models (LLMs) excel at generating human-like dialogues and comprehending text. However, understanding the subtleties of complex exchanges in language remains a challenge. We propose a bootstrapping framework that leverages self-generated feedback to enhance LLM reasoning capabilities for lie detection. The framework consists of three stages: suggestion, feedback collection, and modification. In the suggestion stage, a cost-effective language model generates initial predictions based on game state and dialogue. The feedback-collection stage involves a language model providing feedback on these predictions. In the modification stage, a more advanced language model refines the initial predictions using the auto-generated feedback. We investigate the application of the proposed framework for detecting betrayal and deception in Diplomacy games, and compare it with feedback from professional human players. The LLM-generated feedback exhibits superior quality and significantly enhances the performance of the model. Our approach achieves a 39% improvement over the zero-shot baseline in lying-F1 without the need for any training data, rivaling state-of-the-art supervised learning results.
title LLMs are Superior Feedback Providers: Bootstrapping Reasoning for Lie Detection with Self-Generated Feedback
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2408.13915