Detecting Winning Arguments with Large Language Models and Persuasion Strategies

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Labruna, Tiziano, Modzelewski, Arkadiusz, Satta, Giorgio, Martino, Giovanni Da San
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912826528890880
author Labruna, Tiziano
Modzelewski, Arkadiusz
Satta, Giorgio
Martino, Giovanni Da San
author_facet Labruna, Tiziano
Modzelewski, Arkadiusz
Satta, Giorgio
Martino, Giovanni Da San
contents Detecting persuasion in argumentative text is a challenging task with important implications for understanding human communication. This work investigates the role of persuasion strategies - such as Attack on reputation, Distraction, and Manipulative wording - in determining the persuasiveness of a text. We conduct experiments on three annotated argument datasets: Winning Arguments (built from the Change My View subreddit), Anthropic/Persuasion, and Persuasion for Good. Our approach leverages large language models (LLMs) with a Multi-Strategy Persuasion Scoring approach that guides reasoning over six persuasion strategies. Results show that strategy-guided reasoning improves the prediction of persuasiveness. To better understand the influence of content, we organize the Winning Argument dataset into broad discussion topics and analyze performance across them. We publicly release this topic-annotated version of the dataset to facilitate future research. Overall, our methodology demonstrates the value of structured, strategy-aware prompting for enhancing interpretability and robustness in argument quality assessment.
format Preprint
id arxiv_https___arxiv_org_abs_2601_10660
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Detecting Winning Arguments with Large Language Models and Persuasion Strategies
Labruna, Tiziano
Modzelewski, Arkadiusz
Satta, Giorgio
Martino, Giovanni Da San
Computation and Language
Detecting persuasion in argumentative text is a challenging task with important implications for understanding human communication. This work investigates the role of persuasion strategies - such as Attack on reputation, Distraction, and Manipulative wording - in determining the persuasiveness of a text. We conduct experiments on three annotated argument datasets: Winning Arguments (built from the Change My View subreddit), Anthropic/Persuasion, and Persuasion for Good. Our approach leverages large language models (LLMs) with a Multi-Strategy Persuasion Scoring approach that guides reasoning over six persuasion strategies. Results show that strategy-guided reasoning improves the prediction of persuasiveness. To better understand the influence of content, we organize the Winning Argument dataset into broad discussion topics and analyze performance across them. We publicly release this topic-annotated version of the dataset to facilitate future research. Overall, our methodology demonstrates the value of structured, strategy-aware prompting for enhancing interpretability and robustness in argument quality assessment.
title Detecting Winning Arguments with Large Language Models and Persuasion Strategies
topic Computation and Language
url https://arxiv.org/abs/2601.10660