Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910759373504512 |
|---|---|
| author | Jones, Cameron R. Bergen, Benjamin K. |
| author_facet | Jones, Cameron R. Bergen, Benjamin K. |
| contents | Large Language Models (LLMs) can generate content that is as persuasive as human-written text and appear capable of selectively producing deceptive outputs. These capabilities raise concerns about potential misuse and unintended consequences as these systems become more widely deployed. This review synthesizes recent empirical work examining LLMs' capacity and proclivity for persuasion and deception, analyzes theoretical risks that could arise from these capabilities, and evaluates proposed mitigations. While current persuasive effects are relatively small, various mechanisms could increase their impact, including fine-tuning, multimodality, and social factors. We outline key open questions for future research, including how persuasive AI systems might become, whether truth enjoys an inherent advantage over falsehoods, and how effective different mitigation strategies may be in practice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_17128 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models Jones, Cameron R. Bergen, Benjamin K. Computation and Language Computers and Society Human-Computer Interaction 68T50 K.4.0; I.2.7; H.5.2 Large Language Models (LLMs) can generate content that is as persuasive as human-written text and appear capable of selectively producing deceptive outputs. These capabilities raise concerns about potential misuse and unintended consequences as these systems become more widely deployed. This review synthesizes recent empirical work examining LLMs' capacity and proclivity for persuasion and deception, analyzes theoretical risks that could arise from these capabilities, and evaluates proposed mitigations. While current persuasive effects are relatively small, various mechanisms could increase their impact, including fine-tuning, multimodality, and social factors. We outline key open questions for future research, including how persuasive AI systems might become, whether truth enjoys an inherent advantage over falsehoods, and how effective different mitigation strategies may be in practice. |
| title | Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models |
| topic | Computation and Language Computers and Society Human-Computer Interaction 68T50 K.4.0; I.2.7; H.5.2 |
| url | https://arxiv.org/abs/2412.17128 |