Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914861828538368 |
|---|---|
| author | Schneider, Johannes Flores, Arianna Casanova Kranz, Anne-Catherine |
| author_facet | Schneider, Johannes Flores, Arianna Casanova Kranz, Anne-Catherine |
| contents | This study explores real-world human interactions with large language models (LLMs) in diverse, unconstrained settings in contrast to most prior research focusing on ethically trimmed models like ChatGPT for specific tasks. We aim to understand the originator of toxicity. Our findings show that although LLMs are rightfully accused of providing toxic content, it is mostly demanded or at least provoked by humans who actively seek such content. Our manual analysis of hundreds of conversations judged as toxic by APIs commercial vendors, also raises questions with respect to current practices of what user requests are refused to answer. Furthermore, we conjecture based on multiple empirical indicators that humans exhibit a change of their mental model, switching from the mindset of interacting with a machine more towards interacting with a human. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_05977 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity Schneider, Johannes Flores, Arianna Casanova Kranz, Anne-Catherine Human-Computer Interaction Artificial Intelligence This study explores real-world human interactions with large language models (LLMs) in diverse, unconstrained settings in contrast to most prior research focusing on ethically trimmed models like ChatGPT for specific tasks. We aim to understand the originator of toxicity. Our findings show that although LLMs are rightfully accused of providing toxic content, it is mostly demanded or at least provoked by humans who actively seek such content. Our manual analysis of hundreds of conversations judged as toxic by APIs commercial vendors, also raises questions with respect to current practices of what user requests are refused to answer. Furthermore, we conjecture based on multiple empirical indicators that humans exhibit a change of their mental model, switching from the mindset of interacting with a machine more towards interacting with a human. |
| title | Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2407.05977 |