Users Favor LLM-Generated Content -- Until They Know It's AI
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916658255233024 |
|---|---|
| author | Parshakov, Petr Naidenova, Iuliia Paklina, Sofia Matkin, Nikita Nesseler, Cornel |
| author_facet | Parshakov, Petr Naidenova, Iuliia Paklina, Sofia Matkin, Nikita Nesseler, Cornel |
| contents | In this paper, we investigate how individuals evaluate human and large langue models generated responses to popular questions when the source of the content is either concealed or disclosed. Through a controlled field experiment, participants were presented with a set of questions, each accompanied by a response generated by either a human or an AI. In a randomized design, half of the participants were informed of the response's origin while the other half remained unaware. Our findings indicate that, overall, participants tend to prefer AI-generated responses. However, when the AI origin is revealed, this preference diminishes significantly, suggesting that evaluative judgments are influenced by the disclosure of the response's provenance rather than solely by its quality. These results underscore a bias against AI-generated content, highlighting the societal challenge of improving the perception of AI work in contexts where quality assessments should be paramount. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_16458 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Users Favor LLM-Generated Content -- Until They Know It's AI Parshakov, Petr Naidenova, Iuliia Paklina, Sofia Matkin, Nikita Nesseler, Cornel Human-Computer Interaction Machine Learning General Economics Economics In this paper, we investigate how individuals evaluate human and large langue models generated responses to popular questions when the source of the content is either concealed or disclosed. Through a controlled field experiment, participants were presented with a set of questions, each accompanied by a response generated by either a human or an AI. In a randomized design, half of the participants were informed of the response's origin while the other half remained unaware. Our findings indicate that, overall, participants tend to prefer AI-generated responses. However, when the AI origin is revealed, this preference diminishes significantly, suggesting that evaluative judgments are influenced by the disclosure of the response's provenance rather than solely by its quality. These results underscore a bias against AI-generated content, highlighting the societal challenge of improving the perception of AI work in contexts where quality assessments should be paramount. |
| title | Users Favor LLM-Generated Content -- Until They Know It's AI |
| topic | Human-Computer Interaction Machine Learning General Economics Economics |
| url | https://arxiv.org/abs/2503.16458 |