When an AI Judges Your Work: The Hidden Costs of Algorithmic Assessment
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915828850491392 |
|---|---|
| author | Almog, David Lippman, Lucas Martin, Daniel |
| author_facet | Almog, David Lippman, Lucas Martin, Daniel |
| contents | We use an online experiment with a real work task to study whether workers change their behavior when they know AI will be used to judge their work instead of humans. We find that individuals produce a higher quantity of output when they are assigned an AI evaluator. However, controlling for quantity, the quality of their output is lower, regardless of whether quality is measured using humans or LLM grades. We also find that workers are more likely to use external tools, including LLMs, when they know AI is used to judge their work instead of humans. However, the increase in external tool use does not appear to explain the differences in quantity or quality across treatments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_02076 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | When an AI Judges Your Work: The Hidden Costs of Algorithmic Assessment Almog, David Lippman, Lucas Martin, Daniel General Economics Economics Human-Computer Interaction We use an online experiment with a real work task to study whether workers change their behavior when they know AI will be used to judge their work instead of humans. We find that individuals produce a higher quantity of output when they are assigned an AI evaluator. However, controlling for quantity, the quality of their output is lower, regardless of whether quality is measured using humans or LLM grades. We also find that workers are more likely to use external tools, including LLMs, when they know AI is used to judge their work instead of humans. However, the increase in external tool use does not appear to explain the differences in quantity or quality across treatments. |
| title | When an AI Judges Your Work: The Hidden Costs of Algorithmic Assessment |
| topic | General Economics Economics Human-Computer Interaction |
| url | https://arxiv.org/abs/2603.02076 |