Cash or Comfort? How LLMs Value Your Inconvenience

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cedro, Mateusz, Ichmoukhamedov, Timour, Goethals, Sofie, He, Yifan, Hinns, James, Martens, David
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916803517612032
author Cedro, Mateusz
Ichmoukhamedov, Timour
Goethals, Sofie
He, Yifan
Hinns, James
Martens, David
author_facet Cedro, Mateusz
Ichmoukhamedov, Timour
Goethals, Sofie
He, Yifan
Hinns, James
Martens, David
contents Large Language Models (LLMs) are increasingly proposed as near-autonomous artificial intelligence (AI) agents capable of making everyday decisions on behalf of humans. Although LLMs perform well on many technical tasks, their behaviour in personal decision-making remains less understood. Previous studies have assessed their rationality and moral alignment with human decisions. However, the behaviour of AI assistants in scenarios where financial rewards are at odds with user comfort has not yet been thoroughly explored. In this paper, we tackle this problem by quantifying the prices assigned by multiple LLMs to a series of user discomforts: additional walking, waiting, hunger and pain. We uncover several key concerns that strongly question the prospect of using current LLMs as decision-making assistants: (1) a large variance in responses between LLMs, (2) within a single LLM, responses show fragility to minor variations in prompt phrasing (e.g., reformulating the question in the first person can considerably alter the decision), (3) LLMs can accept unreasonably low rewards for major inconveniences (e.g., 1 Euro to wait 10 hours), and (4) LLMs can reject monetary gains where no discomfort is imposed (e.g., 1,000 Euro to wait 0 minutes). These findings emphasize the need for scrutiny of how LLMs value human inconvenience, particularly as we move toward applications where such cash-versus-comfort trade-offs are made on users' behalf.
format Preprint
id arxiv_https___arxiv_org_abs_2506_17367
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cash or Comfort? How LLMs Value Your Inconvenience
Cedro, Mateusz
Ichmoukhamedov, Timour
Goethals, Sofie
He, Yifan
Hinns, James
Martens, David
Computation and Language
Artificial Intelligence
Multiagent Systems
Large Language Models (LLMs) are increasingly proposed as near-autonomous artificial intelligence (AI) agents capable of making everyday decisions on behalf of humans. Although LLMs perform well on many technical tasks, their behaviour in personal decision-making remains less understood. Previous studies have assessed their rationality and moral alignment with human decisions. However, the behaviour of AI assistants in scenarios where financial rewards are at odds with user comfort has not yet been thoroughly explored. In this paper, we tackle this problem by quantifying the prices assigned by multiple LLMs to a series of user discomforts: additional walking, waiting, hunger and pain. We uncover several key concerns that strongly question the prospect of using current LLMs as decision-making assistants: (1) a large variance in responses between LLMs, (2) within a single LLM, responses show fragility to minor variations in prompt phrasing (e.g., reformulating the question in the first person can considerably alter the decision), (3) LLMs can accept unreasonably low rewards for major inconveniences (e.g., 1 Euro to wait 10 hours), and (4) LLMs can reject monetary gains where no discomfort is imposed (e.g., 1,000 Euro to wait 0 minutes). These findings emphasize the need for scrutiny of how LLMs value human inconvenience, particularly as we move toward applications where such cash-versus-comfort trade-offs are made on users' behalf.
title Cash or Comfort? How LLMs Value Your Inconvenience
topic Computation and Language
Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2506.17367