If They Disagree, Will You Conform? Exploring the Role of Robots' Value Awareness in a Decision-Making Task

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pusceddu, Giulia, Abbo, Giulio Antonio, Rea, Francesco, Belpaeme, Tony, Sciutti, Alessandra
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911587260956672
author Pusceddu, Giulia
Abbo, Giulio Antonio
Rea, Francesco
Belpaeme, Tony
Sciutti, Alessandra
author_facet Pusceddu, Giulia
Abbo, Giulio Antonio
Rea, Francesco
Belpaeme, Tony
Sciutti, Alessandra
contents This study investigates whether the opinions of robotic agents can influence human decision-making when robots display value awareness (i.e., the capability of understanding human preferences and prioritizing them in decision-making). We designed an experiment in which participants interacted with two Furhat robots - one programmed to be Value-Aware and the other Non-Value-Aware - during a labeling task for images representing human values. Results indicate that participants distinguished the Value-Aware robot from the Non-Value-Aware one. Although their explicit choices did not indicate a clear preference for one robot over the other, participants directed their gaze more toward the Value-Aware robot. Additionally, the Value-Aware robot was perceived as more loyal, suggesting that value awareness in a social robot may enhance its perceived commitment to the group. Finally, when both robots disagreed with the participant, conformity occurred in about one out of four trials, and participants took longer to confirm their responses, suggesting that two robots expressing dissent may introduce hesitation in decision-making. On one hand, this highlights the potential risk that robots, if misused, could manipulate users for unethical purposes. On the other hand, it reinforces the idea that social robots could encourage reflection in ambiguous situations and help users avoid scams.
format Preprint
id arxiv_https___arxiv_org_abs_2510_23204
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle If They Disagree, Will You Conform? Exploring the Role of Robots' Value Awareness in a Decision-Making Task
Pusceddu, Giulia
Abbo, Giulio Antonio
Rea, Francesco
Belpaeme, Tony
Sciutti, Alessandra
Robotics
Human-Computer Interaction
This study investigates whether the opinions of robotic agents can influence human decision-making when robots display value awareness (i.e., the capability of understanding human preferences and prioritizing them in decision-making). We designed an experiment in which participants interacted with two Furhat robots - one programmed to be Value-Aware and the other Non-Value-Aware - during a labeling task for images representing human values. Results indicate that participants distinguished the Value-Aware robot from the Non-Value-Aware one. Although their explicit choices did not indicate a clear preference for one robot over the other, participants directed their gaze more toward the Value-Aware robot. Additionally, the Value-Aware robot was perceived as more loyal, suggesting that value awareness in a social robot may enhance its perceived commitment to the group. Finally, when both robots disagreed with the participant, conformity occurred in about one out of four trials, and participants took longer to confirm their responses, suggesting that two robots expressing dissent may introduce hesitation in decision-making. On one hand, this highlights the potential risk that robots, if misused, could manipulate users for unethical purposes. On the other hand, it reinforces the idea that social robots could encourage reflection in ambiguous situations and help users avoid scams.
title If They Disagree, Will You Conform? Exploring the Role of Robots' Value Awareness in a Decision-Making Task
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2510.23204