Inferring trust in recommendation systems from brain, behavioural, and physiological data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cheung, Vincent K. M., Shih, Pei-Cheng, Hirano, Masato, Goto, Masataka, Furuya, Shinichi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908622574845952
author Cheung, Vincent K. M.
Shih, Pei-Cheng
Hirano, Masato
Goto, Masataka
Furuya, Shinichi
author_facet Cheung, Vincent K. M.
Shih, Pei-Cheng
Hirano, Masato
Goto, Masataka
Furuya, Shinichi
contents As people nowadays increasingly rely on artificial intelligence (AI) to curate information and make decisions, assigning the appropriate amount of trust in automated intelligent systems has become ever more important. However, current measurements of trust in automation still largely rely on self-reports that are subjective and disruptive to the user. Here, we take music recommendation as a model to investigate the neural and cognitive processes underlying trust in automation. We observed that system accuracy was directly related to users' trust and modulated the influence of recommendation cues on music preference. Modelling users' reward encoding process with a reinforcement learning model further revealed that system accuracy, expected reward, and prediction error were related to oscillatory neural activity recorded via EEG and changes in pupil diameter. Our results provide a neurally grounded account of calibrating trust in automation and highlight the promises of a multimodal approach towards developing trustable AI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2510_27272
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Inferring trust in recommendation systems from brain, behavioural, and physiological data
Cheung, Vincent K. M.
Shih, Pei-Cheng
Hirano, Masato
Goto, Masataka
Furuya, Shinichi
Human-Computer Interaction
Audio and Speech Processing
Signal Processing
As people nowadays increasingly rely on artificial intelligence (AI) to curate information and make decisions, assigning the appropriate amount of trust in automated intelligent systems has become ever more important. However, current measurements of trust in automation still largely rely on self-reports that are subjective and disruptive to the user. Here, we take music recommendation as a model to investigate the neural and cognitive processes underlying trust in automation. We observed that system accuracy was directly related to users' trust and modulated the influence of recommendation cues on music preference. Modelling users' reward encoding process with a reinforcement learning model further revealed that system accuracy, expected reward, and prediction error were related to oscillatory neural activity recorded via EEG and changes in pupil diameter. Our results provide a neurally grounded account of calibrating trust in automation and highlight the promises of a multimodal approach towards developing trustable AI systems.
title Inferring trust in recommendation systems from brain, behavioural, and physiological data
topic Human-Computer Interaction
Audio and Speech Processing
Signal Processing
url https://arxiv.org/abs/2510.27272