The Illusion of Performance: The Effect of Phantom Display Refresh Rates on User Expectations and Reaction Times

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Bosch, Esther, Welsch, Robin, Ayach, Tamim, Katins, Christopher, Kosch, Thomas
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911804129542144
author Bosch, Esther
Welsch, Robin
Ayach, Tamim
Katins, Christopher
Kosch, Thomas
author_facet Bosch, Esther
Welsch, Robin
Ayach, Tamim
Katins, Christopher
Kosch, Thomas
contents User expectations impact the evaluation of new interactive systems. Increased expectations may enhance the perceived effectiveness of interfaces in user studies, similar to a placebo effect observed in medical studies. To showcase the placebo effect, we conducted a user study with 18 participants who performed a target selection reaction time test with two different display refresh rates. Participants saw a stated screen refresh rate before every condition, which corresponded to the true refresh rate only in half of the conditions and was lower or higher in the other half. Results revealed successful priming, as participants believed in superior or inferior performance based on the narrative despite using the opposite refresh rate. Post-experiment questionnaires confirmed participants still held onto the initial narrative. Interestingly, the objective performance remained unchanged between both refresh rates. We discuss how study narratives influence subjective measures and suggest strategies to mitigate placebo effects in user-centered study designs.
format Preprint
id arxiv_https___arxiv_org_abs_2401_17706
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Illusion of Performance: The Effect of Phantom Display Refresh Rates on User Expectations and Reaction Times
Bosch, Esther
Welsch, Robin
Ayach, Tamim
Katins, Christopher
Kosch, Thomas
Human-Computer Interaction
User expectations impact the evaluation of new interactive systems. Increased expectations may enhance the perceived effectiveness of interfaces in user studies, similar to a placebo effect observed in medical studies. To showcase the placebo effect, we conducted a user study with 18 participants who performed a target selection reaction time test with two different display refresh rates. Participants saw a stated screen refresh rate before every condition, which corresponded to the true refresh rate only in half of the conditions and was lower or higher in the other half. Results revealed successful priming, as participants believed in superior or inferior performance based on the narrative despite using the opposite refresh rate. Post-experiment questionnaires confirmed participants still held onto the initial narrative. Interestingly, the objective performance remained unchanged between both refresh rates. We discuss how study narratives influence subjective measures and suggest strategies to mitigate placebo effects in user-centered study designs.
title The Illusion of Performance: The Effect of Phantom Display Refresh Rates on User Expectations and Reaction Times
topic Human-Computer Interaction
url https://arxiv.org/abs/2401.17706