Better Assumptions, Stronger Conclusions: The Case for Ordinal Regression in HCI

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Syiem, Brandon Victor, Velloso, Eduardo
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914341900517376
author Syiem, Brandon Victor
Velloso, Eduardo
author_facet Syiem, Brandon Victor
Velloso, Eduardo
contents Despite the widespread use of ordinal measures in HCI, such as Likert-items, there is little consensus among HCI researchers on the statistical methods used for analysing such data. Both parametric and non-parametric methods have been extensively used within the discipline, with limited reflection on their assumptions and appropriateness for such analyses. In this paper, we examine recent HCI works that report statistical analyses of ordinal measures. We highlight prevalent methods used, discuss their limitations and spotlight key assumptions and oversights that diminish the insights drawn from these methods. Finally, we champion and detail the use of cumulative link (mixed) models (CLM/CLMM) for analysing ordinal data. Further, we provide practical worked examples of applying CLM/CLMMs using R to published open-sourced datasets. This work contributes towards a better understanding of the statistical methods used to analyse ordinal data in HCI and helps to consolidate practices for future work.
format Preprint
id arxiv_https___arxiv_org_abs_2602_18660
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Better Assumptions, Stronger Conclusions: The Case for Ordinal Regression in HCI
Syiem, Brandon Victor
Velloso, Eduardo
Methodology
Human-Computer Interaction
Despite the widespread use of ordinal measures in HCI, such as Likert-items, there is little consensus among HCI researchers on the statistical methods used for analysing such data. Both parametric and non-parametric methods have been extensively used within the discipline, with limited reflection on their assumptions and appropriateness for such analyses. In this paper, we examine recent HCI works that report statistical analyses of ordinal measures. We highlight prevalent methods used, discuss their limitations and spotlight key assumptions and oversights that diminish the insights drawn from these methods. Finally, we champion and detail the use of cumulative link (mixed) models (CLM/CLMM) for analysing ordinal data. Further, we provide practical worked examples of applying CLM/CLMMs using R to published open-sourced datasets. This work contributes towards a better understanding of the statistical methods used to analyse ordinal data in HCI and helps to consolidate practices for future work.
title Better Assumptions, Stronger Conclusions: The Case for Ordinal Regression in HCI
topic Methodology
Human-Computer Interaction
url https://arxiv.org/abs/2602.18660