Card Sorting with Fewer Cards and the Same Mental Models? A Re-examination of an Established Practice

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kuric, Eduard, Demcak, Peter, Krajcovic, Matus
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912810454220800
author Kuric, Eduard
Demcak, Peter
Krajcovic, Matus
author_facet Kuric, Eduard
Demcak, Peter
Krajcovic, Matus
contents To keep card sorting with a lot of cards concise, a common strategy for gauging mental models involves presenting participants with fewer randomly selected cards instead of the full set. This is a decades-old practice, but its effects lacked systematic examination. To assess how randomized subsets affect data, we conducted an experiment with 160 participants. We compared results between full and randomized 60\% card sets, then analyzed sample size requirements and the impacts of individual personality and cognitive factors. Our results demonstrate that randomized subsets can yield comparable similarity matrices to standard card sorting, but thematic patterns in categories can differ. Increased data variability also warrants larger sample sizes (25-35 for 60% card subset). Results indicate that personality traits and cognitive reflection interact with card sorting. Our research suggests evidence-based practices for conducting card sorting while exposing the influence of study design and individual differences on measurement of mental models.
format Preprint
id arxiv_https___arxiv_org_abs_2509_03232
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Card Sorting with Fewer Cards and the Same Mental Models? A Re-examination of an Established Practice
Kuric, Eduard
Demcak, Peter
Krajcovic, Matus
Human-Computer Interaction
H.5
To keep card sorting with a lot of cards concise, a common strategy for gauging mental models involves presenting participants with fewer randomly selected cards instead of the full set. This is a decades-old practice, but its effects lacked systematic examination. To assess how randomized subsets affect data, we conducted an experiment with 160 participants. We compared results between full and randomized 60\% card sets, then analyzed sample size requirements and the impacts of individual personality and cognitive factors. Our results demonstrate that randomized subsets can yield comparable similarity matrices to standard card sorting, but thematic patterns in categories can differ. Increased data variability also warrants larger sample sizes (25-35 for 60% card subset). Results indicate that personality traits and cognitive reflection interact with card sorting. Our research suggests evidence-based practices for conducting card sorting while exposing the influence of study design and individual differences on measurement of mental models.
title Card Sorting with Fewer Cards and the Same Mental Models? A Re-examination of an Established Practice
topic Human-Computer Interaction
H.5
url https://arxiv.org/abs/2509.03232