Saved in:
| Main Author: | |
|---|---|
| Format: | Recurso digital |
| Language: | |
| Published: |
Zenodo
2024
|
| Online Access: | https://doi.org/10.5281/zenodo.14287285 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Table of Contents:
- <p><strong>How did the data collection work?<br></strong>The goal of the study is to get insights to the usability of the data analysis tool <a href="https://doi.org/10.1145/3670653.3670678">eyenalyzer</a>. Hence the participants complete 6 data analysis tasks using <a href="https://doi.org/10.1145/3670653.3670678">eyenalyzer</a>, while their eye movements are recorded by eye tracking. Note that the tasks are the same as in <a href="https://www.doi.org/10.21125/iceri.2024.0271">this conference paper</a> and the <a href="https://doi.org/10.5281/zenodo.12806804">corresponding data repository</a>, but are broken down into 13 sub-tasks; each task targets one action page in <a href="https://doi.org/10.1145/3670653.3670678">eyenalyzer</a>. After each task, the participants rate the difficulty of the task (on a 7-point Likert scale); after completing all tasks, they fill out a questionnaire on their demographic data as well as the two validated questionnaires <em>System Usability Scale</em> (SUS) and <em>User Experience Questionnaire</em> (UEQ). The submitted solutions are later checked for correctness; the answers to SUS and UEQ are transformed into scores. The manual rewatching of the eye tracking recordings gives the navgiation methods applied for switchting between the tasks or action pages of <a href="https://doi.org/10.1145/3670653.3670678">eyenalyzer</a> as well as the handling of dialog boxes and info fields (i.e. to what extent they are read and whether or not the trigger a positive reaction or not). Further details on the procedure will be found in a soon to be published conference paper.</p> <p><strong>What data is provided?<br></strong>In this repository you can find both the data obtained from 41 participants (i.e., folder <code>data.zip</code>) and a german replication package (i.e., folder <code>material.zip</code>). </p> <ol> <li>The data file <code>data/performance.xlsx</code> comprises 9 columns and 533 rows. Each row represents one combination of participant and sub-task. The columns are: <ul> <li><code>participant</code> the current subject as a unique identifier from {P01, ..., P41}</li> <li><code>task</code> the current sub-task as one of {1A, 1B, 1C, 2A, 2B, 3A, 3B, 3C, 4A, 4B, 5A, 5B, 6}</li> <li><code>score</code> the grading of the current task for the current participant as one of {not completed, wrong, borderline, acceptable, correct}</li> <li><code>time</code> time used by the current participant for the current task in milliseconds</li> <li><code>clicks</code> the number of mouse clicks used by the current participant for the current task</li> <li><code>keys</code> the number of keys pressed on the keyboard by the current participant for the current task</li> <li><code>difficulty</code> difficulty estimate of the current participant for the current task as one of {very difficult, difficult, rather difficult, indecisive, rather easy, easy, very easy}</li> </ul> </li> <li>The data file <code>data/questionnaire.xlsx</code> comprises 18 columns and 41 rows. Each row belongs to one participant. The columns are:<br> <ul> <li><code>participant</code> the current subject as a unique identifier from {P01, ..., P41}</li> <li><code>age</code> age of the current participant in years</li> <li><code>gender</code> gender of the current participant as one of {male, female}</li> <li><code>experience_programming</code> previous experience of the current participant in programming as one of {none, little, indecisive, some, much}</li> <li><code>experience_data_science</code> previous experience of the current participant in data science as one of {none, little, indecisive, some, much}</li> <li><code>experience_experimental_research</code> previous experience of the current participant in experimental research as one of {none, little, indecisive, some, much}</li> <li><code>experience_statistics</code> previous experience of the current participant in statistics as one of {none, little, indecisive, some, much}</li> <li><code>background</code> the occupation of the current participant as one of {bachelor student, master student, phd student, job}</li> <li><code>field</code> the field of study or work of the current participant as one of {social sciences, computer science and mathematics, technology and engineering, economy and law, art and design and music, other}</li> <li><code>SUS</code> the SUS-score obtained by the current participant </li> <li><code>attractiveness</code> the score on the UEQ-scale attractiveness obtained by the current participant</li> <li><code>perspicuity</code> the score on the UEQ-scale perspicuity obtained by the current participant</li> <li><code>novelty</code> the score on the UEQ-scale novelty obtained by the current participant</li> <li><code>stimulation</code> the score on the UEQ-scale stimulation obtained by the current participant</li> <li><code>dependability</code> the score on the UEQ-scale dependability obtained by the current participant</li> <li><code>efficiency</code> the score on the UEQ-scale efficiency obtained by the current participant</li> <li><code>pragmatic_quality</code> the mean score of the pragmatic UEQ-scales for the current participant (i.e. perspicuity, dependability, and efficiency)</li> <li><code>hedonic_quality</code> the mean score of the pragmatic UEQ-scales for the current participant (i.e. stimulation and novelty)</li> </ul> </li> <li>The data file <code>data/navigation_method.xlsx</code> comprises 3 columns and 246 rows. Each row represents one combination of participant and task. The columns are: <ul> <li><code>participant</code> the current participant as a unique identifier from {P01, ..., P41}</li> <li><code>task</code> the current task as one of {T1, T2, T3, T4, T5, T6}</li> <li><code>method</code> the navigation method used by the current participant to switch to the proper action page for the current task as one of {navigation bar, landing page link}</li> </ul> </li> <li>The data file <code>data/dialog_boxes.xlsx</code> comprises 5 columns and 546 rows. Each row belongs to one dialog box triggering. The columns are: <ul> <li><code>participant</code> the current participant as a unique identifier from {P01, ..., P41}</li> <li><code>task</code> the current sub-task as one of {1A, 1B, 1C, 2A, 2B, 3A, 3B, 3C, 4A, 4B, 5A, 5B, 6}</li> <li><code>id</code> the triggered dialog box as a unique identifier from {1, ..., 20}</li> <li><code>reading</code> the degree of reading of the current dialog box by the current participant as one of {yes, partial, no}</li> <li><code>reaction</code> the reaction on the current dialog box by the current participant as one of {good, bad, ignored, consecutive}</li> </ul> </li> <li>The data file <code>data/info_fields.xlsx</code> comprises 5 columns and 166 rows. Each row belongs to one info field triggering. The columns are: <ul> <li><code>participant</code> the current participant as a unique identifier from {P01, ..., P41}</li> <li><code>task</code> the current sub-task as one of {1A, 1B, 1C, 2A, 2B, 3A, 3B, 3C, 4A, 4B, 5A, 5B, 6}</li> <li><code>id</code> the triggered dialog box as a unique identifier from {1, ..., 48}</li> <li><code>reading</code> the degree of reading of the current info field by the current participant as one of {yes, partial, no}</li> <li><code>reaction</code> the reaction on the current info field by the current participant as one of {good, bad, irrelevant}</li> </ul> </li> <li>The replication folder <code>material.zip</code> comprises three files and one subfolder with the following material:<br> <ul> <li><code>primer.pdf</code> information material on statistics provided to the participants</li> <li><code>stimuli.pdf</code> the stimuli used in the eye tracking set up (calibration and the work with <a href="https://doi.org/10.1145/3670653.3670678">eyenalyzer</a> is denoted by dummy slides)</li> <li><code>data/</code> a directory containing the 4 data files needed to complete the tasks (based on the data from <a href="https://doi.org/10.5281/zenodo.7241097">this repository</a>)</li> <li><code>questionnaire.pdf</code> a transcription of the demographic questionnaire</li> </ul> </li> </ol> <p><strong>Do you have further questions?</strong><br>For more information, please feel free to contact <lisa.grabinger@oth-regensburg.de>.</p>