Saved in:
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.17098 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915471507324928 |
|---|---|
| author | Bhatti, Anubhav Angkan, Prithila Behinaein, Behnam Mahmud, Zunayed Rodenburg, Dirk Braund, Heather Mclellan, P. James Ruberto, Aaron Harrison, Geoffery Wilson, Daryl Szulewski, Adam Howes, Dan Etemad, Ali Hungler, Paul |
| author_facet | Bhatti, Anubhav Angkan, Prithila Behinaein, Behnam Mahmud, Zunayed Rodenburg, Dirk Braund, Heather Mclellan, P. James Ruberto, Aaron Harrison, Geoffery Wilson, Daryl Szulewski, Adam Howes, Dan Etemad, Ali Hungler, Paul |
| contents | We present a novel multimodal dataset for Cognitive Load Assessment in REal-time (CLARE). The dataset contains physiological and gaze data from 24 participants with self-reported cognitive load scores as ground-truth labels. The dataset consists of four modalities, namely, Electrocardiography (ECG), Electrodermal Activity (EDA), Electroencephalogram (EEG), and Gaze tracking. To map diverse levels of mental load on participants during experiments, each participant completed four nine-minutes sessions on a computer-based operator performance and mental workload task (the MATB-II software) with varying levels of complexity in one minute segments. During the experiment, participants reported their cognitive load every 10 seconds. For the dataset, we also provide benchmark binary classification results with machine learning and deep learning models on two different evaluation schemes, namely, 10-fold and leave-one-subject-out (LOSO) cross-validation. Benchmark results show that for 10-fold evaluation, the convolutional neural network (CNN) based deep learning model achieves the best classification performance with ECG, EDA, and Gaze. In contrast, for LOSO, the best performance is achieved by the deep learning model with ECG, EDA, and EEG. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_17098 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CLARE: Cognitive Load Assessment in REaltime with Multimodal Data Bhatti, Anubhav Angkan, Prithila Behinaein, Behnam Mahmud, Zunayed Rodenburg, Dirk Braund, Heather Mclellan, P. James Ruberto, Aaron Harrison, Geoffery Wilson, Daryl Szulewski, Adam Howes, Dan Etemad, Ali Hungler, Paul Human-Computer Interaction Artificial Intelligence We present a novel multimodal dataset for Cognitive Load Assessment in REal-time (CLARE). The dataset contains physiological and gaze data from 24 participants with self-reported cognitive load scores as ground-truth labels. The dataset consists of four modalities, namely, Electrocardiography (ECG), Electrodermal Activity (EDA), Electroencephalogram (EEG), and Gaze tracking. To map diverse levels of mental load on participants during experiments, each participant completed four nine-minutes sessions on a computer-based operator performance and mental workload task (the MATB-II software) with varying levels of complexity in one minute segments. During the experiment, participants reported their cognitive load every 10 seconds. For the dataset, we also provide benchmark binary classification results with machine learning and deep learning models on two different evaluation schemes, namely, 10-fold and leave-one-subject-out (LOSO) cross-validation. Benchmark results show that for 10-fold evaluation, the convolutional neural network (CNN) based deep learning model achieves the best classification performance with ECG, EDA, and Gaze. In contrast, for LOSO, the best performance is achieved by the deep learning model with ECG, EDA, and EEG. |
| title | CLARE: Cognitive Load Assessment in REaltime with Multimodal Data |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2404.17098 |