Auto Detecting Cognitive Events Using Machine Learning on Pupillary Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dang, Quang, Kucukosmanoglu, Murat, Anoruo, Michael, Kargosha, Golshan, Conklin, Sarah, Brooks, Justin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914978153365504
author Dang, Quang
Kucukosmanoglu, Murat
Anoruo, Michael
Kargosha, Golshan
Conklin, Sarah
Brooks, Justin
author_facet Dang, Quang
Kucukosmanoglu, Murat
Anoruo, Michael
Kargosha, Golshan
Conklin, Sarah
Brooks, Justin
contents Assessing cognitive workload is crucial for human performance as it affects information processing, decision making, and task execution. Pupil size is a valuable indicator of cognitive workload, reflecting changes in attention and arousal governed by the autonomic nervous system. Cognitive events are closely linked to cognitive workload as they activate mental processes and trigger cognitive responses. This study explores the potential of using machine learning to automatically detect cognitive events experienced using individuals. We framed the problem as a binary classification task, focusing on detecting stimulus onset across four cognitive tasks using CNN models and 1-second pupillary data. The results, measured by Matthew's correlation coefficient, ranged from 0.47 to 0.80, depending on the cognitive task. This paper discusses the trade-offs between generalization and specialization, model behavior when encountering unseen stimulus onset times, structural variances among cognitive tasks, factors influencing model predictions, and real-time simulation. These findings highlight the potential of machine learning techniques in detecting cognitive events based on pupil and eye movement responses, contributing to advancements in personalized learning and optimizing neurocognitive workload management.
format Preprint
id arxiv_https___arxiv_org_abs_2410_14174
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Auto Detecting Cognitive Events Using Machine Learning on Pupillary Data
Dang, Quang
Kucukosmanoglu, Murat
Anoruo, Michael
Kargosha, Golshan
Conklin, Sarah
Brooks, Justin
Machine Learning
Human-Computer Interaction
Neurons and Cognition
Assessing cognitive workload is crucial for human performance as it affects information processing, decision making, and task execution. Pupil size is a valuable indicator of cognitive workload, reflecting changes in attention and arousal governed by the autonomic nervous system. Cognitive events are closely linked to cognitive workload as they activate mental processes and trigger cognitive responses. This study explores the potential of using machine learning to automatically detect cognitive events experienced using individuals. We framed the problem as a binary classification task, focusing on detecting stimulus onset across four cognitive tasks using CNN models and 1-second pupillary data. The results, measured by Matthew's correlation coefficient, ranged from 0.47 to 0.80, depending on the cognitive task. This paper discusses the trade-offs between generalization and specialization, model behavior when encountering unseen stimulus onset times, structural variances among cognitive tasks, factors influencing model predictions, and real-time simulation. These findings highlight the potential of machine learning techniques in detecting cognitive events based on pupil and eye movement responses, contributing to advancements in personalized learning and optimizing neurocognitive workload management.
title Auto Detecting Cognitive Events Using Machine Learning on Pupillary Data
topic Machine Learning
Human-Computer Interaction
Neurons and Cognition
url https://arxiv.org/abs/2410.14174