Saved in:
Bibliographic Details
Main Authors: Sale, Carter, Stolar, Melissa N., Patil, Gaurav, Gostelow, Michael J., Wallier, Julia, Macpherson, Margaret C., Kruger, Jan-Louis, Dras, Mark, Hosking, Simon G., Kallen, Rachel W., Richardson, Michael J.
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.17767
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Real-time cognitive workload monitoring is crucial in safety-critical environments, yet established measures are intrusive, expensive, or lack temporal resolution. We tested whether facial movement dynamics from a standard webcam could provide a low-cost alternative. Seventy-two participants completed a multitasking simulation (OpenMATB) under varied load while facial keypoints were tracked via OpenPose. Linear kinematics (velocity, acceleration, displacement) and recurrence quantification features were extracted. Increasing load altered dynamics across timescales: movement magnitudes rose, temporal organisation fragmented then reorganised into complex patterns, and eye-head coordination weakened. Random forest classifiers trained on pose kinematics outperformed task performance metrics (85% vs. 55% accuracy) but generalised poorly across participants (43% vs. 33% chance). Participant-specific models reached 50% accuracy with minimal calibration (2 minutes per condition), improving continuously to 73% without plateau. Facial movement dynamics sensitively track workload with brief calibration, enabling adaptive interfaces using commodity cameras, though individual differences limit cross-participant generalisation.