Motion as Emotion: Detecting Affect and Cognitive Load from Free-Hand Gestures in VR
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913508398989312 |
|---|---|
| author | Chua, Phoebe Sasikumar, Prasanth Weerasinghe, Yadeesha Nanayakkara, Suranga |
| author_facet | Chua, Phoebe Sasikumar, Prasanth Weerasinghe, Yadeesha Nanayakkara, Suranga |
| contents | Affect and cognitive load influence many user behaviors. In this paper, we propose Motion as Emotion, a novel method that utilizes fine differences in hand motion to recognise affect and cognitive load in virtual reality (VR). We conducted a study with 22 participants who used common free-hand gesture interactions to carry out tasks of varying difficulty in VR environments. We find that the affect and cognitive load induced by tasks are associated with significant differences in gesture features such as speed, distance and hand tension. Standard support vector classification (SVC) models could accurately predict two levels (low, high) of valence, arousal and cognitive load from these features. Our results demonstrate the potential of Motion as Emotion as an accurate and reliable method of inferring user affect and cognitive load from free-hand gestures, without needing any additional wearable sensors or modifications to a standard VR headset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_12921 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Motion as Emotion: Detecting Affect and Cognitive Load from Free-Hand Gestures in VR Chua, Phoebe Sasikumar, Prasanth Weerasinghe, Yadeesha Nanayakkara, Suranga Human-Computer Interaction Affect and cognitive load influence many user behaviors. In this paper, we propose Motion as Emotion, a novel method that utilizes fine differences in hand motion to recognise affect and cognitive load in virtual reality (VR). We conducted a study with 22 participants who used common free-hand gesture interactions to carry out tasks of varying difficulty in VR environments. We find that the affect and cognitive load induced by tasks are associated with significant differences in gesture features such as speed, distance and hand tension. Standard support vector classification (SVC) models could accurately predict two levels (low, high) of valence, arousal and cognitive load from these features. Our results demonstrate the potential of Motion as Emotion as an accurate and reliable method of inferring user affect and cognitive load from free-hand gestures, without needing any additional wearable sensors or modifications to a standard VR headset. |
| title | Motion as Emotion: Detecting Affect and Cognitive Load from Free-Hand Gestures in VR |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2409.12921 |