A multimodal stress detection dataset with facial expressions and physiological signals

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hosseini, Majid, Sohrab, Fahad, Gottumukkala, Raju, Bhupatiraju, Ravi Teja, Katragadda, Satya, Raitoharju, Jenni, Iosifidis, Alexandros, Gabbouj, Moncef
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915504934879232
author Hosseini, Majid
Sohrab, Fahad
Gottumukkala, Raju
Bhupatiraju, Ravi Teja
Katragadda, Satya
Raitoharju, Jenni
Iosifidis, Alexandros
Gabbouj, Moncef
author_facet Hosseini, Majid
Sohrab, Fahad
Gottumukkala, Raju
Bhupatiraju, Ravi Teja
Katragadda, Satya
Raitoharju, Jenni
Iosifidis, Alexandros
Gabbouj, Moncef
contents Affective computing has garnered the attention and interest of researchers in recent years, as there is a need for AI systems to better understand and react to human emotions. However, analyzing human emotions, such as mood or stress, is quite complex. While various stress studies use facial expressions and wearables, most existing datasets rely on processing data from a single modality. This paper presents EmpathicSchool, a novel dataset that captures facial expressions and the associated physiological signals, such as heart rate, electrodermal activity, and skin temperature, under different stress levels. The data was collected from 30 participants during different sessions for about ninety minutes each (for a total of 40 hours). The data includes seven different signal types, including both computer vision and physiological features that can be used to detect stress. In addition, various experiments were conducted to validate the signal quality.
format Preprint
id arxiv_https___arxiv_org_abs_2209_13542
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle A multimodal stress detection dataset with facial expressions and physiological signals
Hosseini, Majid
Sohrab, Fahad
Gottumukkala, Raju
Bhupatiraju, Ravi Teja
Katragadda, Satya
Raitoharju, Jenni
Iosifidis, Alexandros
Gabbouj, Moncef
Multimedia
Signal Processing
Affective computing has garnered the attention and interest of researchers in recent years, as there is a need for AI systems to better understand and react to human emotions. However, analyzing human emotions, such as mood or stress, is quite complex. While various stress studies use facial expressions and wearables, most existing datasets rely on processing data from a single modality. This paper presents EmpathicSchool, a novel dataset that captures facial expressions and the associated physiological signals, such as heart rate, electrodermal activity, and skin temperature, under different stress levels. The data was collected from 30 participants during different sessions for about ninety minutes each (for a total of 40 hours). The data includes seven different signal types, including both computer vision and physiological features that can be used to detect stress. In addition, various experiments were conducted to validate the signal quality.
title A multimodal stress detection dataset with facial expressions and physiological signals
topic Multimedia
Signal Processing
url https://arxiv.org/abs/2209.13542