DIPSER: A Dataset for In-Person Student Engagement Recognition in the Wild

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Marquez-Carpintero, Luis, Suescun-Ferrandiz, Sergio, Álvarez, Carolina Lorenzo, Fernandez-Herrero, Jorge, Viejo, Diego, Roig-Vila, Rosabel, Cazorla, Miguel
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917481238495232
author Marquez-Carpintero, Luis
Suescun-Ferrandiz, Sergio
Álvarez, Carolina Lorenzo
Fernandez-Herrero, Jorge
Viejo, Diego
Roig-Vila, Rosabel
Cazorla, Miguel
author_facet Marquez-Carpintero, Luis
Suescun-Ferrandiz, Sergio
Álvarez, Carolina Lorenzo
Fernandez-Herrero, Jorge
Viejo, Diego
Roig-Vila, Rosabel
Cazorla, Miguel
contents In this paper, a novel dataset is introduced, designed to assess student attention within in-person classroom settings. This dataset encompasses RGB camera data, featuring multiple cameras per student to capture both posture and facial expressions, in addition to smartwatch sensor data for each individual. This dataset allows machine learning algorithms to be trained to predict attention and correlate it with emotion. A comprehensive suite of attention and emotion labels for each student is provided, generated through self-reporting as well as evaluations by four different experts. Our dataset uniquely combines facial and environmental camera data, smartwatch metrics, and includes underrepresented ethnicities in similar datasets, all within in-the-wild, in-person settings, making it the most comprehensive dataset of its kind currently available. The dataset presented offers an extensive and diverse collection of data pertaining to student interactions across different educational contexts, augmented with additional metadata from other tools. This initiative addresses existing deficiencies by offering a valuable resource for the analysis of student attention and emotion in face-to-face lessons.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20209
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DIPSER: A Dataset for In-Person Student Engagement Recognition in the Wild
Marquez-Carpintero, Luis
Suescun-Ferrandiz, Sergio
Álvarez, Carolina Lorenzo
Fernandez-Herrero, Jorge
Viejo, Diego
Roig-Vila, Rosabel
Cazorla, Miguel
Computer Vision and Pattern Recognition
Artificial Intelligence
In this paper, a novel dataset is introduced, designed to assess student attention within in-person classroom settings. This dataset encompasses RGB camera data, featuring multiple cameras per student to capture both posture and facial expressions, in addition to smartwatch sensor data for each individual. This dataset allows machine learning algorithms to be trained to predict attention and correlate it with emotion. A comprehensive suite of attention and emotion labels for each student is provided, generated through self-reporting as well as evaluations by four different experts. Our dataset uniquely combines facial and environmental camera data, smartwatch metrics, and includes underrepresented ethnicities in similar datasets, all within in-the-wild, in-person settings, making it the most comprehensive dataset of its kind currently available. The dataset presented offers an extensive and diverse collection of data pertaining to student interactions across different educational contexts, augmented with additional metadata from other tools. This initiative addresses existing deficiencies by offering a valuable resource for the analysis of student attention and emotion in face-to-face lessons.
title DIPSER: A Dataset for In-Person Student Engagement Recognition in the Wild
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2502.20209