SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Reality

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Daza, Roberto, Shengkai, Lin, Morales, Aythami, Fierrez, Julian, Nagao, Katashi
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916922492190720
author Daza, Roberto
Shengkai, Lin
Morales, Aythami
Fierrez, Julian
Nagao, Katashi
author_facet Daza, Roberto
Shengkai, Lin
Morales, Aythami
Fierrez, Julian
Nagao, Katashi
contents This work introduces SMARTe-VR, a platform for student monitoring in an immersive virtual reality environment designed for online education. SMARTe-VR aims to collect data for adaptive learning, focusing on facial biometrics and learning metadata. The platform allows instructors to create customized learning sessions with video lectures, featuring an interface with an AutoQA system to evaluate understanding, interaction tools (for example, textbook highlighting and lecture tagging), and real-time feedback. Furthermore, we released a dataset that contains 5 research challenges with data from 10 users in VR-based TOEIC sessions. This data set, which spans more than 25 hours, includes facial features, learning metadata, 450 responses, difficulty levels of the questions, concept tags, and understanding labels. Alongside the database, we present preliminary experiments using Item Response Theory models, adapted for understanding detection using facial features. Two architectures were explored: a Temporal Convolutional Network for local features and a Multilayer Perceptron for global features.
format Preprint
id arxiv_https___arxiv_org_abs_2501_10977
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Reality
Daza, Roberto
Shengkai, Lin
Morales, Aythami
Fierrez, Julian
Nagao, Katashi
Human-Computer Interaction
Computer Vision and Pattern Recognition
This work introduces SMARTe-VR, a platform for student monitoring in an immersive virtual reality environment designed for online education. SMARTe-VR aims to collect data for adaptive learning, focusing on facial biometrics and learning metadata. The platform allows instructors to create customized learning sessions with video lectures, featuring an interface with an AutoQA system to evaluate understanding, interaction tools (for example, textbook highlighting and lecture tagging), and real-time feedback. Furthermore, we released a dataset that contains 5 research challenges with data from 10 users in VR-based TOEIC sessions. This data set, which spans more than 25 hours, includes facial features, learning metadata, 450 responses, difficulty levels of the questions, concept tags, and understanding labels. Alongside the database, we present preliminary experiments using Item Response Theory models, adapted for understanding detection using facial features. Two architectures were explored: a Temporal Convolutional Network for local features and a Multilayer Perceptron for global features.
title SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Reality
topic Human-Computer Interaction
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.10977