3D Gaze Tracking for Studying Collaborative Interactions in Mixed-Reality Environments

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Davalos, Eduardo, Zhang, Yike, S., Ashwin T., Fonteles, Joyce H., Timalsina, Umesh, Biswas, Guatam
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910490391740416
author Davalos, Eduardo
Zhang, Yike
S., Ashwin T.
Fonteles, Joyce H.
Timalsina, Umesh
Biswas, Guatam
author_facet Davalos, Eduardo
Zhang, Yike
S., Ashwin T.
Fonteles, Joyce H.
Timalsina, Umesh
Biswas, Guatam
contents This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular cameras and traditional eye-tracking apparatus, struggles with simultaneous data synchronization and analysis from multiple participants in group contexts. Our proposed framework leverages state-of-the-art computer vision and machine learning techniques to overcome these obstacles, enabling precise 3D gaze estimation without dependence on specialized hardware or complex data fusion. Utilizing facial recognition and deep learning, the framework achieves real-time, tracking of gaze patterns across several individuals, addressing common depth estimation errors, and ensuring spatial and identity consistency within the dataset. Empirical results demonstrate the accuracy and reliability of our method in group environments. This provides mechanisms for significant advances in behavior and interaction analysis in educational and professional training applications in dynamic and unstructured environments.
format Preprint
id arxiv_https___arxiv_org_abs_2406_11003
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle 3D Gaze Tracking for Studying Collaborative Interactions in Mixed-Reality Environments
Davalos, Eduardo
Zhang, Yike
S., Ashwin T.
Fonteles, Joyce H.
Timalsina, Umesh
Biswas, Guatam
Computer Vision and Pattern Recognition
Artificial Intelligence
This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular cameras and traditional eye-tracking apparatus, struggles with simultaneous data synchronization and analysis from multiple participants in group contexts. Our proposed framework leverages state-of-the-art computer vision and machine learning techniques to overcome these obstacles, enabling precise 3D gaze estimation without dependence on specialized hardware or complex data fusion. Utilizing facial recognition and deep learning, the framework achieves real-time, tracking of gaze patterns across several individuals, addressing common depth estimation errors, and ensuring spatial and identity consistency within the dataset. Empirical results demonstrate the accuracy and reliability of our method in group environments. This provides mechanisms for significant advances in behavior and interaction analysis in educational and professional training applications in dynamic and unstructured environments.
title 3D Gaze Tracking for Studying Collaborative Interactions in Mixed-Reality Environments
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2406.11003