Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Barkevich, Kevin, Bailey, Reynold, Diaz, Gabriel J.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910389806039040
author Barkevich, Kevin
Bailey, Reynold
Diaz, Gabriel J.
author_facet Barkevich, Kevin
Bailey, Reynold
Diaz, Gabriel J.
contents Algorithms for the estimation of gaze direction from mobile and video-based eye trackers typically involve tracking a feature of the eye that moves through the eye camera image in a way that covaries with the shifting gaze direction, such as the center or boundaries of the pupil. Tracking these features using traditional computer vision techniques can be difficult due to partial occlusion and environmental reflections. Although recent efforts to use machine learning (ML) for pupil tracking have demonstrated superior results when evaluated using standard measures of segmentation performance, little is known of how these networks may affect the quality of the final gaze estimate. This work provides an objective assessment of the impact of several contemporary ML-based methods for eye feature tracking when the subsequent gaze estimate is produced using either feature-based or model-based methods. Metrics include the accuracy and precision of the gaze estimate, as well as drop-out rate.
format Preprint
id arxiv_https___arxiv_org_abs_2403_19768
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality
Barkevich, Kevin
Bailey, Reynold
Diaz, Gabriel J.
Computer Vision and Pattern Recognition
Algorithms for the estimation of gaze direction from mobile and video-based eye trackers typically involve tracking a feature of the eye that moves through the eye camera image in a way that covaries with the shifting gaze direction, such as the center or boundaries of the pupil. Tracking these features using traditional computer vision techniques can be difficult due to partial occlusion and environmental reflections. Although recent efforts to use machine learning (ML) for pupil tracking have demonstrated superior results when evaluated using standard measures of segmentation performance, little is known of how these networks may affect the quality of the final gaze estimate. This work provides an objective assessment of the impact of several contemporary ML-based methods for eye feature tracking when the subsequent gaze estimate is produced using either feature-based or model-based methods. Metrics include the accuracy and precision of the gaze estimate, as well as drop-out rate.
title Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.19768