Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nguyen, Viet Dung, Bailey, Reynold, Diaz, Gabriel J., Ma, Chengyi, Fix, Alexander, Ororbia, Alexander
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913279739166720
author Nguyen, Viet Dung
Bailey, Reynold
Diaz, Gabriel J.
Ma, Chengyi
Fix, Alexander
Ororbia, Alexander
author_facet Nguyen, Viet Dung
Bailey, Reynold
Diaz, Gabriel J.
Ma, Chengyi
Fix, Alexander
Ororbia, Alexander
contents Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. Segmentation models trained using supervised machine learning can excel at this task, their effectiveness is determined by the degree of overlap between the narrow distributions of image properties defined by the target dataset and highly specific training datasets, of which there are few. Attempts to broaden the distribution of existing eye image datasets through the inclusion of synthetic eye images have found that a model trained on synthetic images will often fail to generalize back to real-world eye images. In remedy, we use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data, and to prune the training dataset in a manner that maximizes distribution overlap. We demonstrate that our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15947
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems
Nguyen, Viet Dung
Bailey, Reynold
Diaz, Gabriel J.
Ma, Chengyi
Fix, Alexander
Ororbia, Alexander
Computer Vision and Pattern Recognition
I.2.0; I.2.6; I.4.6; I.4.5
Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. Segmentation models trained using supervised machine learning can excel at this task, their effectiveness is determined by the degree of overlap between the narrow distributions of image properties defined by the target dataset and highly specific training datasets, of which there are few. Attempts to broaden the distribution of existing eye image datasets through the inclusion of synthetic eye images have found that a model trained on synthetic images will often fail to generalize back to real-world eye images. In remedy, we use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data, and to prune the training dataset in a manner that maximizes distribution overlap. We demonstrate that our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
title Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems
topic Computer Vision and Pattern Recognition
I.2.0; I.2.6; I.4.6; I.4.5
url https://arxiv.org/abs/2403.15947