WigglyEyes: Inferring Eye Movements from Keypress Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Yujun, Shi, Danqing, Moon, Hee-Seung, Oulasvirta, Antti
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909702911164416
author Zhu, Yujun
Shi, Danqing
Moon, Hee-Seung
Oulasvirta, Antti
author_facet Zhu, Yujun
Shi, Danqing
Moon, Hee-Seung
Oulasvirta, Antti
contents We present a model for inferring where users look during interaction based on keypress data only. Given a key log, it outputs a scanpath that tells, moment-by-moment, how the user had moved eyes while entering those keys. The model can be used as a proxy for human data in cases where collecting real eye tracking data is expensive or impossible. Our technical insight is an inference architecture that considers the individual characteristics of the user, inferred as a low-dimensional parameter vector. We present a novel loss function for synchronizing inferred eye movements with the keypresses. Evaluations on touchscreen typing demonstrate accurate gaze inference.
format Preprint
id arxiv_https___arxiv_org_abs_2412_15669
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle WigglyEyes: Inferring Eye Movements from Keypress Data
Zhu, Yujun
Shi, Danqing
Moon, Hee-Seung
Oulasvirta, Antti
Human-Computer Interaction
We present a model for inferring where users look during interaction based on keypress data only. Given a key log, it outputs a scanpath that tells, moment-by-moment, how the user had moved eyes while entering those keys. The model can be used as a proxy for human data in cases where collecting real eye tracking data is expensive or impossible. Our technical insight is an inference architecture that considers the individual characteristics of the user, inferred as a low-dimensional parameter vector. We present a novel loss function for synchronizing inferred eye movements with the keypresses. Evaluations on touchscreen typing demonstrate accurate gaze inference.
title WigglyEyes: Inferring Eye Movements from Keypress Data
topic Human-Computer Interaction
url https://arxiv.org/abs/2412.15669