PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Elfares, Mayar, Reisert, Pascal, Hu, Zhiming, Tang, Wenwu, Küsters, Ralf, Bulling, Andreas
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913247996674048
author Elfares, Mayar
Reisert, Pascal
Hu, Zhiming
Tang, Wenwu
Küsters, Ralf
Bulling, Andreas
author_facet Elfares, Mayar
Reisert, Pascal
Hu, Zhiming
Tang, Wenwu
Küsters, Ralf
Bulling, Andreas
contents Latest gaze estimation methods require large-scale training data but their collection and exchange pose significant privacy risks. We propose PrivatEyes - the first privacy-enhancing training approach for appearance-based gaze estimation based on federated learning (FL) and secure multi-party computation (MPC). PrivatEyes enables training gaze estimators on multiple local datasets across different users and server-based secure aggregation of the individual estimators' updates. PrivatEyes guarantees that individual gaze data remains private even if a majority of the aggregating servers is malicious. We also introduce a new data leakage attack DualView that shows that PrivatEyes limits the leakage of private training data more effectively than previous approaches. Evaluations on the MPIIGaze, MPIIFaceGaze, GazeCapture, and NVGaze datasets further show that the improved privacy does not lead to a lower gaze estimation accuracy or substantially higher computational costs - both of which are on par with its non-secure counterparts.
format Preprint
id arxiv_https___arxiv_org_abs_2402_18970
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation
Elfares, Mayar
Reisert, Pascal
Hu, Zhiming
Tang, Wenwu
Küsters, Ralf
Bulling, Andreas
Computer Vision and Pattern Recognition
Human-Computer Interaction
Latest gaze estimation methods require large-scale training data but their collection and exchange pose significant privacy risks. We propose PrivatEyes - the first privacy-enhancing training approach for appearance-based gaze estimation based on federated learning (FL) and secure multi-party computation (MPC). PrivatEyes enables training gaze estimators on multiple local datasets across different users and server-based secure aggregation of the individual estimators' updates. PrivatEyes guarantees that individual gaze data remains private even if a majority of the aggregating servers is malicious. We also introduce a new data leakage attack DualView that shows that PrivatEyes limits the leakage of private training data more effectively than previous approaches. Evaluations on the MPIIGaze, MPIIFaceGaze, GazeCapture, and NVGaze datasets further show that the improved privacy does not lead to a lower gaze estimation accuracy or substantially higher computational costs - both of which are on par with its non-secure counterparts.
title PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
url https://arxiv.org/abs/2402.18970