Toddlers' Active Gaze Behavior Supports Self-Supervised Object Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yu, Zhengyang, Aubret, Arthur, Raabe, Marcel C., Yang, Jane, Yu, Chen, Triesch, Jochen
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908420473356288
author Yu, Zhengyang
Aubret, Arthur
Raabe, Marcel C.
Yang, Jane
Yu, Chen
Triesch, Jochen
author_facet Yu, Zhengyang
Aubret, Arthur
Raabe, Marcel C.
Yang, Jane
Yu, Chen
Triesch, Jochen
contents Toddlers learn to recognize objects from different viewpoints with almost no supervision. During this learning, they execute frequent eye and head movements that shape their visual experience. It is presently unclear if and how these behaviors contribute to toddlers' emerging object recognition abilities. To answer this question, we here combine head-mounted eye tracking during dyadic play with unsupervised machine learning. We approximate toddlers' central visual field experience by cropping image regions from a head-mounted camera centered on the current gaze location estimated via eye tracking. This visual stream feeds an unsupervised computational model of toddlers' learning, which constructs visual representations that slowly change over time. Our experiments demonstrate that toddlers' gaze strategy supports the learning of invariant object representations. Our analysis also shows that the limited size of the central visual field where acuity is high is crucial for this. Overall, our work reveals how toddlers' gaze behavior may support their development of view-invariant object recognition.
format Preprint
id arxiv_https___arxiv_org_abs_2411_01969
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Toddlers' Active Gaze Behavior Supports Self-Supervised Object Learning
Yu, Zhengyang
Aubret, Arthur
Raabe, Marcel C.
Yang, Jane
Yu, Chen
Triesch, Jochen
Computer Vision and Pattern Recognition
Artificial Intelligence
Toddlers learn to recognize objects from different viewpoints with almost no supervision. During this learning, they execute frequent eye and head movements that shape their visual experience. It is presently unclear if and how these behaviors contribute to toddlers' emerging object recognition abilities. To answer this question, we here combine head-mounted eye tracking during dyadic play with unsupervised machine learning. We approximate toddlers' central visual field experience by cropping image regions from a head-mounted camera centered on the current gaze location estimated via eye tracking. This visual stream feeds an unsupervised computational model of toddlers' learning, which constructs visual representations that slowly change over time. Our experiments demonstrate that toddlers' gaze strategy supports the learning of invariant object representations. Our analysis also shows that the limited size of the central visual field where acuity is high is crucial for this. Overall, our work reveals how toddlers' gaze behavior may support their development of view-invariant object recognition.
title Toddlers' Active Gaze Behavior Supports Self-Supervised Object Learning
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2411.01969