A model of early word acquisition based on realistic-scale audiovisual naming events

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khorrami, Khazar, Räsänen, Okko
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911910563151872
author Khorrami, Khazar
Räsänen, Okko
author_facet Khorrami, Khazar
Räsänen, Okko
contents Infants gradually learn to parse continuous speech into words and connect names with objects, yet the mechanisms behind development of early word perception skills remain unknown. We studied the extent to which early words can be acquired through statistical learning from regularities in audiovisual sensory input. We simulated word learning in infants up to 12 months of age in a realistic setting, using a model that solely learns from statistical regularities in unannotated raw speech and pixel-level visual input. Crucially, the quantity of object naming events was carefully designed to match that accessible to infants of comparable ages. Results show that the model effectively learns to recognize words and associate them with corresponding visual objects, with a vocabulary growth rate comparable to that observed in infants. The findings support the viability of general statistical learning for early word perception, demonstrating how learning can operate without assuming any prior linguistic capabilities.
format Preprint
id arxiv_https___arxiv_org_abs_2406_05259
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A model of early word acquisition based on realistic-scale audiovisual naming events
Khorrami, Khazar
Räsänen, Okko
Audio and Speech Processing
Artificial Intelligence
Computation and Language
Infants gradually learn to parse continuous speech into words and connect names with objects, yet the mechanisms behind development of early word perception skills remain unknown. We studied the extent to which early words can be acquired through statistical learning from regularities in audiovisual sensory input. We simulated word learning in infants up to 12 months of age in a realistic setting, using a model that solely learns from statistical regularities in unannotated raw speech and pixel-level visual input. Crucially, the quantity of object naming events was carefully designed to match that accessible to infants of comparable ages. Results show that the model effectively learns to recognize words and associate them with corresponding visual objects, with a vocabulary growth rate comparable to that observed in infants. The findings support the viability of general statistical learning for early word perception, demonstrating how learning can operate without assuming any prior linguistic capabilities.
title A model of early word acquisition based on realistic-scale audiovisual naming events
topic Audio and Speech Processing
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2406.05259