Saved in:
Bibliographic Details
Main Authors: Varatharaj, Ashvini, Todd, Simon
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.14444
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910377819766784
author Varatharaj, Ashvini
Todd, Simon
author_facet Varatharaj, Ashvini
Todd, Simon
contents Non-Māori-speaking New Zealanders (NMS)are able to segment Māori words in a highlysimilar way to fluent speakers (Panther et al.,2024). This ability is assumed to derive through the identification and extraction of statistically recurrent forms. We examine this assumption by asking how NMS segmentations compare to those produced by Morfessor, an unsupervised machine learning model that operates based on statistical recurrence, across words formed by a variety of morphological processes. Both NMS and Morfessor succeed in segmenting words formed by concatenative processes (compounding and affixation without allomorphy), but NMS also succeed for words that invoke templates (reduplication and allomorphy) and other cues to morphological structure, implying that their learning process is sensitive to more than just statistical recurrence.
format Preprint
id arxiv_https___arxiv_org_abs_2403_14444
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle More than Just Statistical Recurrence: Human and Machine Unsupervised Learning of Māori Word Segmentation across Morphological Processes
Varatharaj, Ashvini
Todd, Simon
Computation and Language
Non-Māori-speaking New Zealanders (NMS)are able to segment Māori words in a highlysimilar way to fluent speakers (Panther et al.,2024). This ability is assumed to derive through the identification and extraction of statistically recurrent forms. We examine this assumption by asking how NMS segmentations compare to those produced by Morfessor, an unsupervised machine learning model that operates based on statistical recurrence, across words formed by a variety of morphological processes. Both NMS and Morfessor succeed in segmenting words formed by concatenative processes (compounding and affixation without allomorphy), but NMS also succeed for words that invoke templates (reduplication and allomorphy) and other cues to morphological structure, implying that their learning process is sensitive to more than just statistical recurrence.
title More than Just Statistical Recurrence: Human and Machine Unsupervised Learning of Māori Word Segmentation across Morphological Processes
topic Computation and Language
url https://arxiv.org/abs/2403.14444