CWoMP: Morpheme Representation Learning for Interlinear Glossing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Alper, Morris, Rice, Enora, Shandilya, Bhargav, Palmer, Alexis, Levin, Lori
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912973627326464
author Alper, Morris
Rice, Enora
Shandilya, Bhargav
Palmer, Alexis
Levin, Lori
author_facet Alper, Morris
Rice, Enora
Shandilya, Bhargav
Palmer, Alexis
Levin, Lori
contents Interlinear glossed text (IGT) is a standard notation for language documentation which is linguistically rich but laborious to produce manually. Recent automated IGT methods treat glosses as character sequences, neglecting their compositional structure. We propose CWoMP (Contrastive Word-Morpheme Pretraining), which instead treats morphemes as atomic form-meaning units with learned representations. A contrastively trained encoder aligns words-in-context with their constituent morphemes in a shared embedding space; an autoregressive decoder then generates the morpheme sequence by retrieving entries from a mutable lexicon of these embeddings. Predictions are interpretable--grounded in lexicon entries--and users can improve results at inference time by expanding the lexicon without retraining. We evaluate on diverse low-resource languages, showing that CWoMP outperforms existing methods while being significantly more efficient, with particularly strong gains in extremely low-resource settings.
format Preprint
id arxiv_https___arxiv_org_abs_2603_18184
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CWoMP: Morpheme Representation Learning for Interlinear Glossing
Alper, Morris
Rice, Enora
Shandilya, Bhargav
Palmer, Alexis
Levin, Lori
Computation and Language
Interlinear glossed text (IGT) is a standard notation for language documentation which is linguistically rich but laborious to produce manually. Recent automated IGT methods treat glosses as character sequences, neglecting their compositional structure. We propose CWoMP (Contrastive Word-Morpheme Pretraining), which instead treats morphemes as atomic form-meaning units with learned representations. A contrastively trained encoder aligns words-in-context with their constituent morphemes in a shared embedding space; an autoregressive decoder then generates the morpheme sequence by retrieving entries from a mutable lexicon of these embeddings. Predictions are interpretable--grounded in lexicon entries--and users can improve results at inference time by expanding the lexicon without retraining. We evaluate on diverse low-resource languages, showing that CWoMP outperforms existing methods while being significantly more efficient, with particularly strong gains in extremely low-resource settings.
title CWoMP: Morpheme Representation Learning for Interlinear Glossing
topic Computation and Language
url https://arxiv.org/abs/2603.18184