Saved in:
Bibliographic Details
Main Authors: Cohen, Ido, Gidron, Jacob, Pinto, Idan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.02417
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Diacritical marks in the Hebrew language give words their vocalized form. The task of adding diacritical marks to plain Hebrew text is still dominated by a system that relies heavily on human-curated resources. Recent models trained on diacritized Hebrew texts still present a gap in performance. We use a recently developed char-based PLM to narrowly bridge this gap. Presenting MenakBERT, a character level transformer pretrained on Hebrew text and fine-tuned to produce diacritical marks for Hebrew sentences. We continue to show how finetuning a model for diacritizing transfers to a task such as part of speech tagging.