Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.02417 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909334367109120 |
|---|---|
| author | Cohen, Ido Gidron, Jacob Pinto, Idan |
| author_facet | Cohen, Ido Gidron, Jacob Pinto, Idan |
| contents | Diacritical marks in the Hebrew language give words their vocalized form. The task of adding diacritical marks to plain Hebrew text is still dominated by a system that relies heavily on human-curated resources. Recent models trained on diacritized Hebrew texts still present a gap in performance. We use a recently developed char-based PLM to narrowly bridge this gap. Presenting MenakBERT, a character level transformer pretrained on Hebrew text and fine-tuned to produce diacritical marks for Hebrew sentences. We continue to show how finetuning a model for diacritizing transfers to a task such as part of speech tagging. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_02417 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MenakBERT -- Hebrew Diacriticizer Cohen, Ido Gidron, Jacob Pinto, Idan Computation and Language Machine Learning Diacritical marks in the Hebrew language give words their vocalized form. The task of adding diacritical marks to plain Hebrew text is still dominated by a system that relies heavily on human-curated resources. Recent models trained on diacritized Hebrew texts still present a gap in performance. We use a recently developed char-based PLM to narrowly bridge this gap. Presenting MenakBERT, a character level transformer pretrained on Hebrew text and fine-tuned to produce diacritical marks for Hebrew sentences. We continue to show how finetuning a model for diacritizing transfers to a task such as part of speech tagging. |
| title | MenakBERT -- Hebrew Diacriticizer |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2410.02417 |