ParsiPy: NLP Toolkit for Historical Persian Texts in Python
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916660339802112 |
|---|---|
| author | Farsi, Farhan Fazel, Parnian Haghighi, Sepand Sabouri, Sadra Goshtasb, Farzaneh Hajipour, Nadia Asgari, Ehsaneddin Sameti, Hossein |
| author_facet | Farsi, Farhan Fazel, Parnian Haghighi, Sepand Sabouri, Sadra Goshtasb, Farzaneh Hajipour, Nadia Asgari, Ehsaneddin Sameti, Hossein |
| contents | The study of historical languages presents unique challenges due to their complex orthographic systems, fragmentary textual evidence, and the absence of standardized digital representations of text in those languages. Tackling these challenges needs special NLP digital tools to handle phonetic transcriptions and analyze ancient texts. This work introduces ParsiPy, an NLP toolkit designed to facilitate the analysis of historical Persian languages by offering modules for tokenization, lemmatization, part-of-speech tagging, phoneme-to-transliteration conversion, and word embedding. We demonstrate the utility of our toolkit through the processing of Parsig (Middle Persian) texts, highlighting its potential for expanding computational methods in the study of historical languages. Through this work, we contribute to computational philology, offering tools that can be adapted for the broader study of ancient texts and their digital preservation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_17810 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ParsiPy: NLP Toolkit for Historical Persian Texts in Python Farsi, Farhan Fazel, Parnian Haghighi, Sepand Sabouri, Sadra Goshtasb, Farzaneh Hajipour, Nadia Asgari, Ehsaneddin Sameti, Hossein Computation and Language The study of historical languages presents unique challenges due to their complex orthographic systems, fragmentary textual evidence, and the absence of standardized digital representations of text in those languages. Tackling these challenges needs special NLP digital tools to handle phonetic transcriptions and analyze ancient texts. This work introduces ParsiPy, an NLP toolkit designed to facilitate the analysis of historical Persian languages by offering modules for tokenization, lemmatization, part-of-speech tagging, phoneme-to-transliteration conversion, and word embedding. We demonstrate the utility of our toolkit through the processing of Parsig (Middle Persian) texts, highlighting its potential for expanding computational methods in the study of historical languages. Through this work, we contribute to computational philology, offering tools that can be adapted for the broader study of ancient texts and their digital preservation. |
| title | ParsiPy: NLP Toolkit for Historical Persian Texts in Python |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2503.17810 |