Persian Pronoun Resolution: Leveraging Neural Networks and Language Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866907901804675072 |
|---|---|
| author | Mohammadi, Hassan Haji Talebpour, Alireza Aznaveh, Ahmad Mahmoudi Yazdani, Samaneh |
| author_facet | Mohammadi, Hassan Haji Talebpour, Alireza Aznaveh, Ahmad Mahmoudi Yazdani, Samaneh |
| contents | Coreference resolution, critical for identifying textual entities referencing the same entity, faces challenges in pronoun resolution, particularly identifying pronoun antecedents. Existing methods often treat pronoun resolution as a separate task from mention detection, potentially missing valuable information. This study proposes the first end-to-end neural network system for Persian pronoun resolution, leveraging pre-trained Transformer models like ParsBERT. Our system jointly optimizes both mention detection and antecedent linking, achieving a 3.37 F1 score improvement over the previous state-of-the-art system (which relied on rule-based and statistical methods) on the Mehr corpus. This significant improvement demonstrates the effectiveness of combining neural networks with linguistic models, potentially marking a significant advancement in Persian pronoun resolution and paving the way for further research in this under-explored area. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_10714 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Persian Pronoun Resolution: Leveraging Neural Networks and Language Models Mohammadi, Hassan Haji Talebpour, Alireza Aznaveh, Ahmad Mahmoudi Yazdani, Samaneh Computation and Language Artificial Intelligence Coreference resolution, critical for identifying textual entities referencing the same entity, faces challenges in pronoun resolution, particularly identifying pronoun antecedents. Existing methods often treat pronoun resolution as a separate task from mention detection, potentially missing valuable information. This study proposes the first end-to-end neural network system for Persian pronoun resolution, leveraging pre-trained Transformer models like ParsBERT. Our system jointly optimizes both mention detection and antecedent linking, achieving a 3.37 F1 score improvement over the previous state-of-the-art system (which relied on rule-based and statistical methods) on the Mehr corpus. This significant improvement demonstrates the effectiveness of combining neural networks with linguistic models, potentially marking a significant advancement in Persian pronoun resolution and paving the way for further research in this under-explored area. |
| title | Persian Pronoun Resolution: Leveraging Neural Networks and Language Models |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2405.10714 |