GerPS-Compare: Comparing NER methods for legal norm analysis
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910725748817920 |
|---|---|
| author | Bachinger, Sarah T. Unger, Christoph Erd, Robin Feddoul, Leila Lachenmaier, Clara Zarrieß, Sina König-Ries, Birgitta |
| author_facet | Bachinger, Sarah T. Unger, Christoph Erd, Robin Feddoul, Leila Lachenmaier, Clara Zarrieß, Sina König-Ries, Birgitta |
| contents | We apply NER to a particular sub-genre of legal texts in German: the genre of legal norms regulating administrative processes in public service administration. The analysis of such texts involves identifying stretches of text that instantiate one of ten classes identified by public service administration professionals. We investigate and compare three methods for performing Named Entity Recognition (NER) to detect these classes: a Rule-based system, deep discriminative models, and a deep generative model. Our results show that Deep Discriminative models outperform both the Rule-based system as well as the Deep Generative model, the latter two roughly performing equally well, outperforming each other in different classes. The main cause for this somewhat surprising result is arguably the fact that the classes used in the analysis are semantically and syntactically heterogeneous, in contrast to the classes used in more standard NER tasks. Deep Discriminative models appear to be better equipped for dealing with this heterogenerity than both generic LLMs and human linguists designing rule-based NER systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_02427 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GerPS-Compare: Comparing NER methods for legal norm analysis Bachinger, Sarah T. Unger, Christoph Erd, Robin Feddoul, Leila Lachenmaier, Clara Zarrieß, Sina König-Ries, Birgitta Computation and Language Artificial Intelligence We apply NER to a particular sub-genre of legal texts in German: the genre of legal norms regulating administrative processes in public service administration. The analysis of such texts involves identifying stretches of text that instantiate one of ten classes identified by public service administration professionals. We investigate and compare three methods for performing Named Entity Recognition (NER) to detect these classes: a Rule-based system, deep discriminative models, and a deep generative model. Our results show that Deep Discriminative models outperform both the Rule-based system as well as the Deep Generative model, the latter two roughly performing equally well, outperforming each other in different classes. The main cause for this somewhat surprising result is arguably the fact that the classes used in the analysis are semantically and syntactically heterogeneous, in contrast to the classes used in more standard NER tasks. Deep Discriminative models appear to be better equipped for dealing with this heterogenerity than both generic LLMs and human linguists designing rule-based NER systems. |
| title | GerPS-Compare: Comparing NER methods for legal norm analysis |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2412.02427 |