Improving Legal Entity Recognition Using a Hybrid Transformer Model and Semantic Filtering Approach
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918095377924096 |
|---|---|
| author | Rajamanickam, Duraimurugan |
| author_facet | Rajamanickam, Duraimurugan |
| contents | Legal Entity Recognition (LER) is critical in automating legal workflows such as contract analysis, compliance monitoring, and litigation support. Existing approaches, including rule-based systems and classical machine learning models, struggle with the complexity of legal documents and domain specificity, particularly in handling ambiguities and nested entity structures. This paper proposes a novel hybrid model that enhances the accuracy and precision of Legal-BERT, a transformer model fine-tuned for legal text processing, by introducing a semantic similarity-based filtering mechanism. We evaluate the model on a dataset of 15,000 annotated legal documents, achieving an F1 score of 93.4%, demonstrating significant improvements in precision and recall over previous methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_08521 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Improving Legal Entity Recognition Using a Hybrid Transformer Model and Semantic Filtering Approach Rajamanickam, Duraimurugan Computation and Language Information Retrieval Machine Learning Legal Entity Recognition (LER) is critical in automating legal workflows such as contract analysis, compliance monitoring, and litigation support. Existing approaches, including rule-based systems and classical machine learning models, struggle with the complexity of legal documents and domain specificity, particularly in handling ambiguities and nested entity structures. This paper proposes a novel hybrid model that enhances the accuracy and precision of Legal-BERT, a transformer model fine-tuned for legal text processing, by introducing a semantic similarity-based filtering mechanism. We evaluate the model on a dataset of 15,000 annotated legal documents, achieving an F1 score of 93.4%, demonstrating significant improvements in precision and recall over previous methods. |
| title | Improving Legal Entity Recognition Using a Hybrid Transformer Model and Semantic Filtering Approach |
| topic | Computation and Language Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2410.08521 |