From Citations to Criticality: Predicting Legal Decision Influence in the Multilingual Swiss Jurisprudence
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908385860911104 |
|---|---|
| author | Stern, Ronja Kawamura, Ken Stürmer, Matthias Chalkidis, Ilias Niklaus, Joel |
| author_facet | Stern, Ronja Kawamura, Ken Stürmer, Matthias Chalkidis, Ilias Niklaus, Joel |
| contents | Many court systems are overwhelmed all over the world, leading to huge backlogs of pending cases. Effective triage systems, like those in emergency rooms, could ensure proper prioritization of open cases, optimizing time and resource allocation in the court system. In this work, we introduce the Criticality Prediction dataset, a novel resource for evaluating case prioritization. Our dataset features a two-tier labeling system: (1) the binary LD-Label, identifying cases published as Leading Decisions (LD), and (2) the more granular Citation-Label, ranking cases by their citation frequency and recency, allowing for a more nuanced evaluation. Unlike existing approaches that rely on resource-intensive manual annotations, we algorithmically derive labels leading to a much larger dataset than otherwise possible. We evaluate several multilingual models, including both smaller fine-tuned models and large language models in a zero-shot setting. Our results show that the fine-tuned models consistently outperform their larger counterparts, thanks to our large training set. Our results highlight that for highly domain-specific tasks like ours, large training sets are still valuable. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_13460 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | From Citations to Criticality: Predicting Legal Decision Influence in the Multilingual Swiss Jurisprudence Stern, Ronja Kawamura, Ken Stürmer, Matthias Chalkidis, Ilias Niklaus, Joel Computation and Language Artificial Intelligence Machine Learning 68T50 I.2; I.7 Many court systems are overwhelmed all over the world, leading to huge backlogs of pending cases. Effective triage systems, like those in emergency rooms, could ensure proper prioritization of open cases, optimizing time and resource allocation in the court system. In this work, we introduce the Criticality Prediction dataset, a novel resource for evaluating case prioritization. Our dataset features a two-tier labeling system: (1) the binary LD-Label, identifying cases published as Leading Decisions (LD), and (2) the more granular Citation-Label, ranking cases by their citation frequency and recency, allowing for a more nuanced evaluation. Unlike existing approaches that rely on resource-intensive manual annotations, we algorithmically derive labels leading to a much larger dataset than otherwise possible. We evaluate several multilingual models, including both smaller fine-tuned models and large language models in a zero-shot setting. Our results show that the fine-tuned models consistently outperform their larger counterparts, thanks to our large training set. Our results highlight that for highly domain-specific tasks like ours, large training sets are still valuable. |
| title | From Citations to Criticality: Predicting Legal Decision Influence in the Multilingual Swiss Jurisprudence |
| topic | Computation and Language Artificial Intelligence Machine Learning 68T50 I.2; I.7 |
| url | https://arxiv.org/abs/2410.13460 |