eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913402704625664 |
|---|---|
| author | Sabzevari, Hoorieh Rostamkhani, Mohammadmostafa Eetemadi, Sauleh |
| author_facet | Sabzevari, Hoorieh Rostamkhani, Mohammadmostafa Eetemadi, Sauleh |
| contents | This study investigates the performance of the zero-shot method in classifying data using three large language models, alongside two models with large input token sizes and the two pre-trained models on legal data. Our main dataset comes from the domain of U.S. civil procedure. It includes summaries of legal cases, specific questions, potential answers, and detailed explanations for why each solution is relevant, all sourced from a book aimed at law students. By comparing different methods, we aimed to understand how effectively they handle the complexities found in legal datasets. Our findings show how well the zero-shot method of large language models can understand complicated data. We achieved our highest F1 score of 64% in these experiments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_16490 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure Sabzevari, Hoorieh Rostamkhani, Mohammadmostafa Eetemadi, Sauleh Computation and Language This study investigates the performance of the zero-shot method in classifying data using three large language models, alongside two models with large input token sizes and the two pre-trained models on legal data. Our main dataset comes from the domain of U.S. civil procedure. It includes summaries of legal cases, specific questions, potential answers, and detailed explanations for why each solution is relevant, all sourced from a book aimed at law students. By comparing different methods, we aimed to understand how effectively they handle the complexities found in legal datasets. Our findings show how well the zero-shot method of large language models can understand complicated data. We achieved our highest F1 score of 64% in these experiments. |
| title | eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.16490 |