Unlocking Legal Knowledge: A Multilingual Dataset for Judicial Summarization in Switzerland
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909795417587712 |
|---|---|
| author | Rolshoven, Luca Rasiah, Vishvaksenan Bose, Srinanda Brügger Hostettler, Sarah Burkhalter, Lara Stürmer, Matthias Niklaus, Joel |
| author_facet | Rolshoven, Luca Rasiah, Vishvaksenan Bose, Srinanda Brügger Hostettler, Sarah Burkhalter, Lara Stürmer, Matthias Niklaus, Joel |
| contents | Legal research depends on headnotes: concise summaries that help lawyers quickly identify relevant cases. Yet, many court decisions lack them due to the high cost of manual annotation. To address this gap, we introduce the Swiss Landmark Decisions Summarization (SLDS) dataset containing 20K rulings from the Swiss Federal Supreme Court, each with headnotes in German, French, and Italian. SLDS has the potential to significantly improve access to legal information and transform legal research in Switzerland. We fine-tune open models (Qwen2.5, Llama 3.2, Phi-3.5) and compare them to larger general-purpose and reasoning-tuned LLMs, including GPT-4o, Claude 3.5 Sonnet, and the open-source DeepSeek R1. Using an LLM-as-a-Judge framework, we find that fine-tuned models perform well in terms of lexical similarity, while larger models generate more legally accurate and coherent summaries. Interestingly, reasoning-focused models show no consistent benefit, suggesting that factual precision is more important than deep reasoning in this task. We release SLDS under a CC BY 4.0 license to support future research in cross-lingual legal summarization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_13456 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Unlocking Legal Knowledge: A Multilingual Dataset for Judicial Summarization in Switzerland Rolshoven, Luca Rasiah, Vishvaksenan Bose, Srinanda Brügger Hostettler, Sarah Burkhalter, Lara Stürmer, Matthias Niklaus, Joel Computation and Language Artificial Intelligence Machine Learning 68T50 I.2; I.7 Legal research depends on headnotes: concise summaries that help lawyers quickly identify relevant cases. Yet, many court decisions lack them due to the high cost of manual annotation. To address this gap, we introduce the Swiss Landmark Decisions Summarization (SLDS) dataset containing 20K rulings from the Swiss Federal Supreme Court, each with headnotes in German, French, and Italian. SLDS has the potential to significantly improve access to legal information and transform legal research in Switzerland. We fine-tune open models (Qwen2.5, Llama 3.2, Phi-3.5) and compare them to larger general-purpose and reasoning-tuned LLMs, including GPT-4o, Claude 3.5 Sonnet, and the open-source DeepSeek R1. Using an LLM-as-a-Judge framework, we find that fine-tuned models perform well in terms of lexical similarity, while larger models generate more legally accurate and coherent summaries. Interestingly, reasoning-focused models show no consistent benefit, suggesting that factual precision is more important than deep reasoning in this task. We release SLDS under a CC BY 4.0 license to support future research in cross-lingual legal summarization. |
| title | Unlocking Legal Knowledge: A Multilingual Dataset for Judicial Summarization in Switzerland |
| topic | Computation and Language Artificial Intelligence Machine Learning 68T50 I.2; I.7 |
| url | https://arxiv.org/abs/2410.13456 |