Chinese Labor Law Large Language Model Benchmark
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915731418906624 |
|---|---|
| author | Lan, Zixun Xu, Maochun Ren, Yifan Wu, Rui Zhou, Jianghui Cheng, Xueyang Ding, Jianan Ding Wang, Xinheng Chi, Mingmin Ma, Fei |
| author_facet | Lan, Zixun Xu, Maochun Ren, Yifan Wu, Rui Zhou, Jianghui Cheng, Xueyang Ding, Jianan Ding Wang, Xinheng Chi, Mingmin Ma, Fei |
| contents | Recent advances in large language models (LLMs) have led to substantial progress in domain-specific applications, particularly within the legal domain. However, general-purpose models such as GPT-4 often struggle with specialized subdomains that require precise legal knowledge, complex reasoning, and contextual sensitivity. To address these limitations, we present LabourLawLLM, a legal large language model tailored to Chinese labor law. We also introduce LabourLawBench, a comprehensive benchmark covering diverse labor-law tasks, including legal provision citation, knowledge-based question answering, case classification, compensation computation, named entity recognition, and legal case analysis. Our evaluation framework combines objective metrics (e.g., ROUGE-L, accuracy, F1, and soft-F1) with subjective assessment based on GPT-4 scoring. Experiments show that LabourLawLLM consistently outperforms general-purpose and existing legal-specific LLMs across task categories. Beyond labor law, our methodology provides a scalable approach for building specialized LLMs in other legal subfields, improving accuracy, reliability, and societal value of legal AI applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_09972 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Chinese Labor Law Large Language Model Benchmark Lan, Zixun Xu, Maochun Ren, Yifan Wu, Rui Zhou, Jianghui Cheng, Xueyang Ding, Jianan Ding Wang, Xinheng Chi, Mingmin Ma, Fei Artificial Intelligence Recent advances in large language models (LLMs) have led to substantial progress in domain-specific applications, particularly within the legal domain. However, general-purpose models such as GPT-4 often struggle with specialized subdomains that require precise legal knowledge, complex reasoning, and contextual sensitivity. To address these limitations, we present LabourLawLLM, a legal large language model tailored to Chinese labor law. We also introduce LabourLawBench, a comprehensive benchmark covering diverse labor-law tasks, including legal provision citation, knowledge-based question answering, case classification, compensation computation, named entity recognition, and legal case analysis. Our evaluation framework combines objective metrics (e.g., ROUGE-L, accuracy, F1, and soft-F1) with subjective assessment based on GPT-4 scoring. Experiments show that LabourLawLLM consistently outperforms general-purpose and existing legal-specific LLMs across task categories. Beyond labor law, our methodology provides a scalable approach for building specialized LLMs in other legal subfields, improving accuracy, reliability, and societal value of legal AI applications. |
| title | Chinese Labor Law Large Language Model Benchmark |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2601.09972 |