InternLM-Law: An Open Source Chinese Legal Large Language Model
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914843665104896 |
|---|---|
| author | Fei, Zhiwei Zhang, Songyang Shen, Xiaoyu Zhu, Dawei Wang, Xiao Cao, Maosong Zhou, Fengzhe Li, Yining Zhang, Wenwei Lin, Dahua Chen, Kai Ge, Jidong |
| author_facet | Fei, Zhiwei Zhang, Songyang Shen, Xiaoyu Zhu, Dawei Wang, Xiao Cao, Maosong Zhou, Fengzhe Li, Yining Zhang, Wenwei Lin, Dahua Chen, Kai Ge, Jidong |
| contents | While large language models (LLMs) have showcased impressive capabilities, they struggle with addressing legal queries due to the intricate complexities and specialized expertise required in the legal field. In this paper, we introduce InternLM-Law, a specialized LLM tailored for addressing diverse legal queries related to Chinese laws, spanning from responding to standard legal questions (e.g., legal exercises in textbooks) to analyzing complex real-world legal situations. We meticulously construct a dataset in the Chinese legal domain, encompassing over 1 million queries, and implement a data filtering and processing pipeline to ensure its diversity and quality. Our training approach involves a novel two-stage process: initially fine-tuning LLMs on both legal-specific and general-purpose content to equip the models with broad knowledge, followed by exclusive fine-tuning on high-quality legal data to enhance structured output generation. InternLM-Law achieves the highest average performance on LawBench, outperforming state-of-the-art models, including GPT-4, on 13 out of 20 subtasks. We make InternLM-Law and our dataset publicly available to facilitate future research in applying LLMs within the legal domain. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_14887 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | InternLM-Law: An Open Source Chinese Legal Large Language Model Fei, Zhiwei Zhang, Songyang Shen, Xiaoyu Zhu, Dawei Wang, Xiao Cao, Maosong Zhou, Fengzhe Li, Yining Zhang, Wenwei Lin, Dahua Chen, Kai Ge, Jidong Computation and Language While large language models (LLMs) have showcased impressive capabilities, they struggle with addressing legal queries due to the intricate complexities and specialized expertise required in the legal field. In this paper, we introduce InternLM-Law, a specialized LLM tailored for addressing diverse legal queries related to Chinese laws, spanning from responding to standard legal questions (e.g., legal exercises in textbooks) to analyzing complex real-world legal situations. We meticulously construct a dataset in the Chinese legal domain, encompassing over 1 million queries, and implement a data filtering and processing pipeline to ensure its diversity and quality. Our training approach involves a novel two-stage process: initially fine-tuning LLMs on both legal-specific and general-purpose content to equip the models with broad knowledge, followed by exclusive fine-tuning on high-quality legal data to enhance structured output generation. InternLM-Law achieves the highest average performance on LawBench, outperforming state-of-the-art models, including GPT-4, on 13 out of 20 subtasks. We make InternLM-Law and our dataset publicly available to facilitate future research in applying LLMs within the legal domain. |
| title | InternLM-Law: An Open Source Chinese Legal Large Language Model |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.14887 |