Saved in:
Bibliographic Details
Main Authors: Martin, Lauren, Whitehouse, Nick, Yiu, Stephanie, Catterson, Lizzie, Perera, Rivindu
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.16212
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929227090100224
author Martin, Lauren
Whitehouse, Nick
Yiu, Stephanie
Catterson, Lizzie
Perera, Rivindu
author_facet Martin, Lauren
Whitehouse, Nick
Yiu, Stephanie
Catterson, Lizzie
Perera, Rivindu
contents This paper presents a groundbreaking comparison between Large Language Models and traditional legal contract reviewers, Junior Lawyers and Legal Process Outsourcers. We dissect whether LLMs can outperform humans in accuracy, speed, and cost efficiency during contract review. Our empirical analysis benchmarks LLMs against a ground truth set by Senior Lawyers, uncovering that advanced models match or exceed human accuracy in determining legal issues. In speed, LLMs complete reviews in mere seconds, eclipsing the hours required by their human counterparts. Cost wise, LLMs operate at a fraction of the price, offering a staggering 99.97 percent reduction in cost over traditional methods. These results are not just statistics, they signal a seismic shift in legal practice. LLMs stand poised to disrupt the legal industry, enhancing accessibility and efficiency of legal services. Our research asserts that the era of LLM dominance in legal contract review is upon us, challenging the status quo and calling for a reimagined future of legal workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2401_16212
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Better Call GPT, Comparing Large Language Models Against Lawyers
Martin, Lauren
Whitehouse, Nick
Yiu, Stephanie
Catterson, Lizzie
Perera, Rivindu
Computers and Society
Computation and Language
This paper presents a groundbreaking comparison between Large Language Models and traditional legal contract reviewers, Junior Lawyers and Legal Process Outsourcers. We dissect whether LLMs can outperform humans in accuracy, speed, and cost efficiency during contract review. Our empirical analysis benchmarks LLMs against a ground truth set by Senior Lawyers, uncovering that advanced models match or exceed human accuracy in determining legal issues. In speed, LLMs complete reviews in mere seconds, eclipsing the hours required by their human counterparts. Cost wise, LLMs operate at a fraction of the price, offering a staggering 99.97 percent reduction in cost over traditional methods. These results are not just statistics, they signal a seismic shift in legal practice. LLMs stand poised to disrupt the legal industry, enhancing accessibility and efficiency of legal services. Our research asserts that the era of LLM dominance in legal contract review is upon us, challenging the status quo and calling for a reimagined future of legal workflows.
title Better Call GPT, Comparing Large Language Models Against Lawyers
topic Computers and Society
Computation and Language
url https://arxiv.org/abs/2401.16212