Promises and pitfalls of artificial intelligence for legal applications

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kapoor, Sayash, Henderson, Peter, Narayanan, Arvind
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929232404283392
author Kapoor, Sayash
Henderson, Peter
Narayanan, Arvind
author_facet Kapoor, Sayash
Henderson, Peter
Narayanan, Arvind
contents Is AI set to redefine the legal profession? We argue that this claim is not supported by the current evidence. We dive into AI's increasingly prevalent roles in three types of legal tasks: information processing; tasks involving creativity, reasoning, or judgment; and predictions about the future. We find that the ease of evaluating legal applications varies greatly across legal tasks, based on the ease of identifying correct answers and the observability of information relevant to the task at hand. Tasks that would lead to the most significant changes to the legal profession are also the ones most prone to overoptimism about AI capabilities, as they are harder to evaluate. We make recommendations for better evaluation and deployment of AI in legal contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01656
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Promises and pitfalls of artificial intelligence for legal applications
Kapoor, Sayash
Henderson, Peter
Narayanan, Arvind
Computers and Society
Artificial Intelligence
Is AI set to redefine the legal profession? We argue that this claim is not supported by the current evidence. We dive into AI's increasingly prevalent roles in three types of legal tasks: information processing; tasks involving creativity, reasoning, or judgment; and predictions about the future. We find that the ease of evaluating legal applications varies greatly across legal tasks, based on the ease of identifying correct answers and the observability of information relevant to the task at hand. Tasks that would lead to the most significant changes to the legal profession are also the ones most prone to overoptimism about AI capabilities, as they are harder to evaluate. We make recommendations for better evaluation and deployment of AI in legal contexts.
title Promises and pitfalls of artificial intelligence for legal applications
topic Computers and Society
Artificial Intelligence
url https://arxiv.org/abs/2402.01656