Equitable Access to Justice: Logical LLMs Show Promise

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kant, Manuj, Kant, Manav, Nabi, Marzieh, Carlson, Preston, Ma, Megan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917801898278912
author Kant, Manuj
Kant, Manav
Nabi, Marzieh
Carlson, Preston
Ma, Megan
author_facet Kant, Manuj
Kant, Manav
Nabi, Marzieh
Carlson, Preston
Ma, Megan
contents The costs and complexity of the American judicial system limit access to legal solutions for many Americans. Large language models (LLMs) hold great potential to improve access to justice. However, a major challenge in applying AI and LLMs in legal contexts, where consistency and reliability are crucial, is the need for System 2 reasoning. In this paper, we explore the integration of LLMs with logic programming to enhance their ability to reason, bringing their strategic capabilities closer to that of a skilled lawyer. Our objective is to translate laws and contracts into logic programs that can be applied to specific legal cases, with a focus on insurance contracts. We demonstrate that while GPT-4o fails to encode a simple health insurance contract into logical code, the recently released OpenAI o1-preview model succeeds, exemplifying how LLMs with advanced System 2 reasoning capabilities can expand access to justice.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09904
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Equitable Access to Justice: Logical LLMs Show Promise
Kant, Manuj
Kant, Manav
Nabi, Marzieh
Carlson, Preston
Ma, Megan
Artificial Intelligence
Computers and Society
Logic in Computer Science
The costs and complexity of the American judicial system limit access to legal solutions for many Americans. Large language models (LLMs) hold great potential to improve access to justice. However, a major challenge in applying AI and LLMs in legal contexts, where consistency and reliability are crucial, is the need for System 2 reasoning. In this paper, we explore the integration of LLMs with logic programming to enhance their ability to reason, bringing their strategic capabilities closer to that of a skilled lawyer. Our objective is to translate laws and contracts into logic programs that can be applied to specific legal cases, with a focus on insurance contracts. We demonstrate that while GPT-4o fails to encode a simple health insurance contract into logical code, the recently released OpenAI o1-preview model succeeds, exemplifying how LLMs with advanced System 2 reasoning capabilities can expand access to justice.
title Equitable Access to Justice: Logical LLMs Show Promise
topic Artificial Intelligence
Computers and Society
Logic in Computer Science
url https://arxiv.org/abs/2410.09904