INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challenges

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Pereira, Jayr, Assumpcao, Andre, Trecenti, Julio, Airosa, Luiz, Lente, Caio, Cléto, Jhonatan, Dobins, Guilherme, Nogueira, Rodrigo, Mitchell, Luis, Lotufo, Roberto
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909119661735936
author Pereira, Jayr
Assumpcao, Andre
Trecenti, Julio
Airosa, Luiz
Lente, Caio
Cléto, Jhonatan
Dobins, Guilherme
Nogueira, Rodrigo
Mitchell, Luis
Lotufo, Roberto
author_facet Pereira, Jayr
Assumpcao, Andre
Trecenti, Julio
Airosa, Luiz
Lente, Caio
Cléto, Jhonatan
Dobins, Guilherme
Nogueira, Rodrigo
Mitchell, Luis
Lotufo, Roberto
contents This paper introduces INACIA (Instrução Assistida com Inteligência Artificial), a groundbreaking system designed to integrate Large Language Models (LLMs) into the operational framework of Brazilian Federal Court of Accounts (TCU). The system automates various stages of case analysis, including basic information extraction, admissibility examination, Periculum in mora and Fumus boni iuris analyses, and recommendations generation. Through a series of experiments, we demonstrate INACIA's potential in extracting relevant information from case documents, evaluating its legal plausibility, and formulating propositions for judicial decision-making. Utilizing a validation dataset alongside LLMs, our evaluation methodology presents a novel approach to assessing system performance, correlating highly with human judgment. These results underscore INACIA's potential in complex legal task handling while also acknowledging the current limitations. This study discusses possible improvements and the broader implications of applying AI in legal contexts, suggesting that INACIA represents a significant step towards integrating AI in legal systems globally, albeit with cautious optimism grounded in the empirical findings.
format Preprint
id arxiv_https___arxiv_org_abs_2401_05273
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challenges
Pereira, Jayr
Assumpcao, Andre
Trecenti, Julio
Airosa, Luiz
Lente, Caio
Cléto, Jhonatan
Dobins, Guilherme
Nogueira, Rodrigo
Mitchell, Luis
Lotufo, Roberto
Computation and Language
Artificial Intelligence
This paper introduces INACIA (Instrução Assistida com Inteligência Artificial), a groundbreaking system designed to integrate Large Language Models (LLMs) into the operational framework of Brazilian Federal Court of Accounts (TCU). The system automates various stages of case analysis, including basic information extraction, admissibility examination, Periculum in mora and Fumus boni iuris analyses, and recommendations generation. Through a series of experiments, we demonstrate INACIA's potential in extracting relevant information from case documents, evaluating its legal plausibility, and formulating propositions for judicial decision-making. Utilizing a validation dataset alongside LLMs, our evaluation methodology presents a novel approach to assessing system performance, correlating highly with human judgment. These results underscore INACIA's potential in complex legal task handling while also acknowledging the current limitations. This study discusses possible improvements and the broader implications of applying AI in legal contexts, suggesting that INACIA represents a significant step towards integrating AI in legal systems globally, albeit with cautious optimism grounded in the empirical findings.
title INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challenges
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2401.05273