When AI output tips to bad but nobody notices: Legal implications of AI's mistakes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Restrepo, Dylan J., Restrepo, Nicholas J., Huo, Frank Y., Johnson, Neil F.
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910070588047360
author Restrepo, Dylan J.
Restrepo, Nicholas J.
Huo, Frank Y.
Johnson, Neil F.
author_facet Restrepo, Dylan J.
Restrepo, Nicholas J.
Huo, Frank Y.
Johnson, Neil F.
contents The adoption of generative AI across commercial and legal professions offers dramatic efficiency gains -- yet for law in particular, it introduces a perilous failure mode in which the AI fabricates fictitious case law, statutes, and judicial holdings that appear entirely authentic. Attorneys who unknowingly file such fabrications face professional sanctions, malpractice exposure, and reputational harm, while courts confront a novel threat to the integrity of the adversarial process. This failure mode is commonly dismissed as random `hallucination', but recent physics-based analysis of the Transformer's core mechanism reveals a deterministic component: the AI's internal state can cross a calculable threshold, causing its output to flip from reliable legal reasoning to authoritative-sounding fabrication. Here we present this science in a legal-industry setting, walking through a simulated brief-drafting scenario. Our analysis suggests that fabrication risk is not an anomalous glitch but a foreseeable consequence of the technology's design, with direct implications for the evolving duty of technological competence. We propose that legal professionals, courts, and regulators replace the outdated `black box' mental model with verification protocols based on how these systems actually fail.
format Preprint
id arxiv_https___arxiv_org_abs_2603_23857
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle When AI output tips to bad but nobody notices: Legal implications of AI's mistakes
Restrepo, Dylan J.
Restrepo, Nicholas J.
Huo, Frank Y.
Johnson, Neil F.
Artificial Intelligence
Computers and Society
Social and Information Networks
Chaotic Dynamics
Physics and Society
The adoption of generative AI across commercial and legal professions offers dramatic efficiency gains -- yet for law in particular, it introduces a perilous failure mode in which the AI fabricates fictitious case law, statutes, and judicial holdings that appear entirely authentic. Attorneys who unknowingly file such fabrications face professional sanctions, malpractice exposure, and reputational harm, while courts confront a novel threat to the integrity of the adversarial process. This failure mode is commonly dismissed as random `hallucination', but recent physics-based analysis of the Transformer's core mechanism reveals a deterministic component: the AI's internal state can cross a calculable threshold, causing its output to flip from reliable legal reasoning to authoritative-sounding fabrication. Here we present this science in a legal-industry setting, walking through a simulated brief-drafting scenario. Our analysis suggests that fabrication risk is not an anomalous glitch but a foreseeable consequence of the technology's design, with direct implications for the evolving duty of technological competence. We propose that legal professionals, courts, and regulators replace the outdated `black box' mental model with verification protocols based on how these systems actually fail.
title When AI output tips to bad but nobody notices: Legal implications of AI's mistakes
topic Artificial Intelligence
Computers and Society
Social and Information Networks
Chaotic Dynamics
Physics and Society
url https://arxiv.org/abs/2603.23857