Judgment Delegation Is (Almost) All You Need: A Theory of Why AI Tools Feel Intelligent

Fuente: Zenodo
Guardado en:
Detalles Bibliográficos
Autor principal: Liang, Donglin
Formato: Recurso digital
Publicado: Zenodo 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866901690163134464
author Liang, Donglin
author_facet Liang, Donglin
contents <p dir="ltr">AI tools increasingly appear to perform intelligent work in software engineering and other creative domains, even though their core operation is plausible continuation of context. We argue that this impression arises from judgment delegation: tool support makes latent judgment capabilities in language models delegable by externalizing state, enabling feedback through action, and enforcing decision boundaries.</p> <p dir="ltr">When embedded in such scaffolding, AI systems can absorb much of the option-generation and pre-commitment work that dominates underspecified tasks, allowing users to interact primarily at commitment points. This redistribution of judgment work reduces cognitive burden and creates the experience that the system is “doing the thinking,” even when authority over final commitments nominally remains with the human.</p> <p dir="ltr">At the same time, fluent progress can make delegation difficult to see. Users may allow system proposals to function as decisions by default, not through explicit authorization but through convenience and momentum. This implicit commitment delegation helps explain why AI tools feel autonomous in practice and why costs often surface as late rework or reversals rather than immediate errors.</p> <p>To make these dynamics observable, we introduce Decision Accounting, a lightweight evaluation lens that tracks commitments (D), human option-generation burden (G), and mismatch penalties arising from late detection of incompatible assumptions. Through worked software planning examples, we show that tool support primarily reduces option-generation burden rather than the number of decisions required by a task, and that apparent autonomy becomes brittle when commitment authority shifts implicitly without governance. We argue that perceived intelligence in AI-assisted work is best understood as an outcome of judgment allocation and cost control, not model capability alone.</p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_18194189
institution Zenodo
language
publishDate 2026
publisher Zenodo
record_format zenodo
spellingShingle Judgment Delegation Is (Almost) All You Need: A Theory of Why AI Tools Feel Intelligent
Liang, Donglin
Judgment delegation
tool-mediated intelligence
human–AI collaboration
decision making under uncertainty,
AI system governance
<p dir="ltr">AI tools increasingly appear to perform intelligent work in software engineering and other creative domains, even though their core operation is plausible continuation of context. We argue that this impression arises from judgment delegation: tool support makes latent judgment capabilities in language models delegable by externalizing state, enabling feedback through action, and enforcing decision boundaries.</p> <p dir="ltr">When embedded in such scaffolding, AI systems can absorb much of the option-generation and pre-commitment work that dominates underspecified tasks, allowing users to interact primarily at commitment points. This redistribution of judgment work reduces cognitive burden and creates the experience that the system is “doing the thinking,” even when authority over final commitments nominally remains with the human.</p> <p dir="ltr">At the same time, fluent progress can make delegation difficult to see. Users may allow system proposals to function as decisions by default, not through explicit authorization but through convenience and momentum. This implicit commitment delegation helps explain why AI tools feel autonomous in practice and why costs often surface as late rework or reversals rather than immediate errors.</p> <p>To make these dynamics observable, we introduce Decision Accounting, a lightweight evaluation lens that tracks commitments (D), human option-generation burden (G), and mismatch penalties arising from late detection of incompatible assumptions. Through worked software planning examples, we show that tool support primarily reduces option-generation burden rather than the number of decisions required by a task, and that apparent autonomy becomes brittle when commitment authority shifts implicitly without governance. We argue that perceived intelligence in AI-assisted work is best understood as an outcome of judgment allocation and cost control, not model capability alone.</p>
title Judgment Delegation Is (Almost) All You Need: A Theory of Why AI Tools Feel Intelligent
topic Judgment delegation
tool-mediated intelligence
human–AI collaboration
decision making under uncertainty,
AI system governance
url https://doi.org/10.5281/zenodo.18194189