Evaluation Sufficiency and the Lab Boundary under AI-Mediated Judgment Formation

Fuente: Zenodo
Saved in:
Bibliographic Details
Main Author: Gavaza, Victoria
Format: Recurso digital
Language:English
Published: Zenodo 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866901522932039680
author Gavaza, Victoria
author_facet Gavaza, Victoria
contents <p><strong>AI laboratories invest substantial effort in evaluation, benchmarking, and safety testing to ensure system reliability and mitigate harm. These practices predominantly assess model behaviour through outputs, task performance, and controlled test conditions. This paper identifies a structural limitation of such approaches: AI-mediated judgment formation can introduce governance-relevant risk even when models pass established evaluations. Drawing on AI safety research, evaluation science, and human–AI interaction literature, the paper demonstrates that laboratory sufficiency does not imply governance sufficiency. The resulting gap is not a failure of scientific diligence, but a boundary mismatch between evaluation objects and real-world judgment-shaping interaction.</strong></p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_18475763
institution Zenodo
language eng
publishDate 2026
publisher Zenodo
record_format zenodo
spellingShingle Evaluation Sufficiency and the Lab Boundary under AI-Mediated Judgment Formation
Gavaza, Victoria
AI Governance
Human Judgement
Language Mediated Decision Making
Professional Responsibility
Institutional Accountability
AI Safety
Decision Support Systems
Risk Classification
Human-AI Interaction
Model Evaluation
Interpretability
Chain of thought monitoring
Evaluation Limits
<p><strong>AI laboratories invest substantial effort in evaluation, benchmarking, and safety testing to ensure system reliability and mitigate harm. These practices predominantly assess model behaviour through outputs, task performance, and controlled test conditions. This paper identifies a structural limitation of such approaches: AI-mediated judgment formation can introduce governance-relevant risk even when models pass established evaluations. Drawing on AI safety research, evaluation science, and human–AI interaction literature, the paper demonstrates that laboratory sufficiency does not imply governance sufficiency. The resulting gap is not a failure of scientific diligence, but a boundary mismatch between evaluation objects and real-world judgment-shaping interaction.</strong></p>
title Evaluation Sufficiency and the Lab Boundary under AI-Mediated Judgment Formation
topic AI Governance
Human Judgement
Language Mediated Decision Making
Professional Responsibility
Institutional Accountability
AI Safety
Decision Support Systems
Risk Classification
Human-AI Interaction
Model Evaluation
Interpretability
Chain of thought monitoring
Evaluation Limits
url https://doi.org/10.5281/zenodo.18475763