Saved in:
Bibliographic Details
Main Authors: Zhao, Zihao, Hauke, Frederik, De Castilhos, Juliana, Bode, Mathis, Kather, Jakob Nikolas, Nebelung, Sven, Truhn, Daniel
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.17110
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916054939205632
author Zhao, Zihao
Hauke, Frederik
De Castilhos, Juliana
Bode, Mathis
Kather, Jakob Nikolas
Nebelung, Sven
Truhn, Daniel
author_facet Zhao, Zihao
Hauke, Frederik
De Castilhos, Juliana
Bode, Mathis
Kather, Jakob Nikolas
Nebelung, Sven
Truhn, Daniel
contents Developing AI models that are useful in clinical practice, requires efficient collaboration between clinicians and AI developers. This poses a practical challenge: clinicians must repeatedly communicate and refine their requirements with AI developers before those requirements can be translated into executable model development. This iterative process is time-consuming, and even after repeated discussion, misalignment may still exist because the two sides do not fully share each other's expertise. Coding agents may help close this gap. They can write and refine code on their own, and they carry working knowledge of both medicine and AI to understand commands formulated by both medical experts and developers. We present a prototype that lets clinicians drive AI development directly. A clinician describes the task in plain language, and the system turns the description into a working pipeline, refines it through repeated experiments together with the clinician, and returns a model that meets the stated clinical objective. Across five clinical tasks, the system reliably produces models that matched the clinician's request and reached competitive performance. Most notably, on chest radiographs the system sharply reduced the model's reliance on chest drains, a well-known shortcut for pneumothorax classification, from 60% to 31% on one dataset and from 50% to 18% on another. Our results suggest that coding agents can shift clinical AI development toward a more clinician-driven mode, allowing domain experts to shape models directly instead of relaying requirements through specialized AI teams.
format Preprint
id arxiv_https___arxiv_org_abs_2604_17110
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle From Clinical Intent to Clinical Model: Autonomous Coding-Agents for Clinician-driven AI Development
Zhao, Zihao
Hauke, Frederik
De Castilhos, Juliana
Bode, Mathis
Kather, Jakob Nikolas
Nebelung, Sven
Truhn, Daniel
Computer Vision and Pattern Recognition
Developing AI models that are useful in clinical practice, requires efficient collaboration between clinicians and AI developers. This poses a practical challenge: clinicians must repeatedly communicate and refine their requirements with AI developers before those requirements can be translated into executable model development. This iterative process is time-consuming, and even after repeated discussion, misalignment may still exist because the two sides do not fully share each other's expertise. Coding agents may help close this gap. They can write and refine code on their own, and they carry working knowledge of both medicine and AI to understand commands formulated by both medical experts and developers. We present a prototype that lets clinicians drive AI development directly. A clinician describes the task in plain language, and the system turns the description into a working pipeline, refines it through repeated experiments together with the clinician, and returns a model that meets the stated clinical objective. Across five clinical tasks, the system reliably produces models that matched the clinician's request and reached competitive performance. Most notably, on chest radiographs the system sharply reduced the model's reliance on chest drains, a well-known shortcut for pneumothorax classification, from 60% to 31% on one dataset and from 50% to 18% on another. Our results suggest that coding agents can shift clinical AI development toward a more clinician-driven mode, allowing domain experts to shape models directly instead of relaying requirements through specialized AI teams.
title From Clinical Intent to Clinical Model: Autonomous Coding-Agents for Clinician-driven AI Development
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.17110