The Doctor Will (Still) See You Now: On the Structural Limits of Agentic AI in Healthcare
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917285585747968 |
|---|---|
| author | Dias, Gabriela Aránguiz Jafari, Kiana Griffith, Allie Dias, Carolina Aránguiz Kim, Grace Ra Saadeddin, Lana Kochenderfer, Mykel J. |
| author_facet | Dias, Gabriela Aránguiz Jafari, Kiana Griffith, Allie Dias, Carolina Aránguiz Kim, Grace Ra Saadeddin, Lana Kochenderfer, Mykel J. |
| contents | Across healthcare, agentic artificial intelligence (AI) systems are increasingly promoted as capable of autonomous action, yet in practice they currently operate under near-total human oversight due to safety, regulatory, and liability constraints that make autonomous clinical reasoning infeasible in high-stakes environments. While market enthusiasm suggests a revolution in healthcare agents, the conceptual assumptions and accountability structures shaping these systems remain underexamined. We present a qualitative study based on interviews with 20 stakeholders, including developers, implementers, and end users. Our analysis identifies three mutually reinforcing tensions: conceptual fragmentation regarding the definition of `agentic'; an autonomy contradiction where commercial promises exceed operational reality; and an evaluation blind spot that prioritizes technical benchmarks over sociotechnical safety. We argue that agentic {AI} functions as a site of contested meaning-making where technical aspirations, commercial incentives, and clinical constraints intersect, carrying material consequences for patient safety and the distribution of blame. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_18460 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | The Doctor Will (Still) See You Now: On the Structural Limits of Agentic AI in Healthcare Dias, Gabriela Aránguiz Jafari, Kiana Griffith, Allie Dias, Carolina Aránguiz Kim, Grace Ra Saadeddin, Lana Kochenderfer, Mykel J. Computers and Society Artificial Intelligence Human-Computer Interaction Across healthcare, agentic artificial intelligence (AI) systems are increasingly promoted as capable of autonomous action, yet in practice they currently operate under near-total human oversight due to safety, regulatory, and liability constraints that make autonomous clinical reasoning infeasible in high-stakes environments. While market enthusiasm suggests a revolution in healthcare agents, the conceptual assumptions and accountability structures shaping these systems remain underexamined. We present a qualitative study based on interviews with 20 stakeholders, including developers, implementers, and end users. Our analysis identifies three mutually reinforcing tensions: conceptual fragmentation regarding the definition of `agentic'; an autonomy contradiction where commercial promises exceed operational reality; and an evaluation blind spot that prioritizes technical benchmarks over sociotechnical safety. We argue that agentic {AI} functions as a site of contested meaning-making where technical aspirations, commercial incentives, and clinical constraints intersect, carrying material consequences for patient safety and the distribution of blame. |
| title | The Doctor Will (Still) See You Now: On the Structural Limits of Agentic AI in Healthcare |
| topic | Computers and Society Artificial Intelligence Human-Computer Interaction |
| url | https://arxiv.org/abs/2602.18460 |