Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2604.26214 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917445306941440 |
|---|---|
| author | Rahman, Hasibur Numata, Kenji Lai, Evelyn T Cheriyan, Maria Haimovich, Adrian Ouchi, Kei Desai, Smit |
| author_facet | Rahman, Hasibur Numata, Kenji Lai, Evelyn T Cheriyan, Maria Haimovich, Adrian Ouchi, Kei Desai, Smit |
| contents | Serious illness conversations (SICs) align care with patients' values, goals, and preferences, yet they rarely occur in emergency departments (EDs), where time constraints and emotional burden often leave clinicians making high-stakes decisions without documented insight into what matters most to patients. We present a case study of ED GOAL-AI, a voice-based conversational agent for brief, structured values discussions with older adults in the ED, evaluated with 55 patients for feasibility and acceptability. Most participants completed the conversation and reported the interaction as acceptable and feasible, with ratings of feeling heard and understood comparable to clinicians. However, we also observed critical failure modes, including boundary violations such as hallucinated diagnostic statements, highlighting ethical and emotional risks. This work points to early promise for AI-mediated SICs while underscoring the need for careful boundary setting and participatory design before broader deployment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_26214 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Exploring the Feasibility and Acceptability of AI-Mediated Serious Illness Conversations in the Emergency Department Rahman, Hasibur Numata, Kenji Lai, Evelyn T Cheriyan, Maria Haimovich, Adrian Ouchi, Kei Desai, Smit Human-Computer Interaction Serious illness conversations (SICs) align care with patients' values, goals, and preferences, yet they rarely occur in emergency departments (EDs), where time constraints and emotional burden often leave clinicians making high-stakes decisions without documented insight into what matters most to patients. We present a case study of ED GOAL-AI, a voice-based conversational agent for brief, structured values discussions with older adults in the ED, evaluated with 55 patients for feasibility and acceptability. Most participants completed the conversation and reported the interaction as acceptable and feasible, with ratings of feeling heard and understood comparable to clinicians. However, we also observed critical failure modes, including boundary violations such as hallucinated diagnostic statements, highlighting ethical and emotional risks. This work points to early promise for AI-mediated SICs while underscoring the need for careful boundary setting and participatory design before broader deployment. |
| title | Exploring the Feasibility and Acceptability of AI-Mediated Serious Illness Conversations in the Emergency Department |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2604.26214 |