Effectiveness of ChatGPT in explaining complex medical reports to patients

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sun, Mengxuan, Reiter, Ehud, Kiltie, Anne E, Ramsay, George, Duncan, Lisa, Murchie, Peter, Adam, Rosalind
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914845298786304
author Sun, Mengxuan
Reiter, Ehud
Kiltie, Anne E
Ramsay, George
Duncan, Lisa
Murchie, Peter
Adam, Rosalind
author_facet Sun, Mengxuan
Reiter, Ehud
Kiltie, Anne E
Ramsay, George
Duncan, Lisa
Murchie, Peter
Adam, Rosalind
contents Electronic health records contain detailed information about the medical condition of patients, but they are difficult for patients to understand even if they have access to them. We explore whether ChatGPT (GPT 4) can help explain multidisciplinary team (MDT) reports to colorectal and prostate cancer patients. These reports are written in dense medical language and assume clinical knowledge, so they are a good test of the ability of ChatGPT to explain complex medical reports to patients. We asked clinicians and lay people (not patients) to review explanations and responses of ChatGPT. We also ran three focus groups (including cancer patients, caregivers, computer scientists, and clinicians) to discuss output of ChatGPT. Our studies highlighted issues with inaccurate information, inappropriate language, limited personalization, AI distrust, and challenges integrating large language models (LLMs) into clinical workflow. These issues will need to be resolved before LLMs can be used to explain complex personal medical information to patients.
format Preprint
id arxiv_https___arxiv_org_abs_2406_15963
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Effectiveness of ChatGPT in explaining complex medical reports to patients
Sun, Mengxuan
Reiter, Ehud
Kiltie, Anne E
Ramsay, George
Duncan, Lisa
Murchie, Peter
Adam, Rosalind
Human-Computer Interaction
Computation and Language
Other Quantitative Biology
Electronic health records contain detailed information about the medical condition of patients, but they are difficult for patients to understand even if they have access to them. We explore whether ChatGPT (GPT 4) can help explain multidisciplinary team (MDT) reports to colorectal and prostate cancer patients. These reports are written in dense medical language and assume clinical knowledge, so they are a good test of the ability of ChatGPT to explain complex medical reports to patients. We asked clinicians and lay people (not patients) to review explanations and responses of ChatGPT. We also ran three focus groups (including cancer patients, caregivers, computer scientists, and clinicians) to discuss output of ChatGPT. Our studies highlighted issues with inaccurate information, inappropriate language, limited personalization, AI distrust, and challenges integrating large language models (LLMs) into clinical workflow. These issues will need to be resolved before LLMs can be used to explain complex personal medical information to patients.
title Effectiveness of ChatGPT in explaining complex medical reports to patients
topic Human-Computer Interaction
Computation and Language
Other Quantitative Biology
url https://arxiv.org/abs/2406.15963