Conversational Disease Diagnosis via External Planner-Controlled Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sun, Zhoujian, Luo, Cheng, Liu, Ziyi, Huang, Zhengxing
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913355744149504
author Sun, Zhoujian
Luo, Cheng
Liu, Ziyi
Huang, Zhengxing
author_facet Sun, Zhoujian
Luo, Cheng
Liu, Ziyi
Huang, Zhengxing
contents The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear because they are not adept at collecting patient data proactively. This study presents a LLM-based diagnostic system that enhances planning capabilities by emulating doctors. Our system involves two external planners to handle planning tasks. The first planner employs a reinforcement learning approach to formulate disease screening questions and conduct initial diagnoses. The second planner uses LLMs to parse medical guidelines and conduct differential diagnoses. By utilizing real patient electronic medical record data, we constructed simulated dialogues between virtual patients and doctors and evaluated the diagnostic abilities of our system. We demonstrated that our system obtained impressive performance in both disease screening and differential diagnoses tasks. This research represents a step towards more seamlessly integrating AI into clinical settings, potentially enhancing the accuracy and accessibility of medical diagnostics.
format Preprint
id arxiv_https___arxiv_org_abs_2404_04292
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Conversational Disease Diagnosis via External Planner-Controlled Large Language Models
Sun, Zhoujian
Luo, Cheng
Liu, Ziyi
Huang, Zhengxing
Computation and Language
Artificial Intelligence
The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear because they are not adept at collecting patient data proactively. This study presents a LLM-based diagnostic system that enhances planning capabilities by emulating doctors. Our system involves two external planners to handle planning tasks. The first planner employs a reinforcement learning approach to formulate disease screening questions and conduct initial diagnoses. The second planner uses LLMs to parse medical guidelines and conduct differential diagnoses. By utilizing real patient electronic medical record data, we constructed simulated dialogues between virtual patients and doctors and evaluated the diagnostic abilities of our system. We demonstrated that our system obtained impressive performance in both disease screening and differential diagnoses tasks. This research represents a step towards more seamlessly integrating AI into clinical settings, potentially enhancing the accuracy and accessibility of medical diagnostics.
title Conversational Disease Diagnosis via External Planner-Controlled Large Language Models
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2404.04292