Saved in:
Bibliographic Details
Main Authors: Tabassum, Maliha, Kaiser, M Shamim
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.17559
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908722497847296
author Tabassum, Maliha
Kaiser, M Shamim
author_facet Tabassum, Maliha
Kaiser, M Shamim
contents Healthcare systems around the world are grappling with issues like inefficient diagnostics, rising costs, and limited access to specialists. These problems often lead to delays in treatment and poor health outcomes. Most current AI and deep learning diagnostic systems are not very interactive or transparent, making them less effective in real-world, patient-centered environments. This research introduces a diagnostic chatbot powered by a Large Language Model (LLM), using GPT-4o, Retrieval-Augmented Generation, and explainable AI techniques. The chatbot engages patients in a dynamic conversation, helping to extract and normalize symptoms while prioritizing potential diagnoses through similarity matching and adaptive questioning. With Chain-of-Thought prompting, the system also offers more transparent reasoning behind its diagnoses. When tested against traditional machine learning models like Naive Bayes, Logistic Regression, SVM, Random Forest, and KNN, the LLM-based system delivered impressive results, achieving an accuracy of 90% and Top-3 accuracy of 100%. These findings offer a promising outlook for more transparent, interactive, and clinically relevant AI in healthcare.
format Preprint
id arxiv_https___arxiv_org_abs_2512_17559
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Explainable Conversational AI for Early Diagnosis with Large Language Models
Tabassum, Maliha
Kaiser, M Shamim
Artificial Intelligence
Healthcare systems around the world are grappling with issues like inefficient diagnostics, rising costs, and limited access to specialists. These problems often lead to delays in treatment and poor health outcomes. Most current AI and deep learning diagnostic systems are not very interactive or transparent, making them less effective in real-world, patient-centered environments. This research introduces a diagnostic chatbot powered by a Large Language Model (LLM), using GPT-4o, Retrieval-Augmented Generation, and explainable AI techniques. The chatbot engages patients in a dynamic conversation, helping to extract and normalize symptoms while prioritizing potential diagnoses through similarity matching and adaptive questioning. With Chain-of-Thought prompting, the system also offers more transparent reasoning behind its diagnoses. When tested against traditional machine learning models like Naive Bayes, Logistic Regression, SVM, Random Forest, and KNN, the LLM-based system delivered impressive results, achieving an accuracy of 90% and Top-3 accuracy of 100%. These findings offer a promising outlook for more transparent, interactive, and clinically relevant AI in healthcare.
title Towards Explainable Conversational AI for Early Diagnosis with Large Language Models
topic Artificial Intelligence
url https://arxiv.org/abs/2512.17559