MedCoT: Medical Chain of Thought via Hierarchical Expert

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Jiaxiang, Wang, Yuan, Du, Jiawei, Zhou, Joey Tianyi, Liu, Zuozhu
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909432821055488
author Liu, Jiaxiang
Wang, Yuan
Du, Jiawei
Zhou, Joey Tianyi
Liu, Zuozhu
author_facet Liu, Jiaxiang
Wang, Yuan
Du, Jiawei
Zhou, Joey Tianyi
Liu, Zuozhu
contents Artificial intelligence has advanced in Medical Visual Question Answering (Med-VQA), but prevalent research tends to focus on the accuracy of the answers, often overlooking the reasoning paths and interpretability, which are crucial in clinical settings. Besides, current Med-VQA algorithms, typically reliant on singular models, lack the robustness needed for real-world medical diagnostics which usually require collaborative expert evaluation. To address these shortcomings, this paper presents MedCoT, a novel hierarchical expert verification reasoning chain method designed to enhance interpretability and accuracy in biomedical imaging inquiries. MedCoT is predicated on two principles: The necessity for explicit reasoning paths in Med-VQA and the requirement for multi-expert review to formulate accurate conclusions. The methodology involves an Initial Specialist proposing diagnostic rationales, followed by a Follow-up Specialist who validates these rationales, and finally, a consensus is reached through a vote among a sparse Mixture of Experts within the locally deployed Diagnostic Specialist, which then provides the definitive diagnosis. Experimental evaluations on four standard Med-VQA datasets demonstrate that MedCoT surpasses existing state-of-the-art approaches, providing significant improvements in performance and interpretability.
format Preprint
id arxiv_https___arxiv_org_abs_2412_13736
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MedCoT: Medical Chain of Thought via Hierarchical Expert
Liu, Jiaxiang
Wang, Yuan
Du, Jiawei
Zhou, Joey Tianyi
Liu, Zuozhu
Computer Vision and Pattern Recognition
Artificial intelligence has advanced in Medical Visual Question Answering (Med-VQA), but prevalent research tends to focus on the accuracy of the answers, often overlooking the reasoning paths and interpretability, which are crucial in clinical settings. Besides, current Med-VQA algorithms, typically reliant on singular models, lack the robustness needed for real-world medical diagnostics which usually require collaborative expert evaluation. To address these shortcomings, this paper presents MedCoT, a novel hierarchical expert verification reasoning chain method designed to enhance interpretability and accuracy in biomedical imaging inquiries. MedCoT is predicated on two principles: The necessity for explicit reasoning paths in Med-VQA and the requirement for multi-expert review to formulate accurate conclusions. The methodology involves an Initial Specialist proposing diagnostic rationales, followed by a Follow-up Specialist who validates these rationales, and finally, a consensus is reached through a vote among a sparse Mixture of Experts within the locally deployed Diagnostic Specialist, which then provides the definitive diagnosis. Experimental evaluations on four standard Med-VQA datasets demonstrate that MedCoT surpasses existing state-of-the-art approaches, providing significant improvements in performance and interpretability.
title MedCoT: Medical Chain of Thought via Hierarchical Expert
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.13736