Automated Clinical Problem Detection from SOAP Notes using a Collaborative Multi-Agent LLM Architecture

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lee, Yeawon, Wang, Xiaoyang, Yang, Christopher C.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908510087806976
author Lee, Yeawon
Wang, Xiaoyang
Yang, Christopher C.
author_facet Lee, Yeawon
Wang, Xiaoyang
Yang, Christopher C.
contents Accurate interpretation of clinical narratives is critical for patient care, but the complexity of these notes makes automation challenging. While Large Language Models (LLMs) show promise, single-model approaches can lack the robustness required for high-stakes clinical tasks. We introduce a collaborative multi-agent system (MAS) that models a clinical consultation team to address this gap. The system is tasked with identifying clinical problems by analyzing only the Subjective (S) and Objective (O) sections of SOAP notes, simulating the diagnostic reasoning process of synthesizing raw data into an assessment. A Manager agent orchestrates a dynamically assigned team of specialist agents who engage in a hierarchical, iterative debate to reach a consensus. We evaluated our MAS against a single-agent baseline on a curated dataset of 420 MIMIC-III notes. The dynamic multi-agent configuration demonstrated consistently improved performance in identifying congestive heart failure, acute kidney injury, and sepsis. Qualitative analysis of the agent debates reveals that this structure effectively surfaces and weighs conflicting evidence, though it can occasionally be susceptible to groupthink. By modeling a clinical team's reasoning process, our system offers a promising path toward more accurate, robust, and interpretable clinical decision support tools.
format Preprint
id arxiv_https___arxiv_org_abs_2508_21803
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Automated Clinical Problem Detection from SOAP Notes using a Collaborative Multi-Agent LLM Architecture
Lee, Yeawon
Wang, Xiaoyang
Yang, Christopher C.
Artificial Intelligence
Multiagent Systems
Accurate interpretation of clinical narratives is critical for patient care, but the complexity of these notes makes automation challenging. While Large Language Models (LLMs) show promise, single-model approaches can lack the robustness required for high-stakes clinical tasks. We introduce a collaborative multi-agent system (MAS) that models a clinical consultation team to address this gap. The system is tasked with identifying clinical problems by analyzing only the Subjective (S) and Objective (O) sections of SOAP notes, simulating the diagnostic reasoning process of synthesizing raw data into an assessment. A Manager agent orchestrates a dynamically assigned team of specialist agents who engage in a hierarchical, iterative debate to reach a consensus. We evaluated our MAS against a single-agent baseline on a curated dataset of 420 MIMIC-III notes. The dynamic multi-agent configuration demonstrated consistently improved performance in identifying congestive heart failure, acute kidney injury, and sepsis. Qualitative analysis of the agent debates reveals that this structure effectively surfaces and weighs conflicting evidence, though it can occasionally be susceptible to groupthink. By modeling a clinical team's reasoning process, our system offers a promising path toward more accurate, robust, and interpretable clinical decision support tools.
title Automated Clinical Problem Detection from SOAP Notes using a Collaborative Multi-Agent LLM Architecture
topic Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2508.21803