DALL-M: Context-Aware Clinical Data Augmentation with LLMs

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hsieh, Chihcheng, Moreira, Catarina, Nobre, Isabel Blanco, Sousa, Sandra Costa, Ouyang, Chun, Brereton, Margot, Jorge, Joaquim, Nascimento, Jacinto C.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909538041462784
author Hsieh, Chihcheng
Moreira, Catarina
Nobre, Isabel Blanco
Sousa, Sandra Costa
Ouyang, Chun
Brereton, Margot
Jorge, Joaquim
Nascimento, Jacinto C.
author_facet Hsieh, Chihcheng
Moreira, Catarina
Nobre, Isabel Blanco
Sousa, Sandra Costa
Ouyang, Chun
Brereton, Margot
Jorge, Joaquim
Nascimento, Jacinto C.
contents X-ray images are vital in medical diagnostics, but their effectiveness is limited without clinical context. Radiologists often find chest X-rays insufficient for diagnosing underlying diseases, necessitating the integration of structured clinical features with radiology reports. To address this, we introduce DALL-M, a novel framework that enhances clinical datasets by generating contextual synthetic data. DALL-M augments structured patient data, including vital signs (e.g., heart rate, oxygen saturation), radiology findings (e.g., lesion presence), and demographic factors. It integrates this tabular data with contextual knowledge extracted from radiology reports and domain-specific resources (e.g., Radiopaedia, Wikipedia), ensuring clinical consistency and reliability. DALL-M follows a three-phase process: (i) clinical context storage, (ii) expert query generation, and (iii) context-aware feature augmentation. Using large language models (LLMs), it generates both contextual synthetic values for existing clinical features and entirely new, clinically relevant features. Applied to 799 cases from the MIMIC-IV dataset, DALL-M expanded the original 9 clinical features to 91. Empirical validation with machine learning models (including Decision Trees, Random Forests, XGBoost, and TabNET) demonstrated a 16.5% improvement in F1 score and a 25% increase in Precision and Recall. DALL-M bridges an important gap in clinical data augmentation by preserving data integrity while enhancing predictive modeling in healthcare. Our results show that integrating LLM-generated synthetic features significantly improves model performance, making DALL-M a scalable and practical approach for AI-driven medical diagnostics.
format Preprint
id arxiv_https___arxiv_org_abs_2407_08227
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DALL-M: Context-Aware Clinical Data Augmentation with LLMs
Hsieh, Chihcheng
Moreira, Catarina
Nobre, Isabel Blanco
Sousa, Sandra Costa
Ouyang, Chun
Brereton, Margot
Jorge, Joaquim
Nascimento, Jacinto C.
Artificial Intelligence
Information Retrieval
Machine Learning
I.5.1; J.3; H.3.3; I.2.7
X-ray images are vital in medical diagnostics, but their effectiveness is limited without clinical context. Radiologists often find chest X-rays insufficient for diagnosing underlying diseases, necessitating the integration of structured clinical features with radiology reports. To address this, we introduce DALL-M, a novel framework that enhances clinical datasets by generating contextual synthetic data. DALL-M augments structured patient data, including vital signs (e.g., heart rate, oxygen saturation), radiology findings (e.g., lesion presence), and demographic factors. It integrates this tabular data with contextual knowledge extracted from radiology reports and domain-specific resources (e.g., Radiopaedia, Wikipedia), ensuring clinical consistency and reliability. DALL-M follows a three-phase process: (i) clinical context storage, (ii) expert query generation, and (iii) context-aware feature augmentation. Using large language models (LLMs), it generates both contextual synthetic values for existing clinical features and entirely new, clinically relevant features. Applied to 799 cases from the MIMIC-IV dataset, DALL-M expanded the original 9 clinical features to 91. Empirical validation with machine learning models (including Decision Trees, Random Forests, XGBoost, and TabNET) demonstrated a 16.5% improvement in F1 score and a 25% increase in Precision and Recall. DALL-M bridges an important gap in clinical data augmentation by preserving data integrity while enhancing predictive modeling in healthcare. Our results show that integrating LLM-generated synthetic features significantly improves model performance, making DALL-M a scalable and practical approach for AI-driven medical diagnostics.
title DALL-M: Context-Aware Clinical Data Augmentation with LLMs
topic Artificial Intelligence
Information Retrieval
Machine Learning
I.5.1; J.3; H.3.3; I.2.7
url https://arxiv.org/abs/2407.08227