Improving Mortality Prediction After Radiotherapy with Large Language Model Structuring of Large-Scale Unstructured Electronic Health Records

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Park, Sangjoon, Wee, Chan Woo, Choi, Seo Hee, Kim, Kyung Hwan, Chang, Jee Suk, Yoon, Hong In, Lee, Ik Jae, Kim, Yong Bae, Cho, Jaeho, Keum, Ki Chang, Lee, Chang Geol, Byun, Hwa Kyung, Koom, Woong Sub
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917865594028032
author Park, Sangjoon
Wee, Chan Woo
Choi, Seo Hee
Kim, Kyung Hwan
Chang, Jee Suk
Yoon, Hong In
Lee, Ik Jae
Kim, Yong Bae
Cho, Jaeho
Keum, Ki Chang
Lee, Chang Geol
Byun, Hwa Kyung
Koom, Woong Sub
author_facet Park, Sangjoon
Wee, Chan Woo
Choi, Seo Hee
Kim, Kyung Hwan
Chang, Jee Suk
Yoon, Hong In
Lee, Ik Jae
Kim, Yong Bae
Cho, Jaeho
Keum, Ki Chang
Lee, Chang Geol
Byun, Hwa Kyung
Koom, Woong Sub
contents Accurate survival prediction in radiotherapy (RT) is critical for optimizing treatment decisions. This study developed and validated the RT-Surv framework, which integrates general-domain, open-source large language models (LLMs) to structure unstructured electronic health records alongside structured clinical data. Using data from 34,276 patients and an external cohort of 852, the framework successfully transformed unstructured clinical information into structured formats. Incorporating LLM-structured clinical features improved the concordance index from 0.779 to 0.842 during external validation, demonstrating a significant performance enhancement. Key LLM-structured features, such as disease extent, general condition, and RT purpose, showed high predictive importance and aligned closely with statistically significant predictors identified through conventional statistical analyses, thereby improving model interpretability. Furthermore, the framework enhanced risk stratification, enabling more distinct differentiation among low-, intermediate-, and high-risk groups (p < 0.001) using LLM-structured clinical features. These findings highlight the potential of LLMs to convert unstructured data into actionable insights, improving predictive modeling and patient outcomes in clinics.
format Preprint
id arxiv_https___arxiv_org_abs_2408_05074
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving Mortality Prediction After Radiotherapy with Large Language Model Structuring of Large-Scale Unstructured Electronic Health Records
Park, Sangjoon
Wee, Chan Woo
Choi, Seo Hee
Kim, Kyung Hwan
Chang, Jee Suk
Yoon, Hong In
Lee, Ik Jae
Kim, Yong Bae
Cho, Jaeho
Keum, Ki Chang
Lee, Chang Geol
Byun, Hwa Kyung
Koom, Woong Sub
Computation and Language
Artificial Intelligence
Accurate survival prediction in radiotherapy (RT) is critical for optimizing treatment decisions. This study developed and validated the RT-Surv framework, which integrates general-domain, open-source large language models (LLMs) to structure unstructured electronic health records alongside structured clinical data. Using data from 34,276 patients and an external cohort of 852, the framework successfully transformed unstructured clinical information into structured formats. Incorporating LLM-structured clinical features improved the concordance index from 0.779 to 0.842 during external validation, demonstrating a significant performance enhancement. Key LLM-structured features, such as disease extent, general condition, and RT purpose, showed high predictive importance and aligned closely with statistically significant predictors identified through conventional statistical analyses, thereby improving model interpretability. Furthermore, the framework enhanced risk stratification, enabling more distinct differentiation among low-, intermediate-, and high-risk groups (p < 0.001) using LLM-structured clinical features. These findings highlight the potential of LLMs to convert unstructured data into actionable insights, improving predictive modeling and patient outcomes in clinics.
title Improving Mortality Prediction After Radiotherapy with Large Language Model Structuring of Large-Scale Unstructured Electronic Health Records
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2408.05074