Integration of Large Language Models and Traditional Deep Learning for Social Determinants of Health Prediction

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Landes, Paul, Sun, Jimeng, Cross, Adam
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918012891693056
author Landes, Paul
Sun, Jimeng
Cross, Adam
author_facet Landes, Paul
Sun, Jimeng
Cross, Adam
contents Social Determinants of Health (SDoH) are economic, social and personal circumstances that affect or influence an individual's health status. SDoHs have shown to be correlated to wellness outcomes, and therefore, are useful to physicians in diagnosing diseases and in decision-making. In this work, we automatically extract SDoHs from clinical text using traditional deep learning and Large Language Models (LLMs) to find the advantages and disadvantages of each on an existing publicly available dataset. Our models outperform a previous reference point on a multilabel SDoH classification by 10 points, and we present a method and model to drastically speed up classification (12X execution time) by eliminating expensive LLM processing. The method we present combines a more nimble and efficient solution that leverages the power of the LLM for precision and traditional deep learning methods for efficiency. We also show highly performant results on a dataset supplemented with synthetic data and several traditional deep learning models that outperform LLMs. Our models and methods offer the next iteration of automatic prediction of SDoHs that impact at-risk patients.
format Preprint
id arxiv_https___arxiv_org_abs_2505_04655
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Integration of Large Language Models and Traditional Deep Learning for Social Determinants of Health Prediction
Landes, Paul
Sun, Jimeng
Cross, Adam
Computation and Language
Social Determinants of Health (SDoH) are economic, social and personal circumstances that affect or influence an individual's health status. SDoHs have shown to be correlated to wellness outcomes, and therefore, are useful to physicians in diagnosing diseases and in decision-making. In this work, we automatically extract SDoHs from clinical text using traditional deep learning and Large Language Models (LLMs) to find the advantages and disadvantages of each on an existing publicly available dataset. Our models outperform a previous reference point on a multilabel SDoH classification by 10 points, and we present a method and model to drastically speed up classification (12X execution time) by eliminating expensive LLM processing. The method we present combines a more nimble and efficient solution that leverages the power of the LLM for precision and traditional deep learning methods for efficiency. We also show highly performant results on a dataset supplemented with synthetic data and several traditional deep learning models that outperform LLMs. Our models and methods offer the next iteration of automatic prediction of SDoHs that impact at-risk patients.
title Integration of Large Language Models and Traditional Deep Learning for Social Determinants of Health Prediction
topic Computation and Language
url https://arxiv.org/abs/2505.04655