Experience Retrieval-Augmentation with Electronic Health Records Enables Accurate Discharge QA

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ou, Justice, Huang, Tinglin, Zhao, Yilun, Yu, Ziyang, Lu, Peiqing, Ying, Rex
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912399877996544
author Ou, Justice
Huang, Tinglin
Zhao, Yilun
Yu, Ziyang
Lu, Peiqing
Ying, Rex
author_facet Ou, Justice
Huang, Tinglin
Zhao, Yilun
Yu, Ziyang
Lu, Peiqing
Ying, Rex
contents To improve the reliability of Large Language Models (LLMs) in clinical applications, retrieval-augmented generation (RAG) is extensively applied to provide factual medical knowledge. However, beyond general medical knowledge from open-ended datasets, clinical case-based knowledge is also critical for effective medical reasoning, as it provides context grounded in real-world patient experiences.Motivated by this, we propose Experience Retrieval-Augmentation ExpRAG framework based on Electronic Health Record(EHR), aiming to offer the relevant context from other patients' discharge reports. ExpRAG performs retrieval through a coarse-to-fine process, utilizing an EHR-based report ranker to efficiently identify similar patients, followed by an experience retriever to extract task-relevant content for enhanced medical reasoning.To evaluate ExpRAG, we introduce DischargeQA, a clinical QA dataset with 1,280 discharge-related questions across diagnosis, medication, and instruction tasks. Each problem is generated using EHR data to ensure realistic and challenging scenarios. Experimental results demonstrate that ExpRAG consistently outperforms a text-based ranker, achieving an average relative improvement of 5.2%, highlighting the importance of case-based knowledge for medical reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2503_17933
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Experience Retrieval-Augmentation with Electronic Health Records Enables Accurate Discharge QA
Ou, Justice
Huang, Tinglin
Zhao, Yilun
Yu, Ziyang
Lu, Peiqing
Ying, Rex
Computation and Language
Artificial Intelligence
Information Retrieval
To improve the reliability of Large Language Models (LLMs) in clinical applications, retrieval-augmented generation (RAG) is extensively applied to provide factual medical knowledge. However, beyond general medical knowledge from open-ended datasets, clinical case-based knowledge is also critical for effective medical reasoning, as it provides context grounded in real-world patient experiences.Motivated by this, we propose Experience Retrieval-Augmentation ExpRAG framework based on Electronic Health Record(EHR), aiming to offer the relevant context from other patients' discharge reports. ExpRAG performs retrieval through a coarse-to-fine process, utilizing an EHR-based report ranker to efficiently identify similar patients, followed by an experience retriever to extract task-relevant content for enhanced medical reasoning.To evaluate ExpRAG, we introduce DischargeQA, a clinical QA dataset with 1,280 discharge-related questions across diagnosis, medication, and instruction tasks. Each problem is generated using EHR data to ensure realistic and challenging scenarios. Experimental results demonstrate that ExpRAG consistently outperforms a text-based ranker, achieving an average relative improvement of 5.2%, highlighting the importance of case-based knowledge for medical reasoning.
title Experience Retrieval-Augmentation with Electronic Health Records Enables Accurate Discharge QA
topic Computation and Language
Artificial Intelligence
Information Retrieval
url https://arxiv.org/abs/2503.17933