The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate It
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915064720654336 |
|---|---|
| author | Nicolson, Aaron Zhuang, Shengyao Dowling, Jason Koopman, Bevan |
| author_facet | Nicolson, Aaron Zhuang, Shengyao Dowling, Jason Koopman, Bevan |
| contents | This study investigates the integration of diverse patient data sources into multimodal language models for automated chest X-ray (CXR) report generation. Traditionally, CXR report generation relies solely on CXR images and limited radiology data, overlooking valuable information from patient health records, particularly from emergency departments. Utilising the MIMIC-CXR and MIMIC-IV-ED datasets, we incorporate detailed patient information such as vital signs, medicines, and clinical history to enhance diagnostic accuracy. We introduce a novel approach to transform these heterogeneous data sources into embeddings that prompt a multimodal language model; this significantly enhances the diagnostic accuracy of generated radiology reports. Our comprehensive evaluation demonstrates the benefits of using a broader set of patient data, underscoring the potential for enhanced diagnostic capabilities and better patient outcomes through the integration of multimodal data in CXR report generation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_13181 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate It Nicolson, Aaron Zhuang, Shengyao Dowling, Jason Koopman, Bevan Computer Vision and Pattern Recognition This study investigates the integration of diverse patient data sources into multimodal language models for automated chest X-ray (CXR) report generation. Traditionally, CXR report generation relies solely on CXR images and limited radiology data, overlooking valuable information from patient health records, particularly from emergency departments. Utilising the MIMIC-CXR and MIMIC-IV-ED datasets, we incorporate detailed patient information such as vital signs, medicines, and clinical history to enhance diagnostic accuracy. We introduce a novel approach to transform these heterogeneous data sources into embeddings that prompt a multimodal language model; this significantly enhances the diagnostic accuracy of generated radiology reports. Our comprehensive evaluation demonstrates the benefits of using a broader set of patient data, underscoring the potential for enhanced diagnostic capabilities and better patient outcomes through the integration of multimodal data in CXR report generation. |
| title | The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate It |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.13181 |