XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916449176518656 |
|---|---|
| author | Hashmi, Anees Ur Rehman Almakky, Ibrahim Qazi, Mohammad Areeb Sanjeev, Santosh Papineni, Vijay Ram Jagdish, Jagalpathy Yaqub, Mohammad |
| author_facet | Hashmi, Anees Ur Rehman Almakky, Ibrahim Qazi, Mohammad Areeb Sanjeev, Santosh Papineni, Vijay Ram Jagdish, Jagalpathy Yaqub, Mohammad |
| contents | Large-scale generative models have demonstrated impressive capabilities in producing visually compelling images, with increasing applications in medical imaging. However, they continue to grapple with hallucination challenges and the generation of anatomically inaccurate outputs. These limitations are mainly due to the reliance on textual inputs and lack of spatial control over the generated images, hindering the potential usefulness of such models in real-life settings. In this work, we present XReal, a novel controllable diffusion model for generating realistic chest X-ray images through precise anatomy and pathology location control. Our lightweight method comprises an Anatomy Controller and a Pathology Controller to introduce spatial control over anatomy and pathology in a pre-trained Text-to-Image Diffusion Model, respectively, without fine-tuning the model. XReal outperforms state-of-the-art X-ray diffusion models in quantitative metrics and radiologists' ratings, showing significant gains in anatomy and pathology realism. Our model holds promise for advancing generative models in medical imaging, offering greater precision and adaptability while inviting further exploration in this evolving field. The code and pre-trained model weights are publicly available at https://github.com/BioMedIA-MBZUAI/XReal. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_09240 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model Hashmi, Anees Ur Rehman Almakky, Ibrahim Qazi, Mohammad Areeb Sanjeev, Santosh Papineni, Vijay Ram Jagdish, Jagalpathy Yaqub, Mohammad Image and Video Processing Computer Vision and Pattern Recognition Large-scale generative models have demonstrated impressive capabilities in producing visually compelling images, with increasing applications in medical imaging. However, they continue to grapple with hallucination challenges and the generation of anatomically inaccurate outputs. These limitations are mainly due to the reliance on textual inputs and lack of spatial control over the generated images, hindering the potential usefulness of such models in real-life settings. In this work, we present XReal, a novel controllable diffusion model for generating realistic chest X-ray images through precise anatomy and pathology location control. Our lightweight method comprises an Anatomy Controller and a Pathology Controller to introduce spatial control over anatomy and pathology in a pre-trained Text-to-Image Diffusion Model, respectively, without fine-tuning the model. XReal outperforms state-of-the-art X-ray diffusion models in quantitative metrics and radiologists' ratings, showing significant gains in anatomy and pathology realism. Our model holds promise for advancing generative models in medical imaging, offering greater precision and adaptability while inviting further exploration in this evolving field. The code and pre-trained model weights are publicly available at https://github.com/BioMedIA-MBZUAI/XReal. |
| title | XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.09240 |