Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.08580 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915148458885120 |
|---|---|
| author | Freiche, Benoit El-Khoury, Anthony Nasiri-Sarvi, Ali Hosseini, Mahdi S. Garcia, Damien Basarab, Adrian Boily, Mathieu Rivaz, Hassan |
| author_facet | Freiche, Benoit El-Khoury, Anthony Nasiri-Sarvi, Ali Hosseini, Mahdi S. Garcia, Damien Basarab, Adrian Boily, Mathieu Rivaz, Hassan |
| contents | Diffusion models for image generation have been a subject of increasing interest due to their ability to generate diverse, high-quality images. Image generation has immense potential in medical imaging because open-source medical images are difficult to obtain compared to natural images, especially for rare conditions. The generated images can be used later to train classification and segmentation models. In this paper, we propose simulating realistic ultrasound (US) images by successive fine-tuning of large diffusion models on different publicly available databases. To do so, we fine-tuned Stable Diffusion, a state-of-the-art latent diffusion model, on BUSI (Breast US Images) an ultrasound breast image dataset. We successfully generated high-quality US images of the breast using simple prompts that specify the organ and pathology, which appeared realistic to three experienced US scientists and a US radiologist. Additionally, we provided user control by conditioning the model with segmentations through ControlNet. We will release the source code at http://code.sonography.ai/ to allow fast US image generation to the scientific community. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_08580 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Ultrasound Image Generation using Latent Diffusion Models Freiche, Benoit El-Khoury, Anthony Nasiri-Sarvi, Ali Hosseini, Mahdi S. Garcia, Damien Basarab, Adrian Boily, Mathieu Rivaz, Hassan Computer Vision and Pattern Recognition 68-06 Diffusion models for image generation have been a subject of increasing interest due to their ability to generate diverse, high-quality images. Image generation has immense potential in medical imaging because open-source medical images are difficult to obtain compared to natural images, especially for rare conditions. The generated images can be used later to train classification and segmentation models. In this paper, we propose simulating realistic ultrasound (US) images by successive fine-tuning of large diffusion models on different publicly available databases. To do so, we fine-tuned Stable Diffusion, a state-of-the-art latent diffusion model, on BUSI (Breast US Images) an ultrasound breast image dataset. We successfully generated high-quality US images of the breast using simple prompts that specify the organ and pathology, which appeared realistic to three experienced US scientists and a US radiologist. Additionally, we provided user control by conditioning the model with segmentations through ControlNet. We will release the source code at http://code.sonography.ai/ to allow fast US image generation to the scientific community. |
| title | Ultrasound Image Generation using Latent Diffusion Models |
| topic | Computer Vision and Pattern Recognition 68-06 |
| url | https://arxiv.org/abs/2502.08580 |