Paired Image Generation with Diffusion-Guided Diffusion Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Haoxuan, Cui, Wenju, Cao, Yuzhu, Tan, Tao, Liu, Jie, Peng, Yunsong, Zheng, Jian
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915738746355712
author Zhang, Haoxuan
Cui, Wenju
Cao, Yuzhu
Tan, Tao
Liu, Jie
Peng, Yunsong
Zheng, Jian
author_facet Zhang, Haoxuan
Cui, Wenju
Cao, Yuzhu
Tan, Tao
Liu, Jie
Peng, Yunsong
Zheng, Jian
contents The segmentation of mass lesions in digital breast tomosynthesis (DBT) images is very significant for the early screening of breast cancer. However, the high-density breast tissue often leads to high concealment of the mass lesions, which makes manual annotation difficult and time-consuming. As a result, there is a lack of annotated data for model training. Diffusion models are commonly used for data augmentation, but the existing methods face two challenges. First, due to the high concealment of lesions, it is difficult for the model to learn the features of the lesion area. This leads to the low generation quality of the lesion areas, thus limiting the quality of the generated images. Second, existing methods can only generate images and cannot generate corresponding annotations, which restricts the usability of the generated images in supervised training. In this work, we propose a paired image generation method. The method does not require external conditions and can achieve the generation of paired images by training an extra diffusion guider for the conditional diffusion model. During the experimental phase, we generated paired DBT slices and mass lesion masks. Then, we incorporated them into the supervised training process of the mass lesion segmentation task. The experimental results show that our method can improve the generation quality without external conditions. Moreover, it contributes to alleviating the shortage of annotated data, thus enhancing the performance of downstream tasks. The source code is available at https://github.com/zhanghx1320/PIG.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14833
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Paired Image Generation with Diffusion-Guided Diffusion Models
Zhang, Haoxuan
Cui, Wenju
Cao, Yuzhu
Tan, Tao
Liu, Jie
Peng, Yunsong
Zheng, Jian
Computer Vision and Pattern Recognition
Artificial Intelligence
The segmentation of mass lesions in digital breast tomosynthesis (DBT) images is very significant for the early screening of breast cancer. However, the high-density breast tissue often leads to high concealment of the mass lesions, which makes manual annotation difficult and time-consuming. As a result, there is a lack of annotated data for model training. Diffusion models are commonly used for data augmentation, but the existing methods face two challenges. First, due to the high concealment of lesions, it is difficult for the model to learn the features of the lesion area. This leads to the low generation quality of the lesion areas, thus limiting the quality of the generated images. Second, existing methods can only generate images and cannot generate corresponding annotations, which restricts the usability of the generated images in supervised training. In this work, we propose a paired image generation method. The method does not require external conditions and can achieve the generation of paired images by training an extra diffusion guider for the conditional diffusion model. During the experimental phase, we generated paired DBT slices and mass lesion masks. Then, we incorporated them into the supervised training process of the mass lesion segmentation task. The experimental results show that our method can improve the generation quality without external conditions. Moreover, it contributes to alleviating the shortage of annotated data, thus enhancing the performance of downstream tasks. The source code is available at https://github.com/zhanghx1320/PIG.
title Paired Image Generation with Diffusion-Guided Diffusion Models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2507.14833