CriDiff: Criss-cross Injection Diffusion Framework via Generative Pre-train for Prostate Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Tingwei, Zhang, Miao, Liu, Leiye, Zhong, Jialong, Wang, Shuyao, Piao, Yongri, Lu, Huchuan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913398465232896
author Liu, Tingwei
Zhang, Miao
Liu, Leiye
Zhong, Jialong
Wang, Shuyao
Piao, Yongri
Lu, Huchuan
author_facet Liu, Tingwei
Zhang, Miao
Liu, Leiye
Zhong, Jialong
Wang, Shuyao
Piao, Yongri
Lu, Huchuan
contents Recently, the Diffusion Probabilistic Model (DPM)-based methods have achieved substantial success in the field of medical image segmentation. However, most of these methods fail to enable the diffusion model to learn edge features and non-edge features effectively and to inject them efficiently into the diffusion backbone. Additionally, the domain gap between the images features and the diffusion model features poses a great challenge to prostate segmentation. In this paper, we proposed CriDiff, a two-stage feature injecting framework with a Crisscross Injection Strategy (CIS) and a Generative Pre-train (GP) approach for prostate segmentation. The CIS maximizes the use of multi-level features by efficiently harnessing the complementarity of high and low-level features. To effectively learn multi-level of edge features and non-edge features, we proposed two parallel conditioners in the CIS: the Boundary Enhance Conditioner (BEC) and the Core Enhance Conditioner (CEC), which discriminatively model the image edge regions and non-edge regions, respectively. Moreover, the GP approach eases the inconsistency between the images features and the diffusion model without adding additional parameters. Extensive experiments on four benchmark datasets demonstrate the effectiveness of the proposed method and achieve state-of-the-art performance on four evaluation metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2406_14186
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CriDiff: Criss-cross Injection Diffusion Framework via Generative Pre-train for Prostate Segmentation
Liu, Tingwei
Zhang, Miao
Liu, Leiye
Zhong, Jialong
Wang, Shuyao
Piao, Yongri
Lu, Huchuan
Image and Video Processing
Computer Vision and Pattern Recognition
Recently, the Diffusion Probabilistic Model (DPM)-based methods have achieved substantial success in the field of medical image segmentation. However, most of these methods fail to enable the diffusion model to learn edge features and non-edge features effectively and to inject them efficiently into the diffusion backbone. Additionally, the domain gap between the images features and the diffusion model features poses a great challenge to prostate segmentation. In this paper, we proposed CriDiff, a two-stage feature injecting framework with a Crisscross Injection Strategy (CIS) and a Generative Pre-train (GP) approach for prostate segmentation. The CIS maximizes the use of multi-level features by efficiently harnessing the complementarity of high and low-level features. To effectively learn multi-level of edge features and non-edge features, we proposed two parallel conditioners in the CIS: the Boundary Enhance Conditioner (BEC) and the Core Enhance Conditioner (CEC), which discriminatively model the image edge regions and non-edge regions, respectively. Moreover, the GP approach eases the inconsistency between the images features and the diffusion model without adding additional parameters. Extensive experiments on four benchmark datasets demonstrate the effectiveness of the proposed method and achieve state-of-the-art performance on four evaluation metrics.
title CriDiff: Criss-cross Injection Diffusion Framework via Generative Pre-train for Prostate Segmentation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.14186