Align then Refine: Text-Guided 3D Prostate Lesion Segmentation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917423654895616 |
|---|---|
| author | Sun, Cuiling Peng, Linkai Murphy, Adam Keles, Elif Patel, Hiten D. Ross, Ashley Miller, Frank Turkbey, Baris Bejar, Andrea Mia Aktas, Halil Ertugrul Durak, Gorkem Bagci, Ulas |
| author_facet | Sun, Cuiling Peng, Linkai Murphy, Adam Keles, Elif Patel, Hiten D. Ross, Ashley Miller, Frank Turkbey, Baris Bejar, Andrea Mia Aktas, Halil Ertugrul Durak, Gorkem Bagci, Ulas |
| contents | Automated 3D segmentation of prostate lesions from biparametric MRI (bp-MRI) is essential for reliable algorithmic analysis, but achieving high precision remains challenging. Volumetric methods must combine multiple modalities while ensuring anatomical consistency, but current models struggle to integrate cross-modal information reliably. While vision-language models (VLMs) are replacing the currently used architectural designs, they still lack the fine-grained, lesion-level semantics required for effective localized guidance. To address these limitations, we propose a new multi-encoder U-Net architecture incorporating three key innovations: (1) an alignment loss that enhances foreground text-image similarity to inject lesion semantics; (2) a heatmap loss that calibrates the similarity map and suppresses spurious background activations; and (3) a final-stage, confidence-gated multi-head cross-attention refiner that performs localized boundary edits in high-confidence regions. A phase-scheduled training regime stabilizes the optimization of these components. Our method consistently outperforms prior approaches, establishing a new state-of-the-art on the PI-CAI dataset through enhanced multi-modal fusion and localized text guidance. Our code is available at https://github.com/NUBagciLab/Prostate-Lesion-Segmentation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_18713 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Align then Refine: Text-Guided 3D Prostate Lesion Segmentation Sun, Cuiling Peng, Linkai Murphy, Adam Keles, Elif Patel, Hiten D. Ross, Ashley Miller, Frank Turkbey, Baris Bejar, Andrea Mia Aktas, Halil Ertugrul Durak, Gorkem Bagci, Ulas Computer Vision and Pattern Recognition Automated 3D segmentation of prostate lesions from biparametric MRI (bp-MRI) is essential for reliable algorithmic analysis, but achieving high precision remains challenging. Volumetric methods must combine multiple modalities while ensuring anatomical consistency, but current models struggle to integrate cross-modal information reliably. While vision-language models (VLMs) are replacing the currently used architectural designs, they still lack the fine-grained, lesion-level semantics required for effective localized guidance. To address these limitations, we propose a new multi-encoder U-Net architecture incorporating three key innovations: (1) an alignment loss that enhances foreground text-image similarity to inject lesion semantics; (2) a heatmap loss that calibrates the similarity map and suppresses spurious background activations; and (3) a final-stage, confidence-gated multi-head cross-attention refiner that performs localized boundary edits in high-confidence regions. A phase-scheduled training regime stabilizes the optimization of these components. Our method consistently outperforms prior approaches, establishing a new state-of-the-art on the PI-CAI dataset through enhanced multi-modal fusion and localized text guidance. Our code is available at https://github.com/NUBagciLab/Prostate-Lesion-Segmentation. |
| title | Align then Refine: Text-Guided 3D Prostate Lesion Segmentation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2604.18713 |