ProSona: Prompt-Guided Personalization for Multi-Expert Medical Image Segmentation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914150701072384 |
|---|---|
| author | Elgebaly, Aya Delopoulos, Nikolaos Hörner-Rieber, Juliane Rippke, Carolin Klüter, Sebastian Boldrini, Luca Placidi, Lorenzo Bello, Riccardo Dal Andratschke, Nicolaus Baumgartl, Michael Belka, Claus Kurz, Christopher Landry, Guillaume Albarqouni, Shadi |
| author_facet | Elgebaly, Aya Delopoulos, Nikolaos Hörner-Rieber, Juliane Rippke, Carolin Klüter, Sebastian Boldrini, Luca Placidi, Lorenzo Bello, Riccardo Dal Andratschke, Nicolaus Baumgartl, Michael Belka, Claus Kurz, Christopher Landry, Guillaume Albarqouni, Shadi |
| contents | Automated medical image segmentation suffers from high inter-observer variability, particularly in tasks such as lung nodule delineation, where experts often disagree. Existing approaches either collapse this variability into a consensus mask or rely on separate model branches for each annotator. We introduce ProSona, a two-stage framework that learns a continuous latent space of annotation styles, enabling controllable personalization via natural language prompts. A probabilistic U-Net backbone captures diverse expert hypotheses, while a prompt-guided projection mechanism navigates this latent space to generate personalized segmentations. A multi-level contrastive objective aligns textual and visual representations, promoting disentangled and interpretable expert styles. Across the LIDC-IDRI lung nodule and multi-institutional prostate MRI datasets, ProSona reduces the Generalized Energy Distance by 17% and improves mean Dice by more than one point compared with DPersona. These results demonstrate that natural-language prompts can provide flexible, accurate, and interpretable control over personalized medical image segmentation. Our implementation is available online 1 . |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_08046 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ProSona: Prompt-Guided Personalization for Multi-Expert Medical Image Segmentation Elgebaly, Aya Delopoulos, Nikolaos Hörner-Rieber, Juliane Rippke, Carolin Klüter, Sebastian Boldrini, Luca Placidi, Lorenzo Bello, Riccardo Dal Andratschke, Nicolaus Baumgartl, Michael Belka, Claus Kurz, Christopher Landry, Guillaume Albarqouni, Shadi Computer Vision and Pattern Recognition Artificial Intelligence Automated medical image segmentation suffers from high inter-observer variability, particularly in tasks such as lung nodule delineation, where experts often disagree. Existing approaches either collapse this variability into a consensus mask or rely on separate model branches for each annotator. We introduce ProSona, a two-stage framework that learns a continuous latent space of annotation styles, enabling controllable personalization via natural language prompts. A probabilistic U-Net backbone captures diverse expert hypotheses, while a prompt-guided projection mechanism navigates this latent space to generate personalized segmentations. A multi-level contrastive objective aligns textual and visual representations, promoting disentangled and interpretable expert styles. Across the LIDC-IDRI lung nodule and multi-institutional prostate MRI datasets, ProSona reduces the Generalized Energy Distance by 17% and improves mean Dice by more than one point compared with DPersona. These results demonstrate that natural-language prompts can provide flexible, accurate, and interpretable control over personalized medical image segmentation. Our implementation is available online 1 . |
| title | ProSona: Prompt-Guided Personalization for Multi-Expert Medical Image Segmentation |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2511.08046 |