TP-Seg: Task-Prototype Framework for Unified Medical Lesion Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Jiawei, Zhou, Qiangqiang, Zhu, Dandan, Chen, Yong, Yi, Yugen, Zhao, Xiaoqi
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911559662436352
author Xu, Jiawei
Zhou, Qiangqiang
Zhu, Dandan
Chen, Yong
Yi, Yugen
Zhao, Xiaoqi
author_facet Xu, Jiawei
Zhou, Qiangqiang
Zhu, Dandan
Chen, Yong
Yi, Yugen
Zhao, Xiaoqi
contents Building a unified model with a single set of parameters to efficiently handle diverse types of medical lesion segmentation has become a crucial objective for AI-assisted diagnosis. Existing unified segmentation approaches typically rely on shared encoders across heterogeneous tasks and modalities, which often leads to feature entanglement, gradient interference, and suboptimal lesion discrimination. In this work, we propose TP-Seg, a task-prototype framework for unified medical lesion segmentation. On one hand, the task-conditioned adapter effectively balances shared and task-specific representations through a dual-path expert structure, enabling adaptive feature extraction across diverse medical imaging modalities and lesion types. On the other hand, the prototype-guided task decoder introduces learnable task prototypes as semantic anchors and employs a cross-attention mechanism to achieve fine-grained modeling of task-specific foreground and background semantics. Without bells and whistles, TP-Seg consistently outperforms specialized, general and unified segmentation methods across 8 different medical lesion segmentation tasks covering multiple imaging modalities, demonstrating strong generalization, scalability and clinical applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2604_00684
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TP-Seg: Task-Prototype Framework for Unified Medical Lesion Segmentation
Xu, Jiawei
Zhou, Qiangqiang
Zhu, Dandan
Chen, Yong
Yi, Yugen
Zhao, Xiaoqi
Computer Vision and Pattern Recognition
Building a unified model with a single set of parameters to efficiently handle diverse types of medical lesion segmentation has become a crucial objective for AI-assisted diagnosis. Existing unified segmentation approaches typically rely on shared encoders across heterogeneous tasks and modalities, which often leads to feature entanglement, gradient interference, and suboptimal lesion discrimination. In this work, we propose TP-Seg, a task-prototype framework for unified medical lesion segmentation. On one hand, the task-conditioned adapter effectively balances shared and task-specific representations through a dual-path expert structure, enabling adaptive feature extraction across diverse medical imaging modalities and lesion types. On the other hand, the prototype-guided task decoder introduces learnable task prototypes as semantic anchors and employs a cross-attention mechanism to achieve fine-grained modeling of task-specific foreground and background semantics. Without bells and whistles, TP-Seg consistently outperforms specialized, general and unified segmentation methods across 8 different medical lesion segmentation tasks covering multiple imaging modalities, demonstrating strong generalization, scalability and clinical applicability.
title TP-Seg: Task-Prototype Framework for Unified Medical Lesion Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.00684