WSI-Agents: A Collaborative Multi-Agent System for Multi-Modal Whole Slide Image Analysis
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909696666894336 |
|---|---|
| author | Lyu, Xinheng Liang, Yuci Chen, Wenting Ding, Meidan Yang, Jiaqi Huang, Guolin Zhang, Daokun He, Xiangjian Shen, Linlin |
| author_facet | Lyu, Xinheng Liang, Yuci Chen, Wenting Ding, Meidan Yang, Jiaqi Huang, Guolin Zhang, Daokun He, Xiangjian Shen, Linlin |
| contents | Whole slide images (WSIs) are vital in digital pathology, enabling gigapixel tissue analysis across various pathological tasks. While recent advancements in multi-modal large language models (MLLMs) allow multi-task WSI analysis through natural language, they often underperform compared to task-specific models. Collaborative multi-agent systems have emerged as a promising solution to balance versatility and accuracy in healthcare, yet their potential remains underexplored in pathology-specific domains. To address these issues, we propose WSI-Agents, a novel collaborative multi-agent system for multi-modal WSI analysis. WSI-Agents integrates specialized functional agents with robust task allocation and verification mechanisms to enhance both task-specific accuracy and multi-task versatility through three components: (1) a task allocation module assigning tasks to expert agents using a model zoo of patch and WSI level MLLMs, (2) a verification mechanism ensuring accuracy through internal consistency checks and external validation using pathology knowledge bases and domain-specific models, and (3) a summary module synthesizing the final summary with visual interpretation maps. Extensive experiments on multi-modal WSI benchmarks show WSI-Agents's superiority to current WSI MLLMs and medical agent frameworks across diverse tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_14680 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | WSI-Agents: A Collaborative Multi-Agent System for Multi-Modal Whole Slide Image Analysis Lyu, Xinheng Liang, Yuci Chen, Wenting Ding, Meidan Yang, Jiaqi Huang, Guolin Zhang, Daokun He, Xiangjian Shen, Linlin Computer Vision and Pattern Recognition Artificial Intelligence 68T07, 92C55 I.2.7; I.4.8; J.3 Whole slide images (WSIs) are vital in digital pathology, enabling gigapixel tissue analysis across various pathological tasks. While recent advancements in multi-modal large language models (MLLMs) allow multi-task WSI analysis through natural language, they often underperform compared to task-specific models. Collaborative multi-agent systems have emerged as a promising solution to balance versatility and accuracy in healthcare, yet their potential remains underexplored in pathology-specific domains. To address these issues, we propose WSI-Agents, a novel collaborative multi-agent system for multi-modal WSI analysis. WSI-Agents integrates specialized functional agents with robust task allocation and verification mechanisms to enhance both task-specific accuracy and multi-task versatility through three components: (1) a task allocation module assigning tasks to expert agents using a model zoo of patch and WSI level MLLMs, (2) a verification mechanism ensuring accuracy through internal consistency checks and external validation using pathology knowledge bases and domain-specific models, and (3) a summary module synthesizing the final summary with visual interpretation maps. Extensive experiments on multi-modal WSI benchmarks show WSI-Agents's superiority to current WSI MLLMs and medical agent frameworks across diverse tasks. |
| title | WSI-Agents: A Collaborative Multi-Agent System for Multi-Modal Whole Slide Image Analysis |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence 68T07, 92C55 I.2.7; I.4.8; J.3 |
| url | https://arxiv.org/abs/2507.14680 |