TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Tianyu, Xuan, Weihao, Wu, Hao, Humphrey, Peter, DiStasio, Marcello, Kahila, Mohamed, Tan, Alfonso Garcia, Qi, Heli, Yang, Rui, Han, Simeng, Huang, Tinglin, Wu, Fang, Liu, Chen, Chen, Qingyu, Liu, Nan, Li, Irene, Xu, Hua, Zhao, Hongyu
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911570973425664
author Liu, Tianyu
Xuan, Weihao
Wu, Hao
Humphrey, Peter
DiStasio, Marcello
Kahila, Mohamed
Tan, Alfonso Garcia
Qi, Heli
Yang, Rui
Han, Simeng
Huang, Tinglin
Wu, Fang
Liu, Chen
Chen, Qingyu
Liu, Nan
Li, Irene
Xu, Hua
Zhao, Hongyu
author_facet Liu, Tianyu
Xuan, Weihao
Wu, Hao
Humphrey, Peter
DiStasio, Marcello
Kahila, Mohamed
Tan, Alfonso Garcia
Qi, Heli
Yang, Rui
Han, Simeng
Huang, Tinglin
Wu, Fang
Liu, Chen
Chen, Qingyu
Liu, Nan
Li, Irene
Xu, Hua
Zhao, Hongyu
contents Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack capacities in making the diagnosis with rigorous reasoning paths as well as handling divergent tasks, and thus, challenges of building AI Copilots for real scenarios still exist. Here we introduce TeamPath, an AI system powered by reinforcement learning and router-enhanced solutions based on large-scale histopathology multimodal datasets, to work as a virtual assistant for expert-level disease diagnosis, patch-level information summarization, and cross-modality generation to integrate transcriptomic information for clinical usage. We also collaborate with pathologists from Yale School of Medicine to demonstrate that TeamPath can assist them in working more efficiently by identifying and correcting expert conclusions and reasoning paths. We also discuss the human evaluation results to support the reasoning quality from TeamPath. Overall, TeamPath can flexibly choose the best settings according to the needs, and serve as an innovative and reliable system for information communication across different modalities and experts.
format Preprint
id arxiv_https___arxiv_org_abs_2511_17652
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots
Liu, Tianyu
Xuan, Weihao
Wu, Hao
Humphrey, Peter
DiStasio, Marcello
Kahila, Mohamed
Tan, Alfonso Garcia
Qi, Heli
Yang, Rui
Han, Simeng
Huang, Tinglin
Wu, Fang
Liu, Chen
Chen, Qingyu
Liu, Nan
Li, Irene
Xu, Hua
Zhao, Hongyu
Quantitative Methods
Computer Vision and Pattern Recognition
Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack capacities in making the diagnosis with rigorous reasoning paths as well as handling divergent tasks, and thus, challenges of building AI Copilots for real scenarios still exist. Here we introduce TeamPath, an AI system powered by reinforcement learning and router-enhanced solutions based on large-scale histopathology multimodal datasets, to work as a virtual assistant for expert-level disease diagnosis, patch-level information summarization, and cross-modality generation to integrate transcriptomic information for clinical usage. We also collaborate with pathologists from Yale School of Medicine to demonstrate that TeamPath can assist them in working more efficiently by identifying and correcting expert conclusions and reasoning paths. We also discuss the human evaluation results to support the reasoning quality from TeamPath. Overall, TeamPath can flexibly choose the best settings according to the needs, and serve as an innovative and reliable system for information communication across different modalities and experts.
title TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots
topic Quantitative Methods
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.17652