Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2411.11613 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929597685170176 |
|---|---|
| author | Barash, Danny Manning, Emilie Van Vleck, Aidan Hirsch, Omri Aye, Kyi Lei Li, Jingxi Scumpia, Philip O. Ozcan, Aydogan Aasi, Sumaira Rieger, Kerri E. Sarin, Kavita Y. Freifeld, Oren Winetraub, Yonatan |
| author_facet | Barash, Danny Manning, Emilie Van Vleck, Aidan Hirsch, Omri Aye, Kyi Lei Li, Jingxi Scumpia, Philip O. Ozcan, Aydogan Aasi, Sumaira Rieger, Kerri E. Sarin, Kavita Y. Freifeld, Oren Winetraub, Yonatan |
| contents | Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of expert labelers and the large dataset required (>100,000 images) for model training and tuning are the main hurdles in creating foundation models. In this paper we introduce FoundationShift, a method to apply any AI model from computational pathology without retraining. We show our method is more accurate than state of the art models (SAM, MedSAM, SAM-Med2D, CellProfiler, Hover-Net, PLIP, UNI and ChatGPT), with multiple imaging modalities (OCT and RCM). This is achieved without the need for model retraining or fine-tuning. Applying our method to noninvasive in vivo images could enable physicians to readily incorporate optical imaging modalities into their clinical practice, providing real time tissue analysis and improving patient care. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_11613 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Leveraging Computational Pathology AI for Noninvasive Optical Imaging Analysis Without Retraining Barash, Danny Manning, Emilie Van Vleck, Aidan Hirsch, Omri Aye, Kyi Lei Li, Jingxi Scumpia, Philip O. Ozcan, Aydogan Aasi, Sumaira Rieger, Kerri E. Sarin, Kavita Y. Freifeld, Oren Winetraub, Yonatan Computer Vision and Pattern Recognition Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of expert labelers and the large dataset required (>100,000 images) for model training and tuning are the main hurdles in creating foundation models. In this paper we introduce FoundationShift, a method to apply any AI model from computational pathology without retraining. We show our method is more accurate than state of the art models (SAM, MedSAM, SAM-Med2D, CellProfiler, Hover-Net, PLIP, UNI and ChatGPT), with multiple imaging modalities (OCT and RCM). This is achieved without the need for model retraining or fine-tuning. Applying our method to noninvasive in vivo images could enable physicians to readily incorporate optical imaging modalities into their clinical practice, providing real time tissue analysis and improving patient care. |
| title | Leveraging Computational Pathology AI for Noninvasive Optical Imaging Analysis Without Retraining |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.11613 |