Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.07173 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912267650465792 |
|---|---|
| author | Nishimura, Kazuya Bise, Ryoma Kojima, Yasuhiro |
| author_facet | Nishimura, Kazuya Bise, Ryoma Kojima, Yasuhiro |
| contents | Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may be valuable to augment image representation with pathological information. However, there are no attempts to leverage ST for image recognition ({\it i.e,} patch-level classification of subtypes of pathological image.). One of the big challenges is significant batch effects in spatial transcriptomics that make it difficult to extract pathological features of images from ST. In this paper, we propose a batch-agnostic contrastive learning framework that can extract consistent signals from gene expression of ST in multiple patients. To extract consistent signals from ST, we utilize the batch-agnostic gene encoder that is trained in a variational inference manner. Experiments demonstrated the effectiveness of our framework on a publicly available dataset. Code is publicly available at https://github.com/naivete5656/TPIRBAE |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_07173 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Towards Spatial Transcriptomics-guided Pathological Image Recognition with Batch-Agnostic Encoder Nishimura, Kazuya Bise, Ryoma Kojima, Yasuhiro Computer Vision and Pattern Recognition Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may be valuable to augment image representation with pathological information. However, there are no attempts to leverage ST for image recognition ({\it i.e,} patch-level classification of subtypes of pathological image.). One of the big challenges is significant batch effects in spatial transcriptomics that make it difficult to extract pathological features of images from ST. In this paper, we propose a batch-agnostic contrastive learning framework that can extract consistent signals from gene expression of ST in multiple patients. To extract consistent signals from ST, we utilize the batch-agnostic gene encoder that is trained in a variational inference manner. Experiments demonstrated the effectiveness of our framework on a publicly available dataset. Code is publicly available at https://github.com/naivete5656/TPIRBAE |
| title | Towards Spatial Transcriptomics-guided Pathological Image Recognition with Batch-Agnostic Encoder |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.07173 |