High-Resolution Spatial Transcriptomics from Histology Images using HisToSGE

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Shi, Zhiceng, Xue, Shuailin, Zhu, Fangfang, Min, Wenwen
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929441633992704
author Shi, Zhiceng
Xue, Shuailin
Zhu, Fangfang
Min, Wenwen
author_facet Shi, Zhiceng
Xue, Shuailin
Zhu, Fangfang
Min, Wenwen
contents Spatial transcriptomics (ST) is a groundbreaking genomic technology that enables spatial localization analysis of gene expression within tissue sections. However, it is significantly limited by high costs and sparse spatial resolution. An alternative, more cost-effective strategy is to use deep learning methods to predict high-density gene expression profiles from histological images. However, existing methods struggle to capture rich image features effectively or rely on low-dimensional positional coordinates, making it difficult to accurately predict high-resolution gene expression profiles. To address these limitations, we developed HisToSGE, a method that employs a Pathology Image Large Model (PILM) to extract rich image features from histological images and utilizes a feature learning module to robustly generate high-resolution gene expression profiles. We evaluated HisToSGE on four ST datasets, comparing its performance with five state-of-the-art baseline methods. The results demonstrate that HisToSGE excels in generating high-resolution gene expression profiles and performing downstream tasks such as spatial domain identification. All code and public datasets used in this paper are available at https://github.com/wenwenmin/HisToSGE and https://zenodo.org/records/12792163.
format Preprint
id arxiv_https___arxiv_org_abs_2407_20518
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle High-Resolution Spatial Transcriptomics from Histology Images using HisToSGE
Shi, Zhiceng
Xue, Shuailin
Zhu, Fangfang
Min, Wenwen
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Spatial transcriptomics (ST) is a groundbreaking genomic technology that enables spatial localization analysis of gene expression within tissue sections. However, it is significantly limited by high costs and sparse spatial resolution. An alternative, more cost-effective strategy is to use deep learning methods to predict high-density gene expression profiles from histological images. However, existing methods struggle to capture rich image features effectively or rely on low-dimensional positional coordinates, making it difficult to accurately predict high-resolution gene expression profiles. To address these limitations, we developed HisToSGE, a method that employs a Pathology Image Large Model (PILM) to extract rich image features from histological images and utilizes a feature learning module to robustly generate high-resolution gene expression profiles. We evaluated HisToSGE on four ST datasets, comparing its performance with five state-of-the-art baseline methods. The results demonstrate that HisToSGE excels in generating high-resolution gene expression profiles and performing downstream tasks such as spatial domain identification. All code and public datasets used in this paper are available at https://github.com/wenwenmin/HisToSGE and https://zenodo.org/records/12792163.
title High-Resolution Spatial Transcriptomics from Histology Images using HisToSGE
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.20518