MMAP: A Multi-Magnification and Prototype-Aware Architecture for Predicting Spatial Gene Expression

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nguyen, Hai Dang, Pham, Nguyen Dang Huy, Nguyen, The Minh Duc, Nguyen, Dac Thai, Nguyen, Hang Thi, Nguyen, Duong M.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914578745524224
author Nguyen, Hai Dang
Pham, Nguyen Dang Huy
Nguyen, The Minh Duc
Nguyen, Dac Thai
Nguyen, Hang Thi
Nguyen, Duong M.
author_facet Nguyen, Hai Dang
Pham, Nguyen Dang Huy
Nguyen, The Minh Duc
Nguyen, Dac Thai
Nguyen, Hang Thi
Nguyen, Duong M.
contents Spatial Transcriptomics (ST) enables the measurement of gene expression while preserving spatial information, offering critical insights into tissue architecture and disease pathology. Recent developments have explored the use of hematoxylin and eosin (H&E)-stained whole-slide images (WSIs) to predict transcriptome-wide gene expression profiles through deep neural networks. This task is commonly framed as a regression problem, where each input corresponds to a localized image patch extracted from the WSI. However, predicting spatial gene expression from histological images remains a challenging problem due to the significant modality gap between visual features and molecular signals. Recent studies have attempted to incorporate both local and global information into predictive models. Nevertheless, existing methods still suffer from two key limitations: (1) insufficient granularity in local feature extraction, and (2) inadequate coverage of global spatial context. In this work, we propose a novel framework, MMAP (Multi-MAgnification and Prototype-enhanced architecture), that addresses both challenges simultaneously. To enhance local feature granularity, MMAP leverages multi-magnification patch representations that capture fine-grained histological details. To improve global contextual understanding, it learns a set of latent prototype embeddings that serve as compact representations of slide-level information. Extensive experimental results demonstrate that MMAP consistently outperforms all existing state-of-the-art methods across multiple evaluation metrics, including Mean Absolute Error (MAE), Mean Squared Error (MSE), and Pearson Correlation Coefficient (PCC).
format Preprint
id arxiv_https___arxiv_org_abs_2510_11344
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MMAP: A Multi-Magnification and Prototype-Aware Architecture for Predicting Spatial Gene Expression
Nguyen, Hai Dang
Pham, Nguyen Dang Huy
Nguyen, The Minh Duc
Nguyen, Dac Thai
Nguyen, Hang Thi
Nguyen, Duong M.
Computer Vision and Pattern Recognition
Spatial Transcriptomics (ST) enables the measurement of gene expression while preserving spatial information, offering critical insights into tissue architecture and disease pathology. Recent developments have explored the use of hematoxylin and eosin (H&E)-stained whole-slide images (WSIs) to predict transcriptome-wide gene expression profiles through deep neural networks. This task is commonly framed as a regression problem, where each input corresponds to a localized image patch extracted from the WSI. However, predicting spatial gene expression from histological images remains a challenging problem due to the significant modality gap between visual features and molecular signals. Recent studies have attempted to incorporate both local and global information into predictive models. Nevertheless, existing methods still suffer from two key limitations: (1) insufficient granularity in local feature extraction, and (2) inadequate coverage of global spatial context. In this work, we propose a novel framework, MMAP (Multi-MAgnification and Prototype-enhanced architecture), that addresses both challenges simultaneously. To enhance local feature granularity, MMAP leverages multi-magnification patch representations that capture fine-grained histological details. To improve global contextual understanding, it learns a set of latent prototype embeddings that serve as compact representations of slide-level information. Extensive experimental results demonstrate that MMAP consistently outperforms all existing state-of-the-art methods across multiple evaluation metrics, including Mean Absolute Error (MAE), Mean Squared Error (MSE), and Pearson Correlation Coefficient (PCC).
title MMAP: A Multi-Magnification and Prototype-Aware Architecture for Predicting Spatial Gene Expression
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.11344