Saved in:
Bibliographic Details
Main Authors: Kharouiche, Oussama, Markogiannakis, Aris, Fei, Xiao, Chatzianastasis, Michail, Vazirgiannis, Michalis
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.24840
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917002716643328
author Kharouiche, Oussama
Markogiannakis, Aris
Fei, Xiao
Chatzianastasis, Michail
Vazirgiannis, Michalis
author_facet Kharouiche, Oussama
Markogiannakis, Aris
Fei, Xiao
Chatzianastasis, Michail
Vazirgiannis, Michalis
contents Single-cell RNA sequencing has transformed biology by enabling the measurement of gene expression at cellular resolution, providing information for cell types, states, and disease contexts. Recently, single-cell foundation models have emerged as powerful tools for learning transferable representations directly from expression profiles, improving performance on classification and clustering tasks. However, these models are limited to discrete prediction heads, which collapse cellular complexity into predefined labels that fail to capture the richer, contextual explanations biologists need. We introduce Cell2Text, a multimodal generative framework that translates scRNA-seq profiles into structured natural language descriptions. By integrating gene-level embeddings from single-cell foundation models with pretrained large language models, Cell2Text generates coherent summaries that capture cellular identity, tissue origin, disease associations, and pathway activity, generalizing to unseen cells. Empirically, Cell2Text outperforms baselines on classification accuracy, demonstrates strong ontological consistency using PageRank-based similarity metrics, and achieves high semantic fidelity in text generation. These results demonstrate that coupling expression data with natural language offers both stronger predictive performance and inherently interpretable outputs, pointing to a scalable path for label-efficient characterization of unseen cells.
format Preprint
id arxiv_https___arxiv_org_abs_2509_24840
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cell2Text: Multimodal LLM for Generating Single-Cell Descriptions from RNA-Seq Data
Kharouiche, Oussama
Markogiannakis, Aris
Fei, Xiao
Chatzianastasis, Michail
Vazirgiannis, Michalis
Machine Learning
Computational Engineering, Finance, and Science
Single-cell RNA sequencing has transformed biology by enabling the measurement of gene expression at cellular resolution, providing information for cell types, states, and disease contexts. Recently, single-cell foundation models have emerged as powerful tools for learning transferable representations directly from expression profiles, improving performance on classification and clustering tasks. However, these models are limited to discrete prediction heads, which collapse cellular complexity into predefined labels that fail to capture the richer, contextual explanations biologists need. We introduce Cell2Text, a multimodal generative framework that translates scRNA-seq profiles into structured natural language descriptions. By integrating gene-level embeddings from single-cell foundation models with pretrained large language models, Cell2Text generates coherent summaries that capture cellular identity, tissue origin, disease associations, and pathway activity, generalizing to unseen cells. Empirically, Cell2Text outperforms baselines on classification accuracy, demonstrates strong ontological consistency using PageRank-based similarity metrics, and achieves high semantic fidelity in text generation. These results demonstrate that coupling expression data with natural language offers both stronger predictive performance and inherently interpretable outputs, pointing to a scalable path for label-efficient characterization of unseen cells.
title Cell2Text: Multimodal LLM for Generating Single-Cell Descriptions from RNA-Seq Data
topic Machine Learning
Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2509.24840