Imagen de Portada

Scaling Laws for Masked-Reconstruction Transformers on Single-Cell Transcriptomics

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Kendiukhov, Ihor
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Genomics
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Multi-Dimensional Spectral Geometry of Biological Knowledge in Single-Cell Transformer Representations
por: Kendiukhov, Ihor
Publicado: (2026)

Causal Circuit Tracing Reveals Distinct Computational Architectures in Single-Cell Foundation Models: Inhibitory Dominance, Biological Coherence, and Cross-Model Convergence
por: Kendiukhov, Ihor
Publicado: (2026)

Discovery of a Hematopoietic Manifold in scGPT Yields a Method for Extracting Performant Algorithms from Biological Foundation Model Internals
por: Kendiukhov, Ihor
Publicado: (2026)

What Topological and Geometric Structure Do Biological Foundation Models Learn? Evidence from 141 Hypotheses
por: Kendiukhov, Ihor
Publicado: (2026)

Sparse autoencoders reveal organized biological knowledge but minimal regulatory logic in single-cell foundation models: a comparative atlas of Geneformer and scGPT
por: Kendiukhov, Ihor
Publicado: (2026)

Systematic Evaluation of Single-Cell Foundation Model Interpretability Reveals Attention Captures Co-Expression Rather Than Unique Regulatory Signal
por: Kendiukhov, Ihor
Publicado: (2026)

Graph Neural Networks as a Substitute for Transformers in Single-Cell Transcriptomics
por: Qi, Jiaxin, et al.
Publicado: (2025)

Single Cells Are Spatial Tokens: Transformers for Spatial Transcriptomic Data Imputation
por: Wen, Hongzhi, et al.
Publicado: (2023)

A New Framework for Explainable Rare Cell Identification in Single-Cell Transcriptomics Data
por: Su, Di, et al.
Publicado: (2026)

Scalable Amortized GPLVMs for Single Cell Transcriptomics Data
por: Zhao, Sarah, et al.
Publicado: (2024)

Gene Incremental Learning for Single-Cell Transcriptomics
por: Qi, Jiaxin, et al.
Publicado: (2025)

Geometry-First Generative Spatial Single-Cell Reconstruction
por: Azim, Ehtesamul, et al.
Publicado: (2026)

Deep Learning in Single-Cell and Spatial Transcriptomics Data Analysis: Advances and Challenges from a Data Science Perspective
por: Ge, Shuang, et al.
Publicado: (2024)

Masked Graph Autoencoders with Contrastive Augmentation for Spatially Resolved Transcriptomics Data
por: Fang, Donghai, et al.
Publicado: (2024)

A Large-Scale Comparative Analysis of Imputation Methods for Single-Cell RNA Sequencing Data
por: Iwashita, Yuichiro, et al.
Publicado: (2026)

Exhaustive Circuit Mapping of a Single-Cell Foundation Model Reveals Massive Redundancy, Heavy-Tailed Hub Architecture, and Layer-Dependent Differentiation Control
por: Kendiukhov, Ihor
Publicado: (2026)

Benchmarking Dimensionality Reduction Techniques for Spatial Transcriptomics
por: Mahmud, Md Ishtyaq, et al.
Publicado: (2025)

stMCDI: Masked Conditional Diffusion Model with Graph Neural Network for Spatial Transcriptomics Data Imputation
por: Li, Xiaoyu, et al.
Publicado: (2024)

Multiscale Grassmann Manifolds for Single-Cell Data Analysis
por: Wang, Xiang Xiang, et al.
Publicado: (2025)

Reconstructing Cell Lineage Trees from Phenotypic Features with Metric Learning
por: Kuang, Da, et al.
Publicado: (2025)

DOGMA: Weaving Structural Information into Data-centric Single-cell Transcriptomics Analysis
por: Zhang, Ru, et al.
Publicado: (2026)

PACE: Geometry-Aware Bridge Transport for Single-Cell Trajectory Inference
por: Yu, Chenglei, et al.
Publicado: (2026)

Scalable Single-Cell Gene Expression Generation with Latent Diffusion Models
por: Palla, Giovanni, et al.
Publicado: (2025)

Transcriptomic Models for Immunotherapy Response Prediction Show Limited Cross-cohort Generalisability
por: Liang, Yuheng, et al.
Publicado: (2026)

Discovery of Disease Relationships via Transcriptomic Signature Analysis Powered by Agentic AI
por: Chen, Ke, et al.
Publicado: (2025)

Towards Applying Large Language Models to Complement Single-Cell Foundation Models
por: Palayew, Steven, et al.
Publicado: (2025)

SUICA: Learning Super-high Dimensional Sparse Implicit Neural Representations for Spatial Transcriptomics
por: Zhu, Qingtian, et al.
Publicado: (2024)

CellStream: Dynamical Optimal Transport Informed Embeddings for Reconstructing Cellular Trajectories from Snapshots Data
por: Ling, Yue, et al.
Publicado: (2025)

SemanticST: Spatially Informed Semantic Graph Learning for Clustering, Integration, and Scalable Analysis of Spatial Transcriptomics
por: Zahedi, Roxana, et al.
Publicado: (2025)

sc-OTGM: Single-Cell Perturbation Modeling by Solving Optimal Mass Transport on the Manifold of Gaussian Mixtures
por: Demir, Andac, et al.
Publicado: (2024)

Predicting Gene Disease Associations in Type 2 Diabetes Using Machine Learning on Single-Cell RNA-Seq Data
por: Toledo, Maria De La Luz Lomboy, et al.
Publicado: (2026)

TransST: Transfer Learning Embedded Spatial Factor Modeling of Spatial Transcriptomics Data
por: Liu, Shuo Shuo, et al.
Publicado: (2025)

STRAND: Sequence-Conditioned Transport for Single-Cell Perturbations
por: Fu, Boyang, et al.
Publicado: (2026)

Multi-Modal and Multi-Attribute Generation of Single Cells with CFGen
por: Palma, Alessandro, et al.
Publicado: (2024)

HEIST: A Graph Foundation Model for Spatial Transcriptomics and Proteomics Data
por: Madhu, Hiren, et al.
Publicado: (2025)

SToFM: a Multi-scale Foundation Model for Spatial Transcriptomics
por: Zhao, Suyuan, et al.
Publicado: (2025)

Estimating the Causal Effects of T Cell Receptors
por: Weinstein, Eli N., et al.
Publicado: (2024)

GeneMamba: An Efficient and Effective Foundation Model on Single Cell Data
por: Qi, Cong, et al.
Publicado: (2025)

Discovering Interpretable Biological Concepts in Single-cell RNA-seq Foundation Models
por: Claye, Charlotte, et al.
Publicado: (2025)

Celler:A Genomic Language Model for Long-Tailed Single-Cell Annotation
por: Zhao, Huan, et al.
Publicado: (2025)