Systematic Evaluation of Single-Cell Foundation Model Interpretability Reveals Attention Captures Co-Expression Rather Than Unique Regulatory Signal
Fuente:
arXiv
Guardado en:
| Autor principal: | Kendiukhov, Ihor |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Multi-Dimensional Spectral Geometry of Biological Knowledge in Single-Cell Transformer Representations
por: Kendiukhov, Ihor
Publicado: (2026)
por: Kendiukhov, Ihor
Publicado: (2026)
Causal Circuit Tracing Reveals Distinct Computational Architectures in Single-Cell Foundation Models: Inhibitory Dominance, Biological Coherence, and Cross-Model Convergence
por: Kendiukhov, Ihor
Publicado: (2026)
por: Kendiukhov, Ihor
Publicado: (2026)
Scaling Laws for Masked-Reconstruction Transformers on Single-Cell Transcriptomics
por: Kendiukhov, Ihor
Publicado: (2026)
por: Kendiukhov, Ihor
Publicado: (2026)
What Topological and Geometric Structure Do Biological Foundation Models Learn? Evidence from 141 Hypotheses
por: Kendiukhov, Ihor
Publicado: (2026)
por: Kendiukhov, Ihor
Publicado: (2026)
Discovery of a Hematopoietic Manifold in scGPT Yields a Method for Extracting Performant Algorithms from Biological Foundation Model Internals
por: Kendiukhov, Ihor
Publicado: (2026)
por: Kendiukhov, Ihor
Publicado: (2026)
Sparse autoencoders reveal organized biological knowledge but minimal regulatory logic in single-cell foundation models: a comparative atlas of Geneformer and scGPT
por: Kendiukhov, Ihor
Publicado: (2026)
por: Kendiukhov, Ihor
Publicado: (2026)
ELISA: An Interpretable Hybrid Generative AI Agent for Expression-Grounded Discovery in Single-Cell Genomics
por: Coser, Omar
Publicado: (2026)
por: Coser, Omar
Publicado: (2026)
Learning to Discover Regulatory Elements for Gene Expression Prediction
por: Su, Xingyu, et al.
Publicado: (2025)
por: Su, Xingyu, et al.
Publicado: (2025)
CellxPert: Inference-Time MCMC Steering of a Multi-Omics Single-Cell Foundation Model for In-Silico Perturbation
por: Demir, Andac, et al.
Publicado: (2026)
por: Demir, Andac, et al.
Publicado: (2026)
scInterpreter: Training Large Language Models to Interpret scRNA-seq Data for Cell Type Annotation
por: Li, Cong, et al.
Publicado: (2024)
por: Li, Cong, et al.
Publicado: (2024)
scBench: Evaluating AI Agents on Single-Cell RNA-seq Analysis
por: Workman, Kenny, et al.
Publicado: (2026)
por: Workman, Kenny, et al.
Publicado: (2026)
scPilot: Large Language Model Reasoning Toward Automated Single-Cell Analysis and Discovery
por: Gao, Yiming, et al.
Publicado: (2026)
por: Gao, Yiming, et al.
Publicado: (2026)
Bridging Large Language Models and Single-Cell Transcriptomics in Dissecting Selective Motor Neuron Vulnerability
por: Jiang, Douglas, et al.
Publicado: (2025)
por: Jiang, Douglas, et al.
Publicado: (2025)
scGSDR: Harnessing Gene Semantics for Single-Cell Pharmacological Profiling
por: Huang, Yu-An, et al.
Publicado: (2025)
por: Huang, Yu-An, et al.
Publicado: (2025)
scUnified: An AI-Ready Standardized Resource for Single-Cell RNA Sequencing Analysis
por: Xu, Ping, et al.
Publicado: (2025)
por: Xu, Ping, et al.
Publicado: (2025)
scCluBench: Comprehensive Benchmarking of Clustering Algorithms for Single-Cell RNA Sequencing
por: Xu, Ping, et al.
Publicado: (2025)
por: Xu, Ping, et al.
Publicado: (2025)
Beyond Conditional Computation: Retrieval-Augmented Genomic Foundation Models with Gengram
por: Xu, Huinan, et al.
Publicado: (2026)
por: Xu, Huinan, et al.
Publicado: (2026)
NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction
por: Li, Zhongmin, et al.
Publicado: (2025)
por: Li, Zhongmin, et al.
Publicado: (2025)
Multimodal Modeling of CRISPR-Cas12 Activity Using Foundation Models and Chromatin Accessibility Data
por: Amirabad, Azim Dehghani, et al.
Publicado: (2025)
por: Amirabad, Azim Dehghani, et al.
Publicado: (2025)
Ctrl-DNA: Controllable Cell-Type-Specific Regulatory DNA Design via Constrained RL
por: Chen, Xingyu, et al.
Publicado: (2025)
por: Chen, Xingyu, et al.
Publicado: (2025)
EnTao-GPM: DNA Foundation Model for Predicting the Germline Pathogenic Mutations
por: Lin, Zekai, et al.
Publicado: (2025)
por: Lin, Zekai, et al.
Publicado: (2025)
JEPA-DNA: Grounding Genomic Foundation Models through Joint-Embedding Predictive Architectures
por: Larey, Ariel, et al.
Publicado: (2026)
por: Larey, Ariel, et al.
Publicado: (2026)
Knowledge-Guided Biomarker Identification for Label-Free Single-Cell RNA-Seq Data: A Reinforcement Learning Perspective
por: Xiao, Meng, et al.
Publicado: (2025)
por: Xiao, Meng, et al.
Publicado: (2025)
Open World Knowledge Aided Single-Cell Foundation Model with Robust Cross-Modal Cell-Language Pre-training
por: Wang, Haoran, et al.
Publicado: (2026)
por: Wang, Haoran, et al.
Publicado: (2026)
Helix-mRNA: A Hybrid Foundation Model For Full Sequence mRNA Therapeutics
por: Wood, Matthew, et al.
Publicado: (2025)
por: Wood, Matthew, et al.
Publicado: (2025)
Celler:A Genomic Language Model for Long-Tailed Single-Cell Annotation
por: Zhao, Huan, et al.
Publicado: (2025)
por: Zhao, Huan, et al.
Publicado: (2025)
Leveraging Gene Expression Data and Explainable Machine Learning for Enhanced Early Detection of Type 2 Diabetes
por: Roy, Aurora Lithe, et al.
Publicado: (2024)
por: Roy, Aurora Lithe, et al.
Publicado: (2024)
Gene Incremental Learning for Single-Cell Transcriptomics
por: Qi, Jiaxin, et al.
Publicado: (2025)
por: Qi, Jiaxin, et al.
Publicado: (2025)
SAE-RNA: A Sparse Autoencoder Model for Interpreting RNA Language Model Representations
por: Kim, Taehan, et al.
Publicado: (2025)
por: Kim, Taehan, et al.
Publicado: (2025)
Continuous Diffusion Transformers for Designing Synthetic Regulatory Elements
por: Liu, Jonathan, et al.
Publicado: (2026)
por: Liu, Jonathan, et al.
Publicado: (2026)
Context-Aware Regularization with Markovian Integration for Attention-Based Nucleotide Analysis
por: Refahi, Mohammadsaleh, et al.
Publicado: (2025)
por: Refahi, Mohammadsaleh, et al.
Publicado: (2025)
Gene42: Long-Range Genomic Foundation Model With Dense Attention
por: Vishniakov, Kirill, et al.
Publicado: (2025)
por: Vishniakov, Kirill, et al.
Publicado: (2025)
WTKO-CNN: Deep Learning Reveals Sequence Motifs Distinguishing Wild-Type and Knockout ATAC-seq Peaks
por: Dey, Lopamudra
Publicado: (2026)
por: Dey, Lopamudra
Publicado: (2026)
Interpretable graph-based models on multimodal biomedical data integration: A technical review and benchmarking
por: Sadeghi, Alireza, et al.
Publicado: (2025)
por: Sadeghi, Alireza, et al.
Publicado: (2025)
scASDC: Attention Enhanced Structural Deep Clustering for Single-cell RNA-seq Data
por: Min, Wenwen, et al.
Publicado: (2024)
por: Min, Wenwen, et al.
Publicado: (2024)
ScDiVa: Masked Discrete Diffusion for Joint Modeling of Single-Cell Identity and Expression
por: Wang, Mingxuan, et al.
Publicado: (2026)
por: Wang, Mingxuan, et al.
Publicado: (2026)
Single Cells Are Spatial Tokens: Transformers for Spatial Transcriptomic Data Imputation
por: Wen, Hongzhi, et al.
Publicado: (2023)
por: Wen, Hongzhi, et al.
Publicado: (2023)
Enhanced Gene Selection in Single-Cell Genomics: Pre-Filtering Synergy and Reinforced Optimization
por: Zhang, Weiliang, et al.
Publicado: (2024)
por: Zhang, Weiliang, et al.
Publicado: (2024)
ChromFound: Towards A Universal Foundation Model for Single-Cell Chromatin Accessibility Data
por: Jiao, Yifeng, et al.
Publicado: (2025)
por: Jiao, Yifeng, et al.
Publicado: (2025)
xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Data
por: Gong, Jing, et al.
Publicado: (2023)
por: Gong, Jing, et al.
Publicado: (2023)
Ejemplares similares
-
Multi-Dimensional Spectral Geometry of Biological Knowledge in Single-Cell Transformer Representations
por: Kendiukhov, Ihor
Publicado: (2026) -
Causal Circuit Tracing Reveals Distinct Computational Architectures in Single-Cell Foundation Models: Inhibitory Dominance, Biological Coherence, and Cross-Model Convergence
por: Kendiukhov, Ihor
Publicado: (2026) -
Scaling Laws for Masked-Reconstruction Transformers on Single-Cell Transcriptomics
por: Kendiukhov, Ihor
Publicado: (2026) -
What Topological and Geometric Structure Do Biological Foundation Models Learn? Evidence from 141 Hypotheses
por: Kendiukhov, Ihor
Publicado: (2026) -
Discovery of a Hematopoietic Manifold in scGPT Yields a Method for Extracting Performant Algorithms from Biological Foundation Model Internals
por: Kendiukhov, Ihor
Publicado: (2026)