Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.13049 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916694733094912 |
|---|---|
| author | Zhao, Wenmin Solaguren-Beascoa, Ana Neilson, Grant Muhammed, Louwai Laaniste, Liisi Cakiroglu, Sera Aylin |
| author_facet | Zhao, Wenmin Solaguren-Beascoa, Ana Neilson, Grant Muhammed, Louwai Laaniste, Liisi Cakiroglu, Sera Aylin |
| contents | Recent advances in applying deep learning in genomics include DNA-language and single-cell foundation models. However, these models take only one data type as input. We introduce dynamic token adaptation and demonstrate how it combines these models to predict gene regulation at the single-cell level in different genetic contexts. Although the method is generalisable, we focus on an illustrative example by training an adapter from DNA-sequence embeddings to a single-cell foundation model's token embedding space. As a qualitative evaluation, we assess the impact of DNA sequence changes on the model's learned gene regulatory networks by mutating the transcriptional start site of the transcription factor GATA4 in silico, observing predicted expression changes in its target genes in fetal cardiomyocytes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_13049 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Multi-modal single-cell foundation models via dynamic token adaptation Zhao, Wenmin Solaguren-Beascoa, Ana Neilson, Grant Muhammed, Louwai Laaniste, Liisi Cakiroglu, Sera Aylin Genomics Recent advances in applying deep learning in genomics include DNA-language and single-cell foundation models. However, these models take only one data type as input. We introduce dynamic token adaptation and demonstrate how it combines these models to predict gene regulation at the single-cell level in different genetic contexts. Although the method is generalisable, we focus on an illustrative example by training an adapter from DNA-sequence embeddings to a single-cell foundation model's token embedding space. As a qualitative evaluation, we assess the impact of DNA sequence changes on the model's learned gene regulatory networks by mutating the transcriptional start site of the transcription factor GATA4 in silico, observing predicted expression changes in its target genes in fetal cardiomyocytes. |
| title | Multi-modal single-cell foundation models via dynamic token adaptation |
| topic | Genomics |
| url | https://arxiv.org/abs/2504.13049 |