Imagen de Portada

Efficient and Scalable Fine-Tune of Language Models for Genome Understanding

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhan, Huixin, Wu, Ying Nian, Zhang, Zijun
Formato:	Preprint
Publicado:	2024
Materias:	Genomics Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DYNA: Disease-Specific Language Model for Variant Pathogenicity
por: Zhan, Huixin, et al.
Publicado: (2024)

DNABERT-2: Fine-Tuning a Genomic Language Model for Colorectal Gene Enhancer Classification
por: King, Darren, et al.
Publicado: (2025)

Long-range gene expression prediction with token alignment of large language model
por: Honig, Edouardo, et al.
Publicado: (2024)

Celler:A Genomic Language Model for Long-Tailed Single-Cell Annotation
por: Zhao, Huan, et al.
Publicado: (2025)

Multimodal 3D Genome Pre-training
por: Yang, Minghao, et al.
Publicado: (2025)

xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Data
por: Gong, Jing, et al.
Publicado: (2023)

Enhanced Gene Selection in Single-Cell Genomics: Pre-Filtering Synergy and Reinforced Optimization
por: Zhang, Weiliang, et al.
Publicado: (2024)

MergeDNA: Context-aware Genome Modeling with Dynamic Tokenization through Token Merging
por: Li, Siyuan, et al.
Publicado: (2025)

Absorb & Escape: Overcoming Single Model Limitations in Generating Genomic Sequences
por: Li, Zehui, et al.
Publicado: (2024)

How Private Are DNA Embeddings? Inverting Foundation Model Representations of Genomic Sequences
por: Ouaari, Sofiane, et al.
Publicado: (2026)

Omni-DNA: A Unified Genomic Foundation Model for Cross-Modal and Multi-Task Learning
por: Li, Zehui, et al.
Publicado: (2025)

Genomic Next-Token Predictors are In-Context Learners
por: Breslow, Nathan, et al.
Publicado: (2025)

Meta-Learning on Augmented Gene Expression Profiles for Enhanced Lung Cancer Detection
por: Moghaddam, Arya Hadizadeh, et al.
Publicado: (2024)

TEPI: Taxonomy-aware Embedding and Pseudo-Imaging for Scarcely-labeled Zero-shot Genome Classification
por: Aakur, Sathyanarayanan, et al.
Publicado: (2024)

GeneZip: Region-Aware Compression for Long Context DNA Modeling
por: Zhao, Jianan, et al.
Publicado: (2026)

GenoBERT: A Language Model for Accurate Genotype Imputation
por: Huang, Lei, et al.
Publicado: (2026)

Fast and Scalable Gene Embedding Search: A Comparative Study of FAISS and ScaNN
por: Refahi, Mohammad Saleh, et al.
Publicado: (2025)

Machine Learning-Based Genomic Linguistic Analysis (Gene Sequence Feature Learning): A Case Study on Predicting Heavy Metal Response Genes in Rice
por: Yang, Ruiqi, et al.
Publicado: (2025)

FGBERT: Function-Driven Pre-trained Gene Language Model for Metagenomics
por: Duan, ChenRui, et al.
Publicado: (2024)

Knowledge-guided Contextual Gene Set Analysis Using Large Language Models
por: Wang, Zhizheng, et al.
Publicado: (2025)

SeqMate: A Novel Large Language Model Pipeline for Automating RNA Sequencing
por: Mondal, Devam, et al.
Publicado: (2024)

Revolutionizing Genomics with Reinforcement Learning Techniques
por: Karami, Mohsen, et al.
Publicado: (2023)

HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model
por: Ma, Mingqian, et al.
Publicado: (2025)

Gene42: Long-Range Genomic Foundation Model With Dense Attention
por: Vishniakov, Kirill, et al.
Publicado: (2025)

Revisiting K-mer Profile for Effective and Scalable Genome Representation Learning
por: Celikkanat, Abdulkadir, et al.
Publicado: (2024)

Exploring the Potentials and Challenges of Using Large Language Models for the Analysis of Transcriptional Regulation of Long Non-coding RNAs
por: Wang, Wei, et al.
Publicado: (2024)

F5C-finder: An Explainable and Ensemble Biological Language Model for Predicting 5-Formylcytidine Modifications on mRNA
por: Wang, Guohao, et al.
Publicado: (2024)

Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models
por: Wu, Weimin, et al.
Publicado: (2025)

UniPTMs: The First Unified Multi-type PTM Site Prediction Model via Master-Slave Architecture-Based Multi-Stage Fusion Strategy and Hierarchical Contrastive Loss
por: Lin, Yiyu, et al.
Publicado: (2025)

scCDCG: Efficient Deep Structural Clustering for single-cell RNA-seq via Deep Cut-informed Graph Embedding
por: Xu, Ping, et al.
Publicado: (2024)

eDOC: Explainable Decoding Out-of-domain Cell Types with Evidential Learning
por: Wu, Chaochen, et al.
Publicado: (2024)

Deep Generative Models for Discrete Genotype Simulation
por: Xie, Sihan, et al.
Publicado: (2025)

Pan-infection Foundation Framework Enables Multiple Pathogen Prediction
por: Zhang, Lingrui, et al.
Publicado: (2024)

DiscDiff: Latent Diffusion Model for DNA Sequence Generation
por: Li, Zehui, et al.
Publicado: (2024)

BSM: Small but Powerful Biological Sequence Model for Genes and Proteins
por: Xiang, Weixi, et al.
Publicado: (2024)

SToFM: a Multi-scale Foundation Model for Spatial Transcriptomics
por: Zhao, Suyuan, et al.
Publicado: (2025)

Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decoding
por: Li, Xiner, et al.
Publicado: (2024)

Soft Graph Clustering for single-cell RNA Sequencing Data
por: Xu, Ping, et al.
Publicado: (2025)

stMCDI: Masked Conditional Diffusion Model with Graph Neural Network for Spatial Transcriptomics Data Imputation
por: Li, Xiaoyu, et al.
Publicado: (2024)

TFBS-Finder: Deep Learning-based Model with DNABERT and Convolutional Networks to Predict Transcription Factor Binding Sites
por: Ghosh, Nimisha, et al.
Publicado: (2025)