GenoBERT: A Language Model for Accurate Genotype Imputation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912993294417920 |
|---|---|
| author | Huang, Lei Qiu, Chuan Su, Kuan-Jui Liu, Anqi Gong, Yun Lin, Weiqiang Jiang, Lindong Zhao, Chen Song, Meng Deng, Jeffrey Tian, Qing Luo, Zhe Gong, Ping Shen, Hui Zhang, Chaoyang Deng, Hong-Wen |
| author_facet | Huang, Lei Qiu, Chuan Su, Kuan-Jui Liu, Anqi Gong, Yun Lin, Weiqiang Jiang, Lindong Zhao, Chen Song, Meng Deng, Jeffrey Tian, Qing Luo, Zhe Gong, Ping Shen, Hui Zhang, Chaoyang Deng, Hong-Wen |
| contents | Genotype imputation enables dense variant coverage for genome-wide association and risk-prediction studies, yet conventional reference-panel methods remain limited by ancestry bias and reduced rare-variant accuracy. We present Genotype Bidirectional Encoder Representations from Transformers (GenoBERT), a transformer-based, reference-free framework that tokenizes phased genotypes and uses a self-attention mechanism to capture both short- and long-range linkage disequilibrium (LD) dependencies. Benchmarking on two independent datasets including the Louisiana Osteoporosis Study (LOS) and the 1000 Genomes Project (1KGP) across ancestry groups and multiple genotype missingness levels (5-50%) shows that GenoBERT achieves the highest overall accuracy compared to four baseline methods (Beagle5.4, SCDA, BiU-Net, and STICI). At practical sparsity levels (up to 25% missing), GenoBERT attains high overall imputation accuracy ($r^2 approx 0.98$) across datasets, and maintains robust performance ($r^2 > 0.90$) even at 50% missingness. Experimental results across different ancestries confirm consistent gains across datasets, with resilience to small sample sizes and weak LD. A 128-SNP (single-nucleotide polymorphism) context window (approximately 100 Kb) is validated through LD-decay analyses as sufficient to capture local correlation structures. By eliminating reference-panel dependence while preserving high accuracy, GenoBERT provides a scalable and robust solution for genotype imputation and a foundation for downstream genomic modeling. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_00058 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | GenoBERT: A Language Model for Accurate Genotype Imputation Huang, Lei Qiu, Chuan Su, Kuan-Jui Liu, Anqi Gong, Yun Lin, Weiqiang Jiang, Lindong Zhao, Chen Song, Meng Deng, Jeffrey Tian, Qing Luo, Zhe Gong, Ping Shen, Hui Zhang, Chaoyang Deng, Hong-Wen Genomics Artificial Intelligence Machine Learning Genotype imputation enables dense variant coverage for genome-wide association and risk-prediction studies, yet conventional reference-panel methods remain limited by ancestry bias and reduced rare-variant accuracy. We present Genotype Bidirectional Encoder Representations from Transformers (GenoBERT), a transformer-based, reference-free framework that tokenizes phased genotypes and uses a self-attention mechanism to capture both short- and long-range linkage disequilibrium (LD) dependencies. Benchmarking on two independent datasets including the Louisiana Osteoporosis Study (LOS) and the 1000 Genomes Project (1KGP) across ancestry groups and multiple genotype missingness levels (5-50%) shows that GenoBERT achieves the highest overall accuracy compared to four baseline methods (Beagle5.4, SCDA, BiU-Net, and STICI). At practical sparsity levels (up to 25% missing), GenoBERT attains high overall imputation accuracy ($r^2 approx 0.98$) across datasets, and maintains robust performance ($r^2 > 0.90$) even at 50% missingness. Experimental results across different ancestries confirm consistent gains across datasets, with resilience to small sample sizes and weak LD. A 128-SNP (single-nucleotide polymorphism) context window (approximately 100 Kb) is validated through LD-decay analyses as sufficient to capture local correlation structures. By eliminating reference-panel dependence while preserving high accuracy, GenoBERT provides a scalable and robust solution for genotype imputation and a foundation for downstream genomic modeling. |
| title | GenoBERT: A Language Model for Accurate Genotype Imputation |
| topic | Genomics Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2604.00058 |